Changelog

New Features

• Guard: For audio requests, the audio_payload flag in the request provides access to debugging information of the sample.
• Gateway: For audio requests, sensitive audio material is no longer included in logs.

Quality

• General: Model improvements based on client feedback.
• Audio (TensorRT-LLM): Added denoising to audio processing.

Bug Fixes

• Guard: Fixed a bug in policy handling for audio requests where L2 samples were mistakenly labeled as L3.
• Gateway: Request metadata is no longer altered for logging purposes. User-supplied metadata is now treated strictly as provided.