For AI agents: a documentation index is available at the root level at /llms.txt. Append /llms.txt to any URL for a page-level index, or .md for the markdown version of any page.
Skip to navigation New Features
Guard: For audio requests, the audio_payload flag in the request provides access to debugging information of the sample.
Gateway: For audio requests, sensitive audio material is no longer included in logs.
Quality
General: Model improvements based on client feedback.Audio (TensorRT-LLM): Added denoising to audio processing.
Bug Fixes
Guard: Fixed a bug in policy handling for audio requests where L2 samples were mistakenly labeled as L3.
Gateway: Request metadata is no longer altered for logging purposes. User-supplied metadata is now treated strictly as provided.
