Content Filter Triggered on Innocent Input - DEV Community
Three different mechanisms produce what looks like one refusal, and the HTTP status plus finish_reason tells you which of the three you are arguing with.
Ähnliche Seiten
Notes on Serving LLMs with TensorRT-LLM and Triton - DEV Community