LLM Gateway launches decision API that returns values, not text
LLM Gateway introduced the /v1/systemone endpoint for System One models, which answer named questions with typed values and calibrated probabilities instead of free-form text. The first model, typesafe/jev-1.13.0 from TypeSafe AI, costs $0.042 per million input tokens with free output.
- The /v1/systemone endpoint supports three question types: yes/no, choice from 2–255 options, and score across 2–10 levels
- Answers include probabilities and a confidence score, letting code set its own decision threshold
- The typesafe/jev-1.13.0 model costs $0.042 per million input tokens, with output free
- Rate limit is 600 requests per minute per organization; there is no streaming
Read next
AI