Perplexity publishes guide to LLM gateways and their production risks

Perplexity released a practical guide to LLM gateways, covering how the intermediary layer routes, authenticates, caches and logs model calls. It warns that gateways concentrate provider credentials, citing LiteLLM flaws CVE-2026-35029 and CVE-2026-59823, fixed in version 1.83.9.

• LiteLLM sees 97M monthly downloads and over 59,000 GitHub stars
• CVE-2026-35029 and CVE-2026-59823 fixed in LiteLLM 1.83.9
• Cloudflare AI Gateway outage on June 12, 2025 hit 97% error rates
• Paid LLM gateways start at around $50 per month