Skip to content
Changelog

Eliminate connection errors in concurrent workloads by isolating HTTP/2 clients

ContributorYash Pratap SolankyStaff Software Engineer

April 14, 20261 min read

We fixed an issue where a shared HTTP/2 client was being injected across all model providers, causing connection conflicts and transient failures under concurrent load. Each provider now maintains its own client, eliminating the source of these errors across all providers simultaneously.

Shipped around the same time