I run the same code against several OpenAI-compatible endpoints: hosted ones, a gateway, and a local server. Three SDK defaults caused most of my production issues.
1. The default read timeout is 10 minutes. openai.DEFAULTTIMEOUT is Timeoutconnect=5...