What we know

OpenAI has scaled its Habitat storage system to support over 1 billion ChatGPT users by introducing reliable multi-tenancy, global caching, and using Azure Cosmos DB. These enhancements have led to a 12× increase in read speeds for ChatGPT, improving the system’s responsiveness and efficiency. Habitat now supports over 1 billion users through improved storage architecture. Key upgrades include reliable multi-tenancy, global caching, and integration with Azure Cosmos DB. These changes resulted in ChatGPT achieving 12 times faster read performance.

Why it matters

As ChatGPT’s user base grew rapidly, OpenAI needed to overcome significant storage and performance challenges. The improvements in Habitat’s design, such as serving many users securely with multi-tenancy and reducing latency via global caching, help maintain fast and reliable access to data worldwide. Leveraging Azure Cosmos DB also supports global distribution and scalability.

What is still unknown

Details on supported languages, overall system accuracy, and plans for broader deployment remain unspecified. No independent evaluations of performance improvements or energy efficiency have been published.