OpenAI's Habitat storage gets 12× faster reads for ChatGPT
OpenAI describes how it scaled its Habitat storage system using multi-tenancy, global caching and Azure Cosmos DB to serve over 1 billion ChatGPT users.
OpenAIDevelopers
“Rapidly scaling online storage to serve over 1 billion ChatGPT users (Part II)”
