OpenAI has published an account of how it scaled its online storage infrastructure to support ChatGPT at large scale. According to the company, its storage system, called Habitat, began as a Python library and was rebuilt into a globally distributed storage platform. OpenAI states that the platform now serves over 1 billion ChatGPT users and handles 22 million requests per second.
Why it matters
Serving a user base of this size at high request volumes requires storage infrastructure that can operate reliably across global regions. OpenAI’s description highlights the engineering path from a single library to a distributed platform designed for this level of demand.
Who should care
Infrastructure and platform engineers, as well as teams operating large-scale online services, may find the account relevant to understanding how storage systems are adapted to meet high-throughput, high-user-count requirements.