Vendor · The Decoder ·
OpenAI reportedly cut response costs for guest ChatGPT users by more than half
According to The Information, OpenAI cut inference costs for its AI models by more than half and applied the optimizations to ChatGPT. The report says the number of Nvidia GPUs needed for the service sometimes fell to just a few hundred.