Why? My wife has a ChatGPT $20/mth account, rarely uses now the novelty has warn off (I asked she said twice this month), the only reason she keeps paying for it is to retain the chat history. That's a tiny very rarely used docker container on a server somewhere. Maybe I'm thinking about this wrong, but I would just run this the same way we ran digitalocean, all the $5/mth accounts with no activity sit on a box configured for that, once it starts to do stuff it moves to a box with less VMs on it, etc, this is how subscription levels in cloud work, sure it cost us $100MM to get there, but now it just prints cash. If OpenAI decided to stop training models and focused on unit economics, I don't see how they couldn't get it to profitability quite quickly, even with all the competition.
Chat history is a text file. She is paying $20/mo to host a text file. If you pasted that text file back into Whatever... then you would also retain the chat history. How economical.
You're totally right on the last point: if they stopped training models and fully focused on inference efficiency, then they could totally get to profitability (but presumably would be obsolete in the medium-term unless all progress stopped). But right now, inference is very expensive, and your wife's case is the exception not the rule.
