2,000,000,000 tokens a day — and that's not the limit. How the first small milestone was passed, who Krabbo is, and where the next billions are going.
The last fortnight went on the bits you never see from the chat: optimisations, running tools in parallel, dozens of small repairs. That sort of work usually leaves nothing to show for itself — this time it could at least be counted: more than two billion tokens a day, processed and generated combined.
The query was re-run, naturally, on the assumption a stray zero had crept in somewhere. Back at the start of the year the place was getting one visitor a day, and that only on a good one. Turned out there were exactly that many zeros — ten to the ninth. Shame it isn't in hard currency (only joking).
The interesting bit is where it all goes. About 75% to ordinary conversations. The remaining 25% to agent mode, where Seyka plans the investigation herself and hands the tasks out to subagents. One of those runs can get through nearly 50 million tokens. On a single answer. For one person who simply asked about their website. It was decided this was fine.
Seyka has another new friend — Krabbo, built on OpenClaw. He has taken QA off everyone's hands: checking that new work doesn't break old work, and catching what would otherwise, frankly, have gone unnoticed. He helps see off the small but rather unpleasant bugs, the bigger beasties lurking further down the stack, and whatever else goes bump in the night :)
Krabbo also helps our beloved moggy to "dream" — quietly rereading her own answers and getting better at them with nobody else involved. Which is to say a system that repairs itself, improves itself and generally perfects itself is already running here. Be advised that thinking about that for too long is not recommended.
There are still rather more ideas for spending tokens than there are tokens. Already being built, and due on the site shortly:
Work carries on daily, so it won't be a long wait. The headline says "not the limit" — so far that looks about right, though nobody is making any promises.
Until then the site stays completely free in early access. Yes, at those numbers. No, nobody ever quite worked out how that happened — everyone was too busy filing pull requests to their git. Thanks to everyone who has stuck around all this time — and a special hello to the ones who have, let's say, been up to mischief: you are seen, and you are loved too, because you are the ones making the moggy better 😸
If you haven't told your friends about Seyka yet, now is a very good time.
Ah yes — yesterday, 8 August, was International Cat Day, so big cheers to all of you!
Peace and love.