If you would like an AI “personal agent” but don’t want your data on some opaque cloud computer, there’s a new option that appears to be somewhat nicer: [rociiu] has talorys, an AI agent that runs in your Cloudflare account. True, it is still on a cloud computer, but it is your account on a cloud computer. It is designed so you can use it on Cloudflare’s free account with reasonable limits, and the code running is all on GitHub, so you can — if you are so inclined — look to see what it is doing. The data, too, is all in your cloud instance.
This seems like a reasonable compromise. Cloudflare provides the hosting, and the software in your virtual computer does all the work. At least, that’s how it is promoted. Honestly, we haven’t combed over the code, but the assertion is “Free-tier friendly… no telemetry.”
We are fairly sure they are using Cloudflare’s AI engines, too, so it would be interesting to see how much of your data they could, in theory, harvest in transit. Of course, your data is still in the cloud, so if you are really worried about privacy, this might not be for you. But since everything is in your account and open, you can at least have more control over what’s there. For example, you can easily download or delete your data. You can even see exactly what prompts it uses.
Are there downsides? Sure. The tool can’t integrate with your calendar, for example. It can’t deal with e-mail, nor can it search the web. It won’t write code for you. This isn’t meant to be a general-purpose chatbot replacement. It is more like an AI tool for keeping a task list.
While Cloudflare does have a free tier, it does have daily limits, and you may hit them. And, of course, if things like this get too popular, they could reduce those limits. The system does let you export your data, though.
It isn’t flawless. We asked it to set up three recurring meetings. It got one right, put the other one in for Sunday instead of Monday (even though the title said Monday), and hit a Cloudflare rate limit and failed to create the third one. We asked it to retry the failed one once, and it didn’t work. So I waited a bit and tried again. It claimed it worked. However, when I looked at the schedule, it wasn’t there.
We then asked it to fix the Sunday schedule and add the one it had missed again. It did add it that time. It also added the Monday meeting, but despite saying it would delete the Sunday one, it didn’t. I manually deleted it.
Installation is easy. You can connect a domain you own to Cloudflare or use the subdomain on pages.dev that they give you, which works fine. You run a single command on your computer. It handles authentication to the server and sets up all the services and data stores.
So essentially it is a to-do, reminder, and note-taking system. However, it does work well when it works. It can remember things and will find things it remembers or in notes very easily. Can you do that with non-AI tools? Of course. Not to mention, any of the “big” chatbots can do all of that and more. But not in your own hosted server account.
Besides, it is interesting that for small uses, Cloudflare offers plenty of free-tier compute resources that might come in handy for other projects. It is nice to have some free cloud-based computers, as we noted in a recent Linux Fu post where we used Oracle’s free servers.
As far as I can tell, they’re using GLM 4.7 Flash witch is a 30B-A3B model from ~10 Months ago. That is about 75 years in LLM-years. Ok, there haven’t been terribly many 30B-class MoE models, but gemma4-26B-A4B and Qwen3.6-35B-A3B are from april, which are both excellent models for their size. They’re are also quite old, but except for fine tunes, these are the 30B-class MoEs we have…
“witch is a 30B-A3B model”, finally a plausible explanation for how AI works! :-D
Getting the project working and published with any ML model is surely the difficult part. If people find the pattern useful I’m sure you’ll see model options coming next, since it’s open source.
They could call it Claudeflare!
I’ll see myself out.
Bravo, good sire! :)
Maybe they could co-market a children’s optical toy with Mattel and call it a “Claudeoscope”. I’ll join you on te way out.
The amount of times I see cloudflare pop up with security messages or
get stuck in a look, because it doesn’t like my settings, I’d have to say, I’m not a fan of how much of the internet has been taken over by it.
It’s a direct result from the AI bubble. I’ve seen web hosts report 30%-70% bot traffic there they added cloudflare to reduce overall hosting cost as it blocks those.
A mandatory IT Crowd quote:
“I have a lot of experience with the whole computer thing. You know, emails, sending emails, receiving emails, deleting emails, um… I could go on.”
Do.
“The web. Using a mouse… mices… using mice. Clicking. Double-clicking. The computer screen, of course. The keyboard. The… bit that goes on the floor down there.”
The hard drive?
But there’s duck.ai for that?
I’ve been using Cloudflare workers AI since the start of the beta, and may have guided the team on a few points. I find it a solid product if you just have some fairly menial task that would benefit from a lightweight LLM.
I’ve ended up using it for some weird little niche things – like generating a random quote in an SVG in near-realtime. Or auto-correcting an API failure due to external changes, etc… Think of it as a micro-LLM for micro-service use-cases and you won’t be disappointed.
Clouldflare is a scourge. Their funding from day one is dubious and their incessant expansion is ruining the internet.