← Back to post

Edit history

Most recent

Yeah. I’m all for local inference, but to be clear, you can’t have a local agenic LLM as a Adblock browser plugin.

It’s also massively redundant. Why not just run the agent once and ship the rules to millions of users?

Text and image classification models are tiny, though. That’s definitely doable in an extension, albeit not worth the performance cost, IMO.

Also, there are already browser forks built for agenic usage.

If you want, say, generate UBO rules to use, this is the way to do it. Not hacked in as an extension.

Edited

Yeah. I’m all for local inference, but to be clear, you can’t have a local agenic LLM as a browser plugin.

It’s also massively redundant. Why not just run the agent once and ship the rules to millions of users?

Text and image classification models are tiny, though. That’s definitely doable in an extension, albeit not worth the performance cost, IMO.

Original

Yeah. I’m all for local inference, but to be clear, you can’t have a local agenic LLM as a browser plugin.

Text and image classification models are tiny, though. That’s definitely doable in an extension, albeit not worth the performance cost, IMO.