Most Data Privacy laws require actual harm and can only be enforced by the State AG. Some, like California have exemptions for security related failures that cause harm.

Then others, like Washington have strict laws around Health Data and have a private right of action. Still that would require a specific camera facing to possibly be considered for standing.

*Not a lawyer, just spends all day, every day, taking about privacy law with lawyers

There is no evidence that billions of tokens will ever cost cents. The raw infrastructure cost alone is massive. That's why you see services now charging usage based pricing, because continuing to subsidize inference costs is unsustainable long term.

cents per billion is only 3 orders of magnitude reduction in cost. I can see 6 or so happening in the next decade or so.

1. Like any commodity, I expect the price to converge to the marginal cost. The marginal cost is the price of electricity which is currently 10% or so of the cost of inference.

2. I expect the cost of electricity to go down an order of magnitude. Solar power and batteries are getting cheaper fast.

3. As the price of electricity starts dominating costs, you can drastically reduce costs by by taking advantage of electricity price variations. Build data centers all around the world and answer requests from the part of the world where the sun is shining.

4. Moore's law

5. Algorithm improvements

6. Moving from general purpose chips to chips that are highly optimized for inference.

How do you guard against hash collision?

Based on the blog - anyone who shares a IP address (such as inside a company network) would effectively look the same.

And given most companies run managed browsers on managed systems, the user agent is going to collide too

Not just inside a company network. CGNAT is pretty commonplace nowadays.

Indeed. This is one of the limitations to our approach. We're thinking of ways to workaround it. Please shout if you have any ideas ;)

If/When IPv6 is widely used the problem should fade away.

Separate computer / phone for work.

I may check e-mail off hours from time to time, but I never reply. I don't ever check on vacation.

I eat lunch away from my desk 99% of the time.