“Unlawful” basically is whatever is enforced by the courts, in the US.

Yes, it is. Being able to return fire ended this.

By all accounts, ICE are real law enforcement, with the power, and authority of the state to enact the will of the ruling class on us.

Except, it’s not a live user hitting 10 sights all the same time, trying to crawl the entire site… Live users cannot do that.

That said, if my robots.txt forbids them from hitting my site, as a proxy, they obey that, right?

Except StarLink cannot possibly provide the same bandwidth, latency, and throughput a fiber connection can. Because of physics.

I can either share my 10G symmetrical connection with nobody, or with 200 others.

And, Fiber costs me $70 a month. Starlink, with worse performance, costs 4x more.

And I’m assuming if the robots.txt state their UserAgent isn’t allowed to crawl, it obeys it, right? :P

Good. I went through my CF panel, and blocked some of those “AI Assistants” that by default were open, including Perplexity’s.