@SecurityWriter

@SecurityWriter Whoeaaa, whoeaa.

@joe @SecurityWriter The web has literally had standards for web developers to indicate that a site should be excluded from web crawlers since at least 1994. AI Crawlers have been blatantly ignoring terms of service and crawler exclusion and often adopt obscuration techniques to make it ever more difficult for site admins to block them in various technological ways.

@joe @SecurityWriter It's taken on the aspect of a measure-countermeasure escalation war and AI ingestion agents now account for a huge percentage of overall web traffic, which is hugely costly to site operators, so this goes well beyond the obvious copyright and terms of service violations into something that IMO defacto qualifies as something akin to a denial of service attack.

https://en.wikipedia.org/wiki/Robots.txt

@kentenmakto @SecurityWriter brokers!

Oh, it was rhetorical? I’ll get my coat …

@Infoseepage @SecurityWriter To your point - I have 10 sites on one VPS and I had to shut them all down because AI makes the web unusable. Sites are shutting down left and right. I only want Google to crawl my site, but other services that are using the same bandwidth - no. I really regret backing net neutrality and fighting against copyrights now - that is the opposite of my stance now.

@SecurityWriter heh love the title I was working on an article about distillation. It's never perfect but I decided to push it today because of this event. Seemed to appropriate.

https://medium.com/@wdunn001/the-original-sin-of-ai-8cf8993718b5

@SecurityWriter The Chinese firms should adopt that very relevant point: "but if we can't re-use other LLM's data, our AI race is dead!"

@SecurityWriter: In Spanish we have a saying for that: "Ladrón que roba a ladrón tiene cien años de perdón".

@SecurityWriter @mhoye