With surveillance capitalism reaching it’s peak in 2026/2027, is getting out the Web the only way for the privacy inclined user?
Will Gemini (or cousins) go the way of Linux? Or is it foverer condemned to go the way of Hurd
With surveillance capitalism reaching it’s peak in 2026/2027, is getting out the Web the only way for the privacy inclined user?
Will Gemini (or cousins) go the way of Linux? Or is it foverer condemned to go the way of Hurd
and how do you propose to impose that? Heck robots.txt doesn’t even seem to be honored!
Eh. I make web pages for friends and family. We don’t want them indexed. In my server logs, most of the big scrapers are pretty good about honoring robots.txt. Google does. Meta does. At least some the AI scrapers do. Pretty sure Bytedance does too but I’d have to double check.
I’ll see a hit from let’s say G’s bot, fetching robots.txt, and then no other activity. For all the thigns I can shit on G and Meta for, this isn’t one of them.
Is it universal to heed it? Nah, ofc not. But it’s still more effective than you’d think, given it is voluntary.