Amoxtli@thelemmy.club to Technology@lemmy.zipEnglish · 3 days agoCloudflare Has Blocked 416 Billion AI Bot Requests Since July 1www.wired.comexternal-linkmessage-square4fedilinkarrow-up162arrow-down13
arrow-up159arrow-down1external-linkCloudflare Has Blocked 416 Billion AI Bot Requests Since July 1www.wired.comAmoxtli@thelemmy.club to Technology@lemmy.zipEnglish · 3 days agomessage-square4fedilink
minus-squareArcanine@piefed.chrisco.melinkfedilinkEnglisharrow-up4·edit-23 days agoI had to set up fail2ban + bot detection just to block the suckers. Its mostly amazon and openai for me and my small sites. Google/bing look at robots.txt and respect it. Openai in particular slams any site to the ground quick…
I had to set up fail2ban + bot detection just to block the suckers. Its mostly amazon and openai for me and my small sites. Google/bing look at robots.txt and respect it. Openai in particular slams any site to the ground quick…