maam@feddit.uk to Linux@programming.dev · 9 hours agoLinux traffic has grown 22.4% in PH this yearfeddit.ukimagemessage-square37fedilinkarrow-up1343arrow-down13
arrow-up1340arrow-down1imageLinux traffic has grown 22.4% in PH this yearfeddit.ukmaam@feddit.uk to Linux@programming.dev · 9 hours agomessage-square37fedilink
minus-squarerealitaetsverlust@piefed.ziplinkfedilinkEnglisharrow-up63·9 hours agoI would expect AI scrapers to fake a windows user-agent tbh.
minus-squareWhelks_chance@lemmy.worldlinkfedilinkarrow-up2·5 hours agoWhy? Isn’t it likely that it’ll just report e.g. “python-requests” for the user agent, and it’s up to the server side to decide what that means?
minus-squarerealitaetsverlust@piefed.ziplinkfedilinkEnglisharrow-up1·52 minutes agoThat user agent would make them easily identifiable and therefore blockable. It’s more likely that they are trying to hide as a legitimate user.
minus-squareCaveman@lemmy.worldlinkfedilinkarrow-up1·2 hours agoThat will be labeled as “other” in those cases
I would expect AI scrapers to fake a windows user-agent tbh.
Why? Isn’t it likely that it’ll just report e.g. “python-requests” for the user agent, and it’s up to the server side to decide what that means?
That user agent would make them easily identifiable and therefore blockable. It’s more likely that they are trying to hide as a legitimate user.
That will be labeled as “other” in those cases