ooli2@lemm.ee to Technology@lemmy.mlEnglish · 1 year agoOpen Source devs say AI crawlers dominate traffic, forcing blocks on entire countriesarstechnica.comexternal-linkmessage-square7linkfedilinkarrow-up191arrow-down10cross-posted to: [email protected]
arrow-up191arrow-down1external-linkOpen Source devs say AI crawlers dominate traffic, forcing blocks on entire countriesarstechnica.comooli2@lemm.ee to Technology@lemmy.mlEnglish · 1 year agomessage-square7linkfedilinkcross-posted to: [email protected]
minus-squareOnno (VK6FLAB)@lemmy.radiolinkfedilinkarrow-up31·1 year agoIn my experience, the single biggest bully on the internet are the servers controlled by Meta which in my experience literally perform DDoS attacks whilst crawling, hitting sites several orders of magnitude more than all the others combined. Actively blocking them was the only option left.
In my experience, the single biggest bully on the internet are the servers controlled by Meta which in my experience literally perform DDoS attacks whilst crawling, hitting sites several orders of magnitude more than all the others combined.
Actively blocking them was the only option left.