A year of fighting scrapers on my 1.5 million-page website. What I tried, how I failed, and what's working now.

A year of fighting scrapers on my 1.5 million-page website. What I tried, how I failed, and what’s working now.

  • melroy@kbin.melroy.org
    2·
    2 days ago

    I wanted to have high performance. See my benchmarks. I’m able to reach 150k-180k reqs/sec allowing me to handle ddos attacks as well. Even under very heavy load. Anubis will fall apart.

    Great question BTW!