• sudo@programming.dev
    link
    fedilink
    English
    arrow-up
    3
    ·
    13 hours ago

    Places like cloudflare and akamai are already using machine learning algorithms to detect bot traffic at a network level. You need to use similar machine learning to evade them. And since most of these scrapers are for AI companies I’d expect a lot of the scrapers to be LLM generated.