How bot challenges work

Scrapers that hit a protected site often receive a client challenge instead of the page. The challenge page asks the browser to run JavaScript, and news sites sometimes ask readers to disable any ad blockers. Cloudflare shows a page titled Just a moment while it is verifying you are human. This section explains how to detect those pages honestly and why returning their text as content is wrong.

Scrapers that hit a protected site often receive a client challenge instead of the page. The challenge page asks the browser to run JavaScript, and news sites sometimes ask readers to disable any ad blockers. Cloudflare shows a page titled Just a moment while it is verifying you are human. This section explains how to detect those pages honestly and why returning their text as content is wrong.

Scrapers that hit a protected site often receive a client challenge instead of the page. The challenge page asks the browser to run JavaScript, and news sites sometimes ask readers to disable any ad blockers. Cloudflare shows a page titled Just a moment while it is verifying you are human. This section explains how to detect those pages honestly and why returning their text as content is wrong.

Scrapers that hit a protected site often receive a client challenge instead of the page. The challenge page asks the browser to run JavaScript, and news sites sometimes ask readers to disable any ad blockers. Cloudflare shows a page titled Just a moment while it is verifying you are human. This section explains how to detect those pages honestly and why returning their text as content is wrong.

Scrapers that hit a protected site often receive a client challenge instead of the page. The challenge page asks the browser to run JavaScript, and news sites sometimes ask readers to disable any ad blockers. Cloudflare shows a page titled Just a moment while it is verifying you are human. This section explains how to detect those pages honestly and why returning their text as content is wrong.

Scrapers that hit a protected site often receive a client challenge instead of the page. The challenge page asks the browser to run JavaScript, and news sites sometimes ask readers to disable any ad blockers. Cloudflare shows a page titled Just a moment while it is verifying you are human. This section explains how to detect those pages honestly and why returning their text as content is wrong.

if 'client challenge' in html:
    return blocked

Some anti-bot vendors load scripts from captcha-delivery.com or /cdn-cgi/challenge-platform/.