AI giants targeted by scraping bots — ChatGPT and Perplexity enter the most-scraped websites list for the first time

Summary

AI giants are now among the most frequently scraped sites on the web. TechRadar Pro reports that both ChatGPT and Perplexity AI have entered the top‑scraped‑website rankings for the first time, highlighting a growing trend of bots harvesting AI‑generated content.

Content

The surge in scraping activity is driven by a handful of large‑scale crawlers that aim to collect data for training models, SEO analysis, and competitive intelligence. While OpenAI and Perplexity have not disclosed exact figures, the report notes a noticeable uptick in requests to their endpoints, suggesting that bots are treating AI chat services as valuable data sources.

Key observations from the TechRadar Pro analysis include:

• Increased traffic from known scrapers – Services such as Common Crawl and proprietary data‑collection platforms have amplified their requests to AI endpoints.
• First‑time appearance on the most‑scraped list – Both ChatGPT and Perplexity AI are now listed alongside traditional content hubs like Wikipedia and news aggregators.
• Potential impact on AI model performance – Excessive scraping can strain API limits, affect response times, and introduce noisy data into downstream training pipelines.

For businesses that depend on AI‑generated answers to boost their search presence, the trend signals a need to monitor how often their content is being harvested and to consider protective measures.

Why It Matters

Visibility on AI‑driven search results is becoming a critical component of digital strategy. When bots scrape large volumes of AI output, they can repurpose that content across other platforms, diluting the original source’s authority and potentially diverting traffic.

Moreover, the added load on AI services may lead to throttling or higher usage costs for enterprises that integrate these tools into their workflows. Understanding the scale of scraping helps businesses anticipate performance bottlenecks and budget for increased API usage.

Finally, the practice raises legal and ethical questions. Companies must evaluate whether scraped content complies with licensing terms and whether it could expose proprietary insights to competitors.

FAQs

No FAQs were provided in the original draft.