Monday, August 4, 2025

Perplexity is using stealth, undeclared crawlers to evade no-crawl directives

Perplexity is using stealth, undeclared crawlers to evade no-crawl directives
957 by rrampage | 540 comments on Hacker News.