Most of the web doesn't want to be read by machines — and it's built the defences to prove it. This is the largest audit of web access controls ever published.
See how simple web data access can be with Zyte.
| Share of sites | |
|---|---|
| Open (no barrier) | 18.5% |
| Barrier present | 81.5% |
Open access
Only 18.5% of the world's most-visited landing pages operate without any technical barrier to automated access. The rest have built walls.
Barrier Stacking
AI Crawlers
27% of websites block all crawlers. 12.7% explicitly target AI bots.






Hardest Industry
57% of fashion sites require Moderate or harder access infrastructure.