When web data is business-critical, teams need to know instantly if their crawls are succeeding - or failing - and, crucially, why.
That’s why Zyte is launching the improved Domain Health Hub: your new command center for monitoring, benchmarking, and proactively resolving crawl issues across your most important domains.
This upgrade is built directly from customer feedback: users want not just raw stats, but actionable clarity, early warnings, and the confidence that Zyte is working on their behalf - even before problems hit their bottom line.
What is it?
The improved Domain Health Hub is an interactive dashboard that tracks the real-time health of your top 100 crawled domains.
For each domain, you see your success rates (the percentage of requests returning the data you expect) over the last 24 hours and 7 days, side-by-side with Zyte’s global averages.
Every domain is assigned a clear status (Healthy, Possible Misconfiguration, Issue Being Investigated, or Possible Performance Issue), each with a plain-English tooltip explaining what’s happening and what to do next.
The dashboard also provides recommended actions, such as direct links to troubleshooting guides or support, and is updated every 30 minutes for near real-time accuracy.
Key new features include:
- Global benchmarking: Instantly see if your results are in line with the broader Zyte customer base.
- Deeper antibot insights: Learn which antibot tools may be causing issues and how they impact your traffic.
- Custom filters and views: Sort and filter by domain, status, or tags to focus on what matters most.
- Proactive notifications: Get email alerts when issues are detected or resolved, and integrate with your own systems via a public API.
- Critical domain prioritization: Flag your most important domains so Zyte’s team knows where to focus support.
Why we launched it
Crawl failures - whether from bans, blocks, or site changes - can cost teams not just time and money, but also customer trust.
In the past, users often had no way to know if a ban was temporary, if Zyte’s team was already on the case, or if they could fix it themselves.
The improved Domain Health Hub solves these pain points by offering transparency, context, and concrete next steps at every turn.
It’s designed to reduce firefighting, eliminate guesswork, and empower teams to keep their data pipelines healthy with minimal manual intervention.
Uses for Domain Health Hub
You’ll find the Domain Health Hub invaluable for:
- Monitoring scraping health: Quickly assess which domains are performing well and which need attention.
- Diagnosing underperforming sites: Spot misconfigurations or site-specific issues before they become critical.
- Early warning on bans or misconfigurations: Get notified as soon as Zyte detects a problem - often before your own users notice.
- Optimizing performance: Use benchmarking and recommendations to improve success rates and reduce troubleshooting time.
How it works
Automatic monitoring: Zyte tracks your top domains and benchmarks them against global averages using robust metrics (success rates, response times, average costs, volume, and more).
- Visual dashboard: Access the Domain Health tab in your Stats page to see an at-a-glance table of your domains, sortable and filterable by key metrics and status.
- Statuses explained: Hover over any status to see exactly what it means and what to do next. For example:
- Healthy: Your success rate is above 90%.
- Possible Misconfiguration: Your rate is below 90%, but Zyte’s is higher - suggesting a fixable setup issue.
- Issue Being Investigated: Zyte has an open ticket and is actively working on the problem.
- Possible Performance Issue: Both you and Zyte have lower success rates, indicating a broader or transient problem.
- Recommended actions: Each row offers a direct link to troubleshooting docs or a support ticket as appropriate.
- Notifications and API: Subscribe to email alerts or use the Domain Health API to integrate with your own monitoring tools.
- Enterprise focus: The full stats table is available to enterprise users, ensuring the highest level of operational transparency and support.
Who is it for?
- Data engineering teams who need reliable, self-service visibility to keep crawls running at scale.
- Enterprise platform owners who must deliver consistent web data to clients and stakeholders.
- Any organization that depends on high-quality, uninterrupted web extraction and wants to minimize firefighting and maximize trust.
Try it now
The improved Domain Health Hub is Zyte’s commitment to visibility, control, and trust.
By surfacing issues before they become outages and providing clear, actionable steps, Zyte helps you maintain reliable operations and maximize the value of your web data investment.
Log in to your Zyte dashboard and explore the new Domain Health Hub today. See which domains are thriving, which need attention, and get ahead of issues - before they impact your business.
For more details, visit Zyte Docs.
.png&w=3840&q=75)
