What we check
- Raw HTML content. Word count and whether the app root is empty before JavaScript runs.
- Title, description, H1 and canonical. The basics every page needs.
- noindex. In the robots meta tag and the X-Robots-Tag header.
- robots.txt. Search access for Googlebot, Bingbot, OAI-SearchBot and Claude-SearchBot. Training crawlers are shown separately.
- Sitemap and Open Graph. Discovery and link previews.
- Platform detection. A specific fix for apps hosted on Lovable, Bolt, Vercel, Replit and Base44.
This is a technical readiness check, not a prediction of rankings or AI recommendations. Allowing a search crawler is separate from allowing model training.
Each report gets a shareable link. The checker fetches one page as UsefulShelfBot and respects robots.txt.
Fix what you find
Use our meta tag generator for page descriptions, robots.txt generator for crawl rules, and XML sitemap generator for public URLs. Browse all free SEO tools.
New to this? Read is my website indexable? for what each check means and how to confirm the result in Search Console.