# Website indexability checker for Google and AI search

> Free indexability checker. See if Googlebot, OAI-SearchBot and Claude-SearchBot can read your page's HTML, metadata and robots.txt, with practical fixes.

Canonical: https://usefulshelf.co/check

Check what Google and AI search crawlers can access. Get a shareable report with clear, practical fixes for your page.

## Check website

Enter a public website URL in the [website checker form](https://usefulshelf.co/check). No account is required.

## What we check

- Raw HTML content. Word count and whether the app root is empty before JavaScript runs.
- Title, description, H1 and canonical. The basics every page needs.
- noindex. In the robots meta tag and the X-Robots-Tag header.
- robots.txt. Search access for Googlebot, Bingbot, OAI-SearchBot and Claude-SearchBot. Training crawlers are shown separately.
- Sitemap and Open Graph. Discovery and link previews.
- Platform detection. A specific fix for apps hosted on Lovable, Bolt, Vercel, Replit and Base44.

This is a technical readiness check, not a prediction of rankings or AI recommendations. Allowing a search crawler is separate from allowing model training.

Each report gets a shareable link. The checker fetches one page as [UsefulShelfBot](https://usefulshelf.co/bot) and respects robots.txt.

## Fix what you find

Use our [meta tag generator](https://usefulshelf.co/tools/meta-tag-generator) for page descriptions, [robots.txt generator](https://usefulshelf.co/tools/robots-txt-generator) for crawl rules, and [XML sitemap generator](https://usefulshelf.co/tools/xml-sitemap-generator) for public URLs. [Browse all free SEO tools](https://usefulshelf.co/tools).

New to this? Read [is my website indexable?](https://usefulshelf.co/blog/is-my-website-indexable) for what each check means and how to confirm the result in Search Console.