Need Guest Posts or Backlinks?

Tell us what you need and we will send suitable publisher options.

TECHNICAL SEO · FREE DIAGNOSTIC

Indexability Checker

Review the technical signals that may restrict a page’s discovery in search. Check its response, robots.txt rules, indexing directives and declared canonical, then use the evidence to decide what needs investigation.

The checker reads current public responses. Google’s indexing status is a separate observation available through Search Console for a property you control.

Live URL & batch checksEvidence you can exportNo paid API needed
PUBLIC RESPONSE INSPECTOR v2.0
Human verification code
The code expires after ten minutes and works once.

Investigate before you change anything

Inspect supplied HTML, headers and rules in your browser. Compare a draft or a captured DOM. Pasted content is not sent to the checker server and is never executed.

Open supplied evidence & draft-rule tools
Compare a captured rendered DOM

Paste a DOM snapshot captured separately. This is a supplied snapshot comparison, not remote browser rendering. Headers still apply; a noindex in the original source remains important even if removed later.

A focused workspace for the next decision

01 / REVIEW

Compare supplied URLs

Inspect up to five rows with original addresses, deduplication, rejected inputs and unchecked rows. Import a small TXT or single-column CSV file, review it, then run the batch.

02 / TEST

Try a rule change

Paste current and draft robots rules. Test the page and up to 20 additional same-origin paths for Googlebot, bingbot and GPTBot tokens, with search and training purposes labeled.

03 / VERIFY

Keep the evidence

Compare supplied source with a captured DOM, download CSV, JSON or text, and optionally save compact browser snapshots to compare after a change.

Check an exact URL in four steps

  1. Enter the page address. Use the protocol, hostname, path and relevant parameters you actually want to investigate.
  2. Complete verification and select Check URL. The diagnostic request uses EduGuestPost’s checker identity. It evaluates robots rules for the Googlebot web token.
  3. Review each layer of evidence. Read the final response, crawl rules, page directives and canonical declaration together.
  4. Confirm the intended behavior. Decide whether the page should be discoverable in search before changing its configuration. Recheck after an agreed fix.

An excluded account page and an accidentally excluded service page need different decisions. Establish the page’s purpose first.

Three questions behind an indexability investigation

QuestionEvidence to reviewWhat it helps you decide
Can the crawler fetch the intended page?Response status, redirects and applicable robots.txt rules.Whether access or routing needs investigation.
What does the fetched document declare?Robots meta tags, HTTP indexing headers and canonical signals.Whether the configuration matches your intended search behavior.
What has Google reported?Indexed URL Inspection data and the Page indexing report in Search Console.Whether Google’s recorded crawl and indexing information matches your current evidence.

A browser visit alone cannot settle all three questions. Cookies, location, server rules and the request identity can change the response a service receives.

Read robots.txt and noindex together

Robots.txt rules control crawling. A noindex rule concerns inclusion in search after a supporting crawler can read it. If a path is disallowed, Google may be unable to see a noindex tag on that page.

The checker documents robots.txt inspection for each origin encountered in the page’s redirect route. Review the applicable file and matching line where one is available. A broad restriction can have a narrower exception, so finding the word Disallow somewhere in a file is not enough to explain a particular URL.

If you need to prepare or test a rule change, continue with the Robots.txt Generator and Rule Tester. Check the paths that should stay accessible as well as those you intend to restrict.

Example: a page responds but its configuration still needs review

Illustrative scenario using example.com. This is teaching content, not a live scan or a reproduction of the current report interface.

EvidenceExample
Page under reviewhttps://example.com/guides/launch-checklist/
Page responseHTTP 200
Applicable robots ruleDisallow: /guides/
Page directive observed by the diagnostic fetchnoindex
InterpretationThe page responds to the checker, while the rules restrict crawling and the document requests exclusion.
Important follow-upGoogle may not read that noindex while its crawl is blocked.
Decision before editingConfirm whether this guide is intended for public search, then review both the crawl rule and the page directive.

Removing only the noindex would leave the crawl restriction. Changing only the robots rule would leave the document’s exclusion instruction. The investigation needs both pieces of evidence.

A robots.txt error and a page error have different meanings

Check which request produced the status code. A missing content page needs a different investigation from a missing robots.txt file.

Google treats most robots.txt 4xx responses as the absence of crawl restrictions, with 429 handled differently. Server failures and rate limits also involve retry and cached-file behavior that a fresh third-party request cannot reconstruct.

Keep failed, incomplete and restricted responses in the review queue. A request that could not establish the applicable evidence has not established a clean result.

Review directives at the source

An indexing instruction may come from an HTML template, an SEO plugin or an HTTP response rule. A server or CDN header can remain in place after someone removes a tag in the page editor.

Read the evidence before removing a directive. Nofollow concerns links and should not be read as an instruction to exclude the page itself. Conditional rules also need context: the current checker flags unavailable_after and indexifembedded without resolving their dates or embedded-content exceptions.

When repairing an unintended exclusion, locate the system producing it, record the agreed change and request the same page again. Check representative pages if the setting is shared by a template or content type.

Follow redirects and canonical signals to the next question

If the submitted address redirects, review the destination that returned the page. An accessible homepage is not necessarily an appropriate replacement for a specific guide or service URL. Use the Redirect Checker when you need a closer review of the route.

A different declared canonical can also be intentional. A duplicate variant may nominate its preferred version, while an important independent page may be pointing elsewhere by mistake. Use the Canonical Tag Checker to inspect the declarations and available destination evidence separately.

What a clear report lets you do

Use the findings to prepare a specific implementation task: affected URL, intended behavior, observed signal, responsible configuration and the follow-up check. This gives the person making the change more useful context than a generic request to improve an SEO score.

After the repair, compare the exact URL again. For a property you control, inspect Google’s indexed data and the relevant Page indexing reason in Search Console. A current diagnostic fetch and an older Google crawl can legitimately show different states.

If the cause spans several important pages, request SEO audit services for an agreed investigation and prioritized action plan. Share example URLs, their intended search behavior and the evidence that prompted the review.

Know the coverage of this check

The live checker and evidence workspace have these limits:

Part of the checkPublished boundary
Overall request budget35 seconds, shared by all URLs in a batch.
Page inspectionUp to 256 KiB of the response and up to three configured redirects.
Each origin’s robots inspectionUp to 500 KiB and up to five redirects.
RenderingServer-response inspection plus optional supplied source/DOM comparison. No remote JavaScript rendering.
Wider coverageNo whole-site crawl, sitemap-membership check or soft-404 determination.
Google-specific evidenceNo Search Console account inspection or confirmation of Google indexing.

Incomplete chains, response limits and challenge pages need review. A finding applies to the evidence inspected during that request.

When JavaScript may add or change a directive, use the Rendered HTML Checker to compare source with a supplied DOM snapshot. That comparison has its own evidence requirements; it does not turn this checker into a remote browser.

The live module does not retain page bodies or robots reports. Optional compact snapshots stay in your browser, expire from the comparison list after 30 days and can be deleted there. Up to ten records are kept; raw HTML and robots text are excluded. Supplied-evidence inputs are processed in your browser. Consult the Privacy Policy for the site’s broader processing terms. Keep any report you choose to download or share within your own review process.

Indexability checker FAQs

What does indexability mean?

It describes whether technical signals appear compatible with a page being considered for search. Actual indexing also depends on the search engine’s discovery, processing and selection decisions.

Does this tell me whether Google indexed my page?

It reviews public response evidence. Use Search Console’s indexed URL Inspection data for Google’s recorded status on a verified property. Its live test and indexed report answer different questions.

Can an allowed page still be absent from Google?

Yes. Review Google’s reported reason and the page’s content, duplication, discovery and other relevant evidence. An absence of common technical restrictions does not establish why an individual page has not been indexed.

Does a robots.txt block remove an indexed URL?

Not necessarily. Google may know about a URL from other sources while being unable to fetch its content. A robots restriction also prevents it from reading a page-level noindex when the page cannot be crawled.

Is a missing robots.txt file automatically a problem?

No. A website can permit crawling without publishing restrictions. Investigate the exact response and intended rules rather than adding a file solely to change a diagnostic label.

Why can Search Console disagree with a fresh check?

The observations may come from different times and request contexts. Compare the exact URL, reported crawl date, final destination and available response evidence before deciding that either report is wrong.

Is nofollow the same as noindex?

No. They concern different behavior. Review the page’s indexing instruction and its link-related directives separately.

Does the tool request the page as the real Googlebot?

The request identifies as EduGuestPost’s diagnostic checker. Robots matching uses the Googlebot web token. This cannot reproduce Google’s network identity, cached rules or crawl history.

Does a different canonical mean I should remove it?

No. Confirm whether the page is a duplicate variant or an independent destination. A valid relationship still needs to agree with the purpose of the content.

Can I check every page or schedule alerts?

Choose a single URL or a batch of up to five rows (the administrator may set a lower limit). You can import a small TXT or single-column CSV file and save compact before/after snapshots in your browser. Whole-site crawling, scheduled checks and alerts are not included.

Does this edit my site or submit the page to Google?

The checker returns evidence for review. Apply an approved change in the system that owns the setting and use the appropriate Search Console workflow when needed.

Check the destination before planning a placement

When the page is ready for readers and its intended search behavior has been reviewed, you can buy guest posts through EduGuestPost’s publisher-selection process. Compare topic, audience, editorial requirements and current placement terms before approving an opportunity.

An indexability check answers a technical question about the destination. Publisher suitability and the campaign’s expected value still need their own review.

Further reading

Explore Ahrefs’ robots.txt guide, Backlinko’s technical SEO guide and Neil Patel’s robots.txt guide. Rule matching uses the bundled robots-parser 3.0.1 library with tested fixtures. These references do not certify the checker or guarantee indexing.

Need help investigating several pages?

Share the affected URLs, their intended search behavior and the evidence you observed.

Request an SEO audit →
Send a project enquiry