Index My Site

Get your programmatic SEO pages indexed, one batch at a time

Submit hundreds or thousands of templated pages in batches, see which templates Google indexes, and stop spending on the ones it does not. If a page is confirmed as not indexed, you get the standard credit back.

Why programmatic SEO pages are not indexed

Large sets of templated pages usually stall in two places in Search Console: Discovered - currently not indexed, where Google has not crawled them yet, and Crawled - currently not indexed, where it crawled them and chose not to index them. These are the usual causes.

  • The template says almost nothing

    A page that is a title, a few swapped fields, and boilerplate gives Google little reason to index it. Thin pages often end up as Crawled - currently not indexed.

  • Pages are near copies of each other

    City, variant, or comparison pages that differ by one word look like duplicates. Google consolidates duplicates and indexes one version, not all of them.

  • Nothing links to them

    Pages that only exist in a sitemap, with no hub or category page linking to them, look unimportant and are harder for Google to find.

  • Your site cannot be crawled that fast

    Every site starts with a cautious crawl capacity limit that grows only if demand is there and the server stays fast. Thousands of new URLs can wait as Discovered - currently not indexed.

  • Everything went live on one day

    Publishing the full set at once puts every URL in the same crawl queue, including the weak ones. Google spends time on pages you did not need indexed.

  • The sitemap lists URLs you do not want indexed

    Redirects, noindex pages, filtered views, and URLs whose canonical points elsewhere waste crawling on pages that cannot be indexed.

Based on Google’s guides to crawl budget and the Page indexing report. Read more about Discovered - currently not indexed and Crawled - currently not indexed.

Fix these four things before you submit any pages

Submitting a page gets Googlebot to it sooner. It does not change what Googlebot finds when it gets there. Do these first.

  1. 1

    Give every page data no other page has

    Each page should answer its search on its own: real numbers, specifics, examples, or listings for that one entity. If two pages would say the same thing, merge them into one.

  2. 2

    Link to every page from hubs

    Build category and hub pages that link to each programmatic page, and link related pages to each other. A page Google can reach by following links is easier to find and looks more important.

  3. 3

    List only canonical, indexable URLs in your sitemap

    Each URL should return 200, carry no noindex, not be blocked by robots.txt, and have a canonical that points to itself. Add lastmod when pages change.

  4. 4

    Publish in batches, best pages first

    Launch the pages with the most search demand and the strongest data first. If those get indexed, release the next batch. If they do not, fix the template before you publish more.

Submitting cannot rescue thin, scaled pages

Google’s spam policies treat many pages generated mainly to rank, with little or no value to users, as scaled content abuse, whether a person, a script, or AI wrote them. No indexing service changes that.

Google lists these as examples

  • Using AI or similar tools to generate many pages without adding value for users.
  • Scraping feeds or search results, or rewording them with synonyms or translation, to make many pages.
  • Stitching content from other pages together without adding value.
  • Many pages that make little sense to a reader but contain search keywords.

What that means for your templates

  • Every page needs something useful that the other pages in the set do not have.
  • If you cannot fill a page with real data, do not publish it.
  • A low index rate is Google telling you about the template. Fix it before you send more.
  • We never promise indexing. Google decides.

Source: Google spam policies, scaled content abuse.

Work out how many jobs and credits your rollout needs

Enter how many pages you plan to index and how many to send in each batch. Each job holds up to 2000 URLs.

Batches
Jobs
Credits at most
At $0.20 per credit

At this size one purchase of $1,000 or more gets the bulk price instead.

At the bulk price of $0.10 per credit

Needs one purchase of at least $1,000 (10,000 credits). Credits never expire, so the rest stay for later.

Send of up to pages, . Standard indexing is 1 credit per sent URL. Skipped URLs are not charged, so this is the most you would spend.

Any URL confirmed as not indexed after the final check, around day 14, gets its standard credit back.

How to roll out programmatic pages with Index My Site

Submit in batches, read the result for each batch, and only scale the templates that get indexed.

  1. Step 1

    Create a project for the site

    A project groups every job for one site, so all of its programmatic pages report together.

  2. Step 2

    Submit your first batch

    Paste the URLs, upload them with the CLI, or send them from the API. One job takes up to 2000 URLs, and you can create as many jobs as you need. Name each job after the template or batch so you can compare them later.

  3. Step 3

    Let the checks filter out pages that cannot be indexed

    Redirects, noindex pages, robots.txt blocks, error pages, and canonicals pointing to another page are skipped and not charged. Pages with little main content wait for your approval, with the word count we found, so a thin template shows up before you pay for it.

  4. Step 4

    Read the index rate before you send the next batch

    We check every URL once after 24 hours. Your full report follows around day 5, with final checks around day 14. The project shows its index rate once batches finish, so you can see which templates Google is taking.

  5. Step 5

    Stop spending on templates that do not get indexed

    If one template has a low index rate, pause it and improve the content before you submit more of it. Pages confirmed as not indexed get their standard credit back.

  6. Step 6

    Watch the sitemap for new pages

    Once the template works, add your sitemap to the project. We read it every six hours and can submit new URLs automatically, up to a limit you set per read (100 by default).

Details in the docs for projects and sitemap watches and checks before sending.

Frequently asked questions

Usually because the pages are thin or very similar to each other, few internal links point to them, or the site published more URLs than Google is ready to crawl. Google says it decides how much to crawl from crawl capacity and crawl demand, and that demand depends on page quality, popularity, and how many duplicate or unimportant URLs it finds on the site.

Source: Google Search Central: Optimize your crawl budget

No. Submitting helps Googlebot find and crawl a page. Google still decides whether to index it. Google treats many pages made mainly to rank, with little value to users, as scaled content abuse, however they were created. Sites that break Google’s spam policies can rank lower or drop out of results, so fix the content first.

Source: Google Search Central: Spam policies, scaled content abuse

Not by itself. Google’s scaled content abuse policy is about pages generated mainly to manipulate rankings that provide little or no value, no matter how they are made. Templated pages built on unique, useful data for each entity are a different thing from pages that only swap a keyword.

Source: Google Search Central: Spam policies, scaled content abuse

We suggest batches. Google says every site starts with a conservative crawl capacity limit that rises only if there is demand and the site stays healthy. Releasing your best pages first lets you see whether the template gets indexed before you publish thousands more like it.

Source: Google Search Central: Optimize your crawl budget

Up to 2000 URLs per job, and as many jobs as you have credits for. A URL that is already in progress in another of your jobs is skipped without charge, so overlapping batches do not cost twice.

Standard indexing is 1 credit per sent URL, which is $0.20, or $0.10 on any single purchase of $1,000 or more. Skipped URLs are not charged. A URL confirmed as not indexed after the final check, around day 14, gets its standard credit back. Credits never expire.

If a page has nothing useful to add, remove it and return 404 or 410, or merge it into a stronger page. Google says noindex pages are still requested and then dropped, which wastes crawling, and that removed pages should return 404 or 410.

Source: Google Search Central: Optimize your crawl budget

Send your first batch of programmatic pages

Create an account, buy credits from $25, and send your strongest pages as the first batch.