Skip to main contentSkip to footer

XML Sitemap Setup and Optimization

Give search engines a clean, accurate list of the pages you want discovered and indexed, then monitor how they process it.

A Roadmap of Your Website for Search Engines

Search engines discover pages mainly by following links. They start from pages they already know, follow links to new pages, and gradually build a picture of a website. This works well for small, well-linked sites, but pages can be missed or found late when a website is new, has few external links, is very large, adds content frequently, or has pages that are poorly linked from elsewhere on the site. An XML sitemap helps by giving search engines a direct list of the URLs you consider important, along with optional information such as when each page was last meaningfully updated.

A sitemap is a supporting signal, not a guarantee. Listing a page does not force a search engine to crawl or index it, and search engines still decide what to index based on quality, duplication and many other factors. But a clean sitemap reduces the chance that important pages are overlooked, helps search engines notice updates sooner, and, through the reports in Google Search Console and Bing Webmaster Tools, gives you valuable feedback about how your pages are being processed. A messy sitemap, by contrast, full of redirected, broken, duplicate or noindexed URLs, sends mixed signals and makes those reports much harder to interpret.

ViV Softech Solution is a website designing and digital marketing agency based in Delhi. We set up, clean and maintain XML sitemaps for business websites, ecommerce stores, blogs and portals across India. This page explains what a good sitemap contains and leaves out, the different types of sitemaps, how sitemaps are generated on WordPress and other platforms, how we submit and monitor them, the common problems we fix, special considerations for large websites, and what affects cost. It is part of our wider technical SEO services.

What a Well-Optimised Sitemap Does

Supports Discovery

Helps search engines find new and deep pages that may not yet have many internal or external links pointing to them.

Lists Only the Right URLs

Contains only canonical, indexable pages that return a normal 200 status, with no redirects, errors or duplicates.

Signals Updates

Uses accurate last-modified dates so search engines can prioritise pages that genuinely changed.

Stays Organised

Splits large websites into logical sitemaps by content type, making reports easier to read.

Enables Monitoring

Lets you compare submitted pages with indexed pages in Search Console and spot problems early.

Updates Automatically

Is generated dynamically so new pages are added and removed pages disappear without manual editing.

What Belongs in a Sitemap, and What Does Not

Include

  • Your home page and main section or hub pages.
  • Service, product and category pages you want found in search.
  • Blog posts, guides and other useful content.
  • Location pages for areas you genuinely serve.
  • Important images and videos where image or video sitemaps are relevant.

Every URL listed should be the canonical version, use the correct protocol and domain, for example https and your preferred www or non-www version, and return a normal 200 response.

Exclude

  • URLs that redirect or return 404 or other errors.
  • Pages marked noindex, such as thank-you pages or internal search results.
  • Duplicate or parameter URLs that canonicalise elsewhere.
  • Thin archives such as empty tags, attachment pages or author pages on single-author sites.
  • Login, cart, checkout and account pages.
  • Staging, test or development URLs.

Excluding a page from the sitemap does not stop it being indexed; that needs noindex or other controls. The sitemap’s job is to list what you do want.

Types of Sitemaps

Standard XML sitemap

A list of page URLs with optional last-modified dates. Most websites need only this, usually split by content type.

Sitemap index

A file that lists other sitemap files. A single sitemap is limited to 50,000 URLs or 50 MB uncompressed, so larger sites use an index pointing to several smaller sitemaps. Many plugins split sitemaps much earlier to keep them manageable.

Image sitemap

Additional information about images on your pages, helpful when important images are loaded in ways search engines might not easily discover.

Video sitemap

Details such as title, description, thumbnail and duration for videos hosted on your site, where video visibility matters to your business.

News sitemap

For publishers approved for Google News, listing recent articles. Only relevant to genuine news publishers.

HTML sitemap

A normal web page linking to your main sections for visitors. It is not an XML sitemap, but on large sites it can help both visitors and crawlers find content.

Priority, Change Frequency and Last-Modified Dates

The sitemap format allows three optional tags for each URL: priority, change frequency and last modified. Google has stated that it ignores the priority and change frequency values, so spending time adjusting them brings little benefit. The last-modified date, however, can be used when it is consistently accurate. That means it should reflect a meaningful change to the main content of the page, such as updated service details, new prices or a revised article, not a trivial change like a new copyright year in the footer or a sidebar widget refresh. If every page shows today’s date on every crawl, search engines learn to distrust the field. We check how your platform generates these dates and adjust settings or code where possible so they remain trustworthy.

Sitemaps on WordPress, WooCommerce and Other Platforms

WordPress includes a basic built-in sitemap, and popular SEO plugins replace it with more configurable versions that let you choose which post types and taxonomies to include. A common problem is having two or three sitemaps at once, from WordPress core, an SEO plugin and perhaps an older sitemap plugin, each listing different URLs. We make sure only one sitemap system is active and that it is configured correctly: including pages, posts, products and useful categories, and excluding media attachment pages, empty tags, unnecessary custom post types created by plugins, and anything set to noindex.

For WooCommerce stores, we review product, category and brand sitemaps, check how out-of-stock and discontinued products are handled, and ensure filtered and sorted URLs are not included. On Shopify, Wix and similar platforms, sitemaps are generated automatically with limited control, so the focus shifts to managing which pages exist and are indexable. On custom-built websites and portals, we work with your developers to generate dynamic sitemaps from the database so they always match the live site.

Submitting and Monitoring Your Sitemap

Submission

We submit your sitemap or sitemap index in Google Search Console and Bing Webmaster Tools, and reference it in your robots.txt file so other crawlers can find it. If Search Console is not yet set up, we help verify ownership of your domain first. See robots.txt configuration.

Reading the reports

Search Console shows when a sitemap was last read, whether it had errors, and how many discovered URLs there are. The page indexing report can be filtered by sitemap, so you can see which submitted pages are indexed and why others are not.

Understanding the gap

It is normal for not every submitted URL to be indexed. Reasons include pages search engines consider duplicate or low value, pages discovered but not yet crawled, or technical issues. A large or growing gap is a signal to investigate, which we cover in indexing and crawling issue resolution.

Ongoing checks

We recommend reviewing sitemap reports monthly and after major changes, such as a redesign, migration, plugin change or large content update.

Common Sitemap Problems We Fix

  • Redirected and broken URLs left in the sitemap after pages were moved or deleted.
  • Noindexed pages listed, sending contradictory signals.
  • Wrong domain or protocol, such as http or staging URLs after a migration.
  • Multiple competing sitemaps from different plugins.
  • Sitemap blocked by robots.txt or returning an error itself.
  • Important pages missing because a post type or category was excluded by mistake.
  • Thousands of low-value URLs such as attachment pages, tags or filter combinations.
  • Inaccurate last-modified dates that change on every request.
  • Caching issues where an outdated sitemap is served long after pages change.
  • Malformed XML caused by special characters or plugin conflicts.

Large Websites, Stores and Portals

For websites with tens of thousands of pages, such as ecommerce catalogues, property portals, job boards, directories or news sites, sitemaps become an important management tool. Splitting sitemaps by type and section, for example products by category, location pages by state, or articles by month, makes it possible to see in Search Console exactly which parts of the site are being indexed well and which are struggling. Listings that expire, such as jobs, events or properties, need to be removed from sitemaps promptly and handled with appropriate status codes or redirects. Generation must also be efficient, so that building the sitemap does not slow down the server. We plan sitemap architecture together with your URL structure so the two support each other.

Sitemaps During Launches and Migrations

When a new website launches or an existing one moves to a new domain, platform or URL structure, the sitemap plays a useful role. For a new site, submitting a clean sitemap soon after launch helps search engines discover pages. During a migration, the new sitemap should list only the new URLs, while redirects carry visitors and search engines from old URLs. Some specialists also keep a temporary sitemap of old URLs for a short period so search engines recrawl them and notice the redirects sooner, then remove it. We coordinate sitemap changes with redirect management and our website migration process, and we check that staging sites are never exposed through a sitemap.

Our Process

1. Audit

Find every sitemap, crawl the listed URLs and compare them with the pages that actually exist on your site.

2. Plan

Agree which content types and sections should be included and how sitemaps should be split.

3. Configure

Set up one sitemap system, remove conflicts and fix exclusions, dates and caching.

4. Validate

Check XML validity, status codes and canonicals for every listed URL.

5. Submit

Submit to Search Console and Bing Webmaster Tools and reference in robots.txt.

6. Monitor

Review reports regularly and investigate gaps between submitted and indexed pages.

What Affects Cost

  • Website size and the number of content types.
  • Platform and whether existing plugins or settings can be used.
  • Custom development for dynamic sitemaps on bespoke sites.
  • Cleanup scope, such as removing thousands of low-value URLs.
  • Search Console setup and verification needs.
  • Ongoing monitoring requirements.

Frequently Asked Questions

No. A sitemap helps search engines discover pages, but they decide what to index based on quality, duplication and other factors.

A small, well-linked site can be crawled without one, but a sitemap is easy to set up and useful for monitoring in Search Console.

Google has said it ignores these values. Accurate last-modified dates are more useful.

Common reasons include duplication, low perceived value, crawl delays or technical issues. Search Console reports help identify the cause.

Ideally automatically whenever pages are added, changed or removed.

It can cause confusion and conflicting data. We recommend one well-configured sitemap system.

No. Once submitted, search engines revisit the sitemap periodically. Resubmitting is useful after major changes.

Help Search Engines Find Your Best Pages

Share your website. We will audit your sitemaps and propose fixes with a quote.

Call NowWhatsApp