Tip 5 of 31: Give Search Engines a Map
Imagine inviting someone to your office but forgetting to give them directions.
That is effectively what happens when your website has no XML sitemap.
An XML sitemap is a machine-readable list of the important pages on your website. It helps search engines discover pages and understand when important content has changed. It complements good internal linking rather than replacing it.
The Problem
Search engines discover most pages by following links.
On a well-structured website, that often works well. However, some pages can be harder to discover, particularly if they are newly published, deeply nested or have relatively few internal links.
An XML sitemap provides another route to those pages by listing the URLs you want search engines to crawl and consider for indexing. It does not guarantee that every page will be indexed, but it makes discovery easier.
Why This Matters
One of our clients generated £45,000 in placement fees from their website in a single month.
For that to happen consistently, search engines first need to discover the pages that matter.
An up-to-date XML sitemap helps ensure important content is available for discovery alongside a strong internal linking structure.
What to Include
Your XML sitemap should normally contain:
- Canonical URLs
- Indexable pages
- Important landing pages
- Service pages
- Job sector pages
- Blog articles
- Other pages you want appearing in search results
It should normally exclude:
- Redirected URLs
- Duplicate pages
- 404 pages
- URLs blocked from indexing
- Internal search results
- Temporary development pages
If your content management system generates the sitemap automatically, check that it follows these principles.
Keep It Current
Your sitemap should update automatically whenever important pages are added, removed or substantially changed.
The <lastmod> value should reflect genuine content updates rather than every minor edit, helping search engines understand when a page has meaningfully changed.
Submit the sitemap through Google Search Console and reference it from your robots.txt file where appropriate.
Up Next
Tip 6 of 31 explains how canonical URLs help search engines identify the preferred version of duplicate or substantially similar pages.
Frequently Asked Questions
What is an XML sitemap?
An XML sitemap is a machine-readable file that lists the important URLs on your website. It helps search engines discover pages and understand when important content has changed.
Does every website need an XML sitemap?
Not necessarily. Google can often discover pages on smaller, well-linked websites without one. However, an XML sitemap is considered best practice for most business websites because it improves URL discovery and management.
Should every page appear in my sitemap?
No. Include the canonical, indexable pages that you want search engines to consider. Exclude redirects, duplicate URLs, error pages and pages blocked from indexing.
Will an XML sitemap improve AI search visibility?
A sitemap can make important URLs easier for search engines to discover, but it does not guarantee that AI-assisted systems will find, cite or recommend your content.
How often should an XML sitemap update?
Ideally it should update automatically whenever important pages are added, removed or meaningfully changed. The last modification date should reflect genuine content updates.
Darren Revell, Co-Founder, RecruiterWEB
Co-Founder, RecruiterWEB
Darren Revell began working in recruitment technology in 2004 when he founded Recruitwise Technology. He later became a founder of RecruiterWEB, which acquired the Recruitwise Technology brand, platform and customer base in 2016. Darren remains Co-Founder and Co-Owner of RecruiterWEB.
Darren came to Rectech after eleven years working in recruitment. He started as a trainee recruiter in 1993 and progressed through the ranks to recruiter, billing manager, billing director, and eventually recruitment company owner. During that career, he delivered permanent hires, contract hires, client campaign advertising, team moves, retained search, master vendor services, and RPO.
In 2004, he switched focus to recruitment technology and began building websites and job boards specifically for recruitment agencies. RecruiterWEB has since built websites for 667+ agencies and executive search firms in the UK and internationally. The platform runs on custom code built explicitly for recruitment, with built-in job board functionality, ATS and job poster integration, Google for Jobs structured data, and GDPR-compliant candidate registration included as standard on every plan.
Darren writes on recruitment website design, SEO and AI visibility for recruitment agencies, candidate data protection, and the commercial impact of digital investment on recruitment businesses.
Specialist Areas
- Recruitment website design and technology
- SEO and AI visibility for recruitment agencies
- ATS and job poster integration (Bullhorn, Vincere, idibu, and others)
- GDPR and candidate data protection
- Branding for recruitment agencies and executive search firms
Connect
LinkedIn: linkedin.com/in/
Phone: 01223 655278
Darren has also appeared as a guest on the RecTalk podcast, covering his background in recruitment and the founding of RecruiterWEB.
