1. Pick the URLs that should rank
Export a small inventory: homepage, priority category pages, main products or services, and the pages that answer your most valuable search questions. Decide which pages are canonical, which have duplicate variants and which should not appear in Search. Avoid treating every search result, filter parameter or tag archive as an indexable landing page. An audit starts with a content decision, not a crawl score.
2. Test whether the server returns the right status
Use a browser and an HTTP header checker. Each public page should normally return 200, an obsolete page should redirect to its closest useful replacement or return a genuine 404/410, and private admin URLs should remain protected. Watch out for "soft 404" pages that display a missing-page message but return 200. Check the destination of important internal links after every redesign or migration.
3. Verify robots, canonical and sitemap alignment
Open robots.txt and ensure it does not block important articles, stylesheets or images. Read the canonical tag on representative pages. Confirm that canonical URLs resolve successfully and that the XML sitemap contains only live, preferred, indexable pages. Search, tracking redirects and empty filtered views should not be included. For pagination, each useful page needs its own discoverable URL and self-consistent canonical.
4. Check the click path and internal links
Choose a key page and trace how a person and crawler reach it from the homepage. Replace vague anchor text such as "click here" with descriptive links. Create topic hubs for related articles instead of placing everything in one mega-menu. Also inspect affiliate and purchase buttons: an over-aggressive query-string rule can block a redirect endpoint even while the landing page looks fine. Test real links all the way to the destination.
5. Validate rendering, mobile usability and speed
Review the mobile page at a narrow viewport. Check tap targets, overflow, font sizes, CLS from unreserved images, and excessive frontend JavaScript. Optimize the largest images, reserve layout dimensions, cache static assets and avoid rendering-blocking widgets. PageSpeed Insights and browser performance tools can identify symptoms, but prioritize fixes that improve the actual user experience on your key landing pages.
6. Inspect structured data without chasing badges
Use appropriate Article, Organization, BreadcrumbList or product markup only when the visible page genuinely supports it. Do not add fake five-star reviews, invented prices, duplicated article schema, or FAQ rich-result markup without checking eligibility. Validate the emitted JSON-LD and verify that its URLs and dates match the visible content. Structured data can improve understanding; it cannot replace a useful page.
7. Triage by business impact
Create a three-column queue: affected URLs, the concrete issue, and the recommended action. Fix inaccessible money pages, broken purchasing links and incorrect canonical targets first. Then improve internal discovery and mobile issues. Re-crawl the changed pages, submit updated sitemaps if appropriate and monitor Search Console over several weeks. A crawl count is a diagnostic—not proof of ranking gains.
Quick checklist before you decide
Use this list as a practical review tool. A missing answer is a reason to investigate, not automatically a deal-breaker.
- Priority pages return 200 and can be reached from navigation
- Robots.txt allows important content and media
- Canonical URLs match final clean URLs
- XML sitemap excludes noindex/empty pages
- Real purchase and affiliate redirects complete
- Mobile layout, image dimensions and Core Web Vitals reviewed
- Structured data reflects visible truthful content
- Search Console indexing and queries monitored
Frequently asked questions
How often should I audit a small website?
After a significant redesign or migration, test immediately. Otherwise review key pages, indexing and broken links monthly or quarterly depending on how often your site changes.
Do I need a paid crawler?
Not necessarily. Server logs, Search Console, browser tools and manual checks cover many small-site issues. Crawlers become more valuable as page counts and patterns grow.
Will fixing every technical error guarantee rankings?
No. Technical access is a foundation; search intent, original value, competition and relevance still matter.
Explore a relevant project.
See whether this tool fits your workflow.