sus.botdocs

SEO finding

A page's unavailable_after date has passed, but the site still lists or links it

SEO Warning Severity: Medium

Part of the audit Indexability. Finding id: seo.unavailableAfterPassed.

What it costs you

Search engines have dropped the page, or will, while your own site still treats it as current. If the date was a mistake (a template default, a wrong year), a page you want found is gone from search.

What to do

If the page should be found, remove unavailable_after or set a date in the future. If its time is over, take it out of the sitemap and the internal links, and redirect it to a current page or let it answer 410.

What it checks

  • Page expiry date has passed

How to fix it

Fix

    Remove the expired header rule or retire the page

    1. Find where the X-Robots-Tag header with unavailable_after is added: the web server, the CDN, or the application.
    2. If the page should be found, remove the rule or set a date in the future.
    3. If the page's time is over, take it out of the sitemap and the internal links, and redirect it to a current page or let it answer 410.

    How to check: curl -sI [url] shows no X-Robots-Tag with a past unavailable_after, or the page is no longer linked. Run this rule again.