Run Indexability (zero-auth alternative to index-coverage)
Checklist criteria (verbatim)
Verbatim text from the 100-item checklist; this site does not re-judge it. The measured values on the right are from a single fetch and are not paired line by line.
Fields come from this tool's M0 detector (a single fetch), with no day-over-day change or verdict; vantage server-KR. The checklist criteria on the left are verbatim and are not re-judged here.
Full report
Grouped by checklist item: criteria, general explanation, recommendations and official references are listed per item; the full set of measured values is listed separately at the end, not paired item by item. This site does not re-judge, and the explanations and recommendations do not give a compliance verdict on any single measurement.
Tool 收录与可索引性(零授权替代 index-coverage) · Site kyliecosmetics.com · Vantage server-KR · Generated 2026-11-22T21:06:10.253Z · Reference version 2026-11-09 · 4 checklist items
Generated on this page from checklist references and this run's measurements; no history, change events or compliance verdicts.
Checklist items · 4
#6 robots.txt 与 sitemap 体检 · P1
Criteria:是否屏蔽关键资源、sitemap 是否可达/时效、结账与账号页是否误开放
Explanation
The first thing an external agent (search engine, shopping assistant, price crawler) does is read robots.txt and the sitemap. Blocking product pages or static assets makes products invisible; an unreachable, stale or never-updated sitemap delays discovery of new listings. Typical failures: /products/ or /collections/ in Disallow, checkout/account pages left open, sub-sitemaps drifting because pagination cursors move.
Recommendations
Review Disallow rules per agent and block only genuinely private paths; product and collection pages must stay crawlable.
Declare the absolute Sitemap URL in robots.txt and shard large catalogs with a sitemap index.
Make lastmod reflect the real modification time, not the generation date.
After every template or route change, re-crawl the homepage and key product pages with JavaScript disabled.
Crawled does not mean indexed. A stray noindex, a wrong canonical or incomplete hreflang keeps pages out of the index, or indexes the wrong regional variant. To an agent, a page that is live but not indexed does not exist. Typical failures: a template adds noindex to the homepage, canonical points at a staging domain, or hreflang is only one-way.
Recommendations
Use the URL Inspection tool to confirm key pages are indexed, not merely crawled.
Check that the homepage and key product pages carry a self-referencing absolute canonical on the production domain.
Apply noindex to checkout, account and internal-search results, but not to category or product listing pages.
Complete bidirectional hreflang so every regional variant maps to its own currency and language.
Rising crawl errors, soft-404s, longer redirect chains and slower responses usually show up before traffic drops. An agent that hits a 5xx or timeout abandons the visit and does not retry the way a browser does. Typical failures: a redesign creates long 302 chains, discontinued products return a 200 empty page, or peak traffic lets crawlers slow the origin.
Recommendations
Track the daily change in 5xx rate and TTFB from one vantage; never compare absolute values across vantages.
Return 410/404 or 301 to a relevant category for discontinued products instead of a 200 empty shell.
Keep redirect chains to a single hop and remove loops and cross-domain hops.
Give crawlers their own cache and rate limits so bulk crawling cannot slow the real checkout path.