AgentBIAgent with Business Intelligence for DTC sites

Back to the knowledge base

OPT-1

Declare llms.txt and .well-known/ucp entry points

Published:2026-11-18Views:0

robots.txt tells crawlers which paths are readable; a site-description file tells them what the site is and what entry points it offers. Shopping and search agents often look for llms.txt and public descriptors under .well-known/ on arrival. These are simply configuration files written by the site owner in a public format — no external data integration and no real orders involved.

Start by listing site capabilities: product entry points, search and filter paths, where structured data and feeds live, and how locale versions switch. Then state which paths are private (account, checkout, internal search) and should be excluded in robots. Put this in a plain-text file at a stable path so agents don't have to infer capabilities by guessing page structure.

Declaration files are a cheap config-layer change, but often edited by many hands. Log each change with its date in the definition changelog and re-verify entry reachability with scripts disabled. This article covers discoverability and authoring only; it endorses no protocol and issues no verdict on whether a single crawl read the file.

Official references

2026-11-22