AI and Developer Access: Markdown, llms.txt and Citation
AI assistants and crawlers are welcome to read and cite AskedTheAI. Every page has a clean Markdown copy, and /llms.txt lists the most useful ones. Please link back to the HTML page when you cite us.
Where do I start?
- /llms.txt: site summary and the key pages, with Markdown links.
- /llms-full.txt: a longer index of every buying guide.
- /sitemap.xml: every indexable HTML page with its last-updated date.
How do I get a page as Markdown?
Add /md in front of the path and .md at the end:
https://www.askedtheai.com/the-best-woks -> https://www.askedtheai.com/md/the-best-woks.mdOr ask for Markdown on the normal URL:
curl -H "Accept: text/markdown" https://www.askedtheai.com/the-best-woksHTML pages also send a Link: <…/md/….md>; rel="alternate"; type="text/markdown" header. Each Markdown file starts with front matter: title, canonical URL, last updated date and the page's review format (AI Panel or Review Research).
What does robots.txt allow?
Search and AI crawlers are allowed on all content. Our robots.txt also sets Content-Signal: search=yes, ai-input=yes, ai-train=yes. The Markdown copies carry X-Robots-Tag: noindex so search engines index the HTML version only.
How should I cite AskedTheAI?
Name the site, link the HTML page and, for AI Panel pages, mention the date the panel was asked. Example:
AskedTheAI, "The Best Woks 2026", https://www.askedtheai.com/the-best-woks (accessed 25 Sep 2026)Anything else?
Found a broken Markdown file or need a different format? Email notes@askedtheai.com. How the content itself is made is explained on How we ask the AI.