{"id":2622,"date":"2026-11-06T08:00:00","date_gmt":"2026-11-06T08:00:00","guid":{"rendered":"https:\/\/www.fullstoppr.com\/?p=2622"},"modified":"2026-10-29T09:56:47","modified_gmt":"2026-10-29T09:56:47","slug":"llms-txt-schema-ai-visibility","status":"publish","type":"post","link":"https:\/\/www.fullstoppr.com\/en\/llms-txt-schema-ai-visibility\/","title":{"rendered":"llms.txt, Schema.org and more: the technical basics of AI visibility"},"content":{"rendered":"

Before ChatGPT, Perplexity and Google AI Overviews can recommend a company, they have to be able to read and understand its website. A few technical basics take care of that, from open doors for AI crawlers to Schema.org structured data. The new llms.txt file can help too, but it is no substitute for good media relations.<\/strong><\/p>\n

Why does technology matter for AI visibility?<\/h2>\n

Technology determines whether AI search can read and understand a website at all, and therefore whether it uses or recommends a company as a source. AI search works in two steps. It draws on what a language model learned during training, and for many questions it also fetches current pages from the web. For that second step, providers send out their own crawlers.<\/p>\n

Lock those crawlers out, or build content that is hard to read, and you give away opportunities. The good news: most hurdles are quick to fix.<\/p>\n

Does your robots.txt let AI crawlers in?<\/h2>\n

Whether AI crawlers may visit your website is governed by robots.txt. The file is a website\u2019s house rules. It tells bots which areas they may visit. Many companies have blocked AI crawlers as a precaution, sometimes without noticing, because a plugin or their hosting provider set it up that way by default.<\/p>\n

Well-known names include GPTBot and OAI-SearchBot from OpenAI, PerplexityBot and ClaudeBot from Anthropic. Google AI Overviews rely on the regular Googlebot, while Google-Extended governs use for Gemini. If you want to appear in AI answers, allow at least the search crawlers. Whether you also permit training is a deliberate choice each company makes for itself.<\/p>\n

What does Schema.org structured data do?<\/h2>\n

Schema.org is a shared vocabulary that lets a website explain to machines what it contains. A block of text becomes an unambiguous statement: this is the company name, this is the head office, this is the management, this is an expert article with author and date.<\/p>\n

These types are particularly useful for AI visibility:<\/p>\n