If you have a website, you need to make sure that not just humans, but also AI agents are able to use that website. This is an initiative that Google has been taking the lead on. And this week at Google IO, we saw their latest push in this direction.
So I'll talk about two new things you're going to have to start thinking about when you're designing your website: L O M S T X T and WebMCP. Neither of these things are new, but up until recently, they haven't really mattered, and it looks like they're going to start mattering.
So, llms dot txt is a text file that you place on the root directory of your website, and it just explains what the important pages of your website are. This idea came around maybe a year ago, and a lot of people thought it was going to be important for showing up in AI search results.
Well, as of right now, it still does not help you show up in AI search results, and Google's John Mueller has confirmed they have no intention in using this in AI search. However, in Google IO, they confirmed that AI agents are already starting to use this to understand the structure of your website. It helps them understand what information they can find in your website and what actions they can take.
Once we have more information about best practices around L L M S T X T, I'll make a follow up video. For now, it might be worth giving your site map to Claude or another L L M and asking it to create an L L M S T X T file for you.
And the second one is WebMCP, or Web Model Context Protocol. This was announced last year as a new standard for how AI can interact with your website, but up until now it's just been in beta. Inside the Chrome browser Google IO, we learned that it will probably be widespread pretty soon.
Now there's two ways that WebMCP can be set up on your website. If you have any HTML forms on your website, you can just add a few extra tags. Give the AI confidence in what each field does and what the form itself does.
I assume these new tags will just become a standard part of HTML forms, but you'll have to go back and update any existing forms.
The second version is a bit more complex. If you have any interactive JavaScript on your website, these might be multi step forms or quizzes or other types of tools. You can now add a little bit of extra code to the JavaScript to allow agents to use them.
Fortunately, you don't need to learn how to do this. Google has released some documentation. You can just give that documentation and your existing JavaScript to any large language model and they can update it for you.
I'm also pretty sure Google said that AI Studio or Anti gravity can handle this out of the box.
All this might not sound like a big deal. It might sound like something only a few niche websites are gonna implement. But Google IO painted a much different version of the internet than the one we've been interacting with.
I think very soon, the vast majority of activity on your website is going to be by an AI agent. And right now, there's a big opportunity to gain a first mover's advantage. These AI agents can interact with your website and not your competitor's website.
They're going to default to you.