Your robots.txt also asks Claude, GPT, Perplexity, Google not to come — which is a separate line to change from whatever your edge is doing.
Four agent clients are refused at the edge
When somebody asks an assistant about you, it answers from whatever it can reach. That is not your site.
98% of your page text needs JavaScript
These clients do not run JavaScript. They are being handed an empty page and answering from somewhere else.
robots.txt blocks four reading agents and lets search crawlers through
Your own robots.txt is what turns them away. Nothing else on the site gets a chance to be read.
Four of the Five AI clients can't read this page at all.
7 of your 16 findings have a file below with your own URLs in it. The rest are a punch list ordered by effort, and a prompt that applies the lot one commit at a time.
Covers amazon.com. Another domain later is $5.
Your files open here in the browser the second you pay. We email a copy too, so check your spam folder for it: we are a new domain and filters have not met us yet.
Serve this at https://amazon.com/llms.txt. It tells a reading agent which of your pages matter, in the order they matter.
# Amazon.com. Spend less. Smile more. > Free shipping on millions of items. Get the best of Shopping and Entertainment with Prime. Enjoy low prices and great deals on the largest selection of everyday essentials and other products, including fashion, home, beauty, electronics, Alexa Devices, sporting goods, toys, automotive, pets, baby, books, video games, musical instruments, office supplies, and more. ## Other pages - [Amazon Registry & Gifting](https://www.amazon.com/registries) - [Amazon.com: Amazon Basics](https://www.amazon.com/Amazon_Basics): Welcome to AmazonBasics - [Amazon.com: Amazon Prime](https://www.amazon.com/amazonprime)
Retrievability is costing you the most — 21 of the 84 points you're missing. Open any line to see what we measured.
We read at most 6 pages a scan, sequentially, one second apart, and obey your robots.txt on every page rather than only the first. The full catalog and the weights are published, and blocking us takes one line.
This site sends a header that forbids putting it in a frame, so we are not showing one. That is a deliberate setting and a reasonable one; the name above opens it.
Free shipping on millions of items. Get the best of Shopping and Entertainment with Prime. Enjoy low prices and great deals on the largest selection of everyday essentials and other products, including fashion, home, beauty, electronics, Alexa Devices, sporting goods, toys, automotive, pets, baby, books, video games, musical instruments, office supplies, and more.