Your robots.txt also asks Claude, Perplexity, Google not to come — which is a separate line to change from whatever your edge is doing.
robots.txt blocks three reading agents and lets search crawlers through
Your own robots.txt is what turns them away. Nothing else on the site gets a chance to be read.
robots.txt blocks three reading agents and lets search crawlers through. That is the biggest thing between you and a better grade.
4 of your 8 findings have a file below with your own URLs in it. The rest are a punch list ordered by effort, and a prompt that applies the lot one commit at a time.
Covers bonappetit.com. Another domain later is $5.
Your files open here in the browser the second you pay. We email a copy too, so check your spam folder for it: we are a new domain and filters have not met us yet.
Serve this at https://bonappetit.com/llms.txt. It tells a reading agent which of your pages matter, in the order they matter.
# Bon Appétit: Recipes, Cooking, Entertaining, Restaurants | Bon Appétit > Cook with confidence. Enjoy your food. Find recipes, search our encyclopedia of cooking tips and ingredients, watch food videos, and more. ## Updates - [Newsletters | Bon Appétit](https://www.bonappetit.com/newsletter): Subscribe to our newsletters ## Other pages - [Recipes | Bon Appétit](https://www.bonappetit.com/recipes): Find the best recipes for breakfast, lunch, and dinner. That means eggs, chicken, pasta, and everything else you can imagine. - [Drinks | Bon Appétit](https://www.bonappetit.com/drinks): Sharp scene reports, definitive taste tests, travel inspiration, and more from the people responsible for our favorite vibes, dives, and speakeasies. - [Cooking | Bon Appétit](https://www.bonappetit.com/cooking): Expert advice for achievable, memorable meals - [Shopping | Bon Appétit](https://www.bonappetit.com/shopping): Our editors know good stuff—find Grade A products, fresh launches, and tasty ingredients to level-up your cooking
Actionability is costing you the most — 15 of the 42 points you're missing. Open any line to see what we measured.
We read at most 6 pages a scan, sequentially, one second apart, and obey your robots.txt on every page rather than only the first. The full catalog and the weights are published, and blocking us takes one line.
This site sends a header that forbids putting it in a frame, so we are not showing one. That is a deliberate setting and a reasonable one; the name above opens it.
Cook with confidence. Enjoy your food. Find recipes, search our encyclopedia of cooking tips and ingredients, watch food videos, and more.