An assistant's crawler fetches the page once, without running JavaScript, and reads the text, the structured data and the links. Below is what it gets from aesop.com, taken from the copy the scanner kept.
characters of text without JavaScript
structured data for the business
of 3 AI crawlers turned away at the edge
Title: Aesop USA | Formulations for Skin, Hair & Body · language en. First 1,800 of 11,113 characters:
Aesop USA | Formulations for Skin, Hair & Body Skip to content Skip to footer navigation An error occured on the server, please try later or contact the customer service You're in offline mode with a limited website functionality. Please check your network connection. Search... Stores Customer service Email sign up Account My cart 0 product in cart My cart Gifts Discover Gifts Category Discover Category Shop all Gifts Seasonal Gift Kits Signature Formulations Fragrant gifts Gifts for home Gifts for travel Thoughtful gestures Delightful indulgences Bountiful offerings Kits & Sets The Aesop Valise Try the Gift Finder Shop all New & Notable Discover New & Notable New additions Discover New additions The Aesop Valise Unforeseen Aer Antithesis Intense Body Cleanser Solais Replenishing Hand Serum Resolute Facial Concentrate Above Us, Steorra Eau de Parfum Notable formulations Discover Notable formulations Shop all Post-Poo Drops Resurrection Aromatique Hand Wash Reverence Aromatique Hand Wash Resurrection Aromatique Hand Balm Geranium Leaf Body Cleanser The Aesop Valise Uniquely Aesop Skin Care Discover Skin Care Category Discover Category Shop all Skin Care Cleansers Toners Exfoliants & Masks Concentrates & Serums Moisturisers Eye & Lip Care Shaving Sun Care Skin concern Discover Skin concern Dullness Ageing Uneven Tone & Texture Congestion Dehydration Skin type Discover Skin type Normal Dry Oily Combination Sensitive Ingredients Discover Ingredients Vitamin C Retinoid Panthenol Antioxidants Witch Hazel Seasonal Skin Care Find your skin type Hand & Body Discover Hand & Body Category Discover Category Shop all Hand & Body Hand Washes & Balms Bar Soaps Body Cleansers & Scrubs Body Balms & Oils Oral Care & Deodorants Hand & Body Care Kits Notable formulations Discover Notable f
| A business type in JSON-LD | Organization |
| Name | Aesop |
| Telephone | no |
| Address | yes |
| Opening hours | no |
| Menu or price list | nothing |
| Cuisine in structured data | no |
| JSON-LD blocks | 10 (Brand, ContactPoint, EntryPoint, MerchantReturnPolicy, OnlineStore, Organization) |
| Link | Role | Where it goes |
|---|---|---|
| www.aesop.com/hair/hair-treatments/ | booking | the business's own site |
| www.aesop.com/customer-service/orders-and-delivery.html | ordering | the business's own site |
Everything here comes from fetching the homepage once as a crawler. The report turns it into a score and a list of fixes, with code to paste.