An assistant's crawler fetches the page once, without running JavaScript, and reads the text, the structured data and the links. Below is what it gets from virginaustralia.com, taken from the copy the scanner kept.
characters of text without JavaScript
structured data for the business
of 3 AI crawlers turned away at the edge
Title: Page not found · language en-AU. First 1,800 of 3,771 characters:
Page not found Skip to content Book Book now Let's fly Explore hotels Hire a car Travel insurance Holidays Pride Flight Activities Business Class Flights Flight specials Happy Hour Featured sales Sign up to V-mail Manage booking Retrieve your Travel Bank details Change or cancel Upgrade options Check-in Redeem travel credits Domestic flights Flights to Sydney Flights to Melbourne Flights to Brisbane Flights to Perth Flights to Gold Coast Flights to Cairns Explore all destinations International flights Flights to Bali Flights to Fiji Flights to Queenstown Flights to London Flights to Paris Flights to Rome Flights to Athens Holiday packages Holidays in Fiji Holidays in Bali Holidays in Vanuatu Holidays in Hamilton Island Holidays in Cairns Holidays in Gold Coast Holidays in New Zealand Explore Our network Destinations Travel inspiration Qatar Airways partnership Book flights Popular domestic routes Sydney to Melbourne Sydney to Brisbane Melbourne to Sydney Melbourne to Brisbane Brisbane to Sydney Adelaide to Melbourne Perth to Melbourne Popular international routes Sydney to Bali flights Melbourne to Bali flights Brisbane to Bali flights Sydney to Fiji flights Melbourne to Fiji flights Brisbane to Fiji flights Sydney to London flights Melbourne to London flights Travel info Flying with us Fare types Our fleet Agency Hub Airline partners Qatar Airways partnership Specific travel Specific needs and assistance Flying with kids Pet travel Charters Group travel Important update for guests departing Sydney Airport Baggage Baggage on partner airline flights Carry-on baggage Checked baggage Dangerous goods Baggage tracking Day of travel Check-in Lounges Connecting flights Airport guides Transfer maps Delayed, cancelled and disrupted flights Onboard experience Cabin classes Econom
| A business type in JSON-LD | no |
| Name | no |
| Telephone | no |
| Address | no |
| Opening hours | no |
| Menu or price list | a menu or price-list page in HTML www.virginaustralia.com/au/en/travel-info/onboard-experience |
| Cuisine in structured data | no |
| JSON-LD blocks | 1 (BreadcrumbList, ListItem, microdata:SiteNavigationElement) |
| Link | Role | Where it goes |
|---|---|---|
| www.virginaustralia.com/au/en/?bookingType=flights#/book-trip | booking | the business's own site |
Everything here comes from fetching the homepage once as a crawler. The report turns it into a score and a list of fixes, with code to paste.