An assistant's crawler fetches the page once, without running JavaScript, and reads the text, the structured data and the links. Below is what it gets from australia.com, taken from the copy the scanner kept.
characters of text without JavaScript
structured data for the business
of 3 AI crawlers turned away at the edge
Title: Travel to Australia - Australian Tourism Information - Tourism Australia · language en-GB. First 1,800 of 11,499 characters:
Travel to Australia - Australian Tourism Information - Tourism Australia Skip to content Skip to footer navigation Search Back Be inspired Places to go Things to do Plan your trip Search Be inspired Places to go Things to do Plan your trip Explore Come and say G'day Discover your Australia Travel videos Deals and offers Cities States Beaches Islands Country Outback Nature Sydney Melbourne Brisbane Perth Gold Coast Adelaide Cairns Darwin Hobart Canberra View more Australian Capital Territory New South Wales Northern Territory Queensland South Australia Tasmania Victoria Western Australia External Territories View more Bondi The Whitsundays Esperance Mornington Peninsula Noosa Jervis Bay Port Douglas Byron Bay Ningaloo Reef Airlie Beach View more Kangaroo Island Rottnest Island K’gari Hamilton Island Lord Howe Island Tiwi Islands Phillip Island The Whitsundays Bruny Island View more Margaret River Barossa Valley The Grampians Hunter Valley Bundaberg Daylesford McLaren Vale Glass House Mountains Mudgee Alice Springs Broome Uluru and Kata Tjuta The Kimberley Flinders Ranges Kakadu National Park Eyre Peninsula Karijini National Park Monkey Mia Great Barrier Reef Kangaroo Island Blue Mountains Daintree Rainforest Great Ocean Road Scenic Rim Purnululu National Park Cradle Mountain-Lake St Clair National Park Litchfield National Park Freycinet View more Culture Adventure Nature Sustainable travel Relaxation Family Backpacking Aboriginal experiences Arts and culture Festivals and events Food and drink Adventure and sports Walks and hikes Road trips and drives Beaches and islands Nature and national parks Wildlife Sustainable travel Health and wellness Luxury Family travel Family destinations Family road trips Backpacking Work and holiday Visa FAQ Planning tools Visas and entry A
| A business type in JSON-LD | no |
| Name | no |
| Telephone | no |
| Address | no |
| Opening hours | no |
| Menu or price list | nothing |
| Cuisine in structured data | no |
| JSON-LD blocks | 1 (EntryPoint, SearchAction, WebSite) |
| Link | Role | Where it goes |
|---|---|---|
| www.smartraveller.gov.au/while-youre-away/biosecurity-border | ordering | an unrecognised third party |
Everything here comes from fetching the homepage once as a crawler. The report turns it into a score and a list of fixes, with code to paste.