An assistant's crawler fetches the page once, without running JavaScript, and reads the text, the structured data and the links. Below is what it gets from dailytelegraph.com.au, taken from the copy the scanner kept.
characters of text without JavaScript
structured data for the business
of 3 AI crawlers turned away at the edge (GPTBot, ClaudeBot, PerplexityBot)
Title: No Cookies | Daily Telegraph · language en. First 1,800 of 6,934 characters:
No Cookies | Daily Telegraph Read Today's PaperTributesSubscribeSign InRead Today's PaperMy accountLogoutMy NewsToday's PaperThe Daily TelegraphTweed Daily NewsThe Coffs Coast AdvocateNorth Shore TimesWentworth CourierMosman DailyLiftouts & MagazinesAt HomeBingeBody + SoulEscapeReal EstateStellarSydney WeekendTAB Form GuideNSWLocal BlacktownCampbelltown-CamdenSt George and ShireCanterbury-BankstownEastern SuburbsFairfieldThe HillsHornsbyInner WestLiverpoolManlyMosmanNorth ShoreParramattaPenrithRydeSouth East SydneySydney CityAlburyBallinaBlue MountainsBowralByron ShireCanberraCentral CoastCoffs HarbourDubboGraftonLismoreNewcastlePort MacquarieSouth CoastTweed HeadsWagga WaggaWollongongNSWBreaking NewsPolice & CourtsBush SummitTributesDTTVThe WarPodcastsRead Today's PaperClassifiedsNationalBack AustraliaLet Them Be KidsThe Home FrontRegionalNorthern TerritoryQueenslandSouth AustraliaTasmaniaVictoriaWestern AustraliaVideoTrue CrimeWorldAsiaEuropeMiddle EastNorth AmericaSportNRLNRLWSuperCoach NRLNRL TippingSchoolboy CupLadderTeamsOriginOpinionAFLNewsSuperCoach AFLAFL TippingLadderAFLWOpinionTeamsCricketBBLSuperCoach BBLOpinionWomen's CricketHorse RacingFormBasketballNBLSuperCoach NBLNBASuperCoachMotorsportSupercarsFormula 1MotoGPFootballA-LeaguesEPLWorld Cup 2026GolfTennisRugbySuper RugbyNetballMore SportsLocal SportUFCBoxingCyclingAmerican SportsNFLOlympicsWinter OlympicsParalympicsPodcastsDaily Telegraph NRLSuperCoach NRLThe Matty Johns PodcastLive StreamsLeagueBasketballWater PoloOther SportsKTV PartnersBusinessBusiness NewsAgribusinessInsolvenciesNew South WalesNorthern TerritoryQueenslandSouth AustraliaTasmaniaVictoriaEconomyAustralian EconomyRetailSmall BusinessStocks & SharesWorkEntrepreneursLeaders & CompaniesWomen in LeadershipOpinion & AnalysisASX TraderBarefoot
| A business type in JSON-LD | no |
| Name | no |
| Telephone | no |
| Address | no |
| Opening hours | no |
| Menu or price list | nothing |
| Cuisine in structured data | no |
| JSON-LD blocks | 1 (BreadcrumbList, ListItem) |
No booking or ordering link found. An agent has nothing to act on.
Everything here comes from fetching the homepage once as a crawler. The report turns it into a score and a list of fixes, with code to paste.