An assistant's crawler fetches the page once, without running JavaScript, and reads the text, the structured data and the links. Below is what it gets from taglus.com.au, taken from the copy the scanner kept.
characters of text without JavaScript
structured data for the business
of 3 AI crawlers turned away at the edge (GPTBot, ClaudeBot)
Title: Untitled · language en. First 958 of 958 characters:
Untitled SiteNew linkResourcesLearnDocumentationGuides and APIBlogLatest postsUpdatesChangelogWhat is newFeaturedPlatform guideOverview of features and setup.DownloadWebinarJoin our next live session.RegistersecondNew linkProductSign inGet startedSiteMobile navigation linksSiteNew linkResourcesLearnDocumentationGuides and APIBlogLatest postsUpdatesChangelogWhat is newsecondNew linkProductSign inGet started Deploy fasterA better workflowLorem ipsum, dolor sit amet consectetur adipisicing elit. Maiores impedit perferendis suscipit eaque, iste dolor cupiditate blanditiis ratione.Push to deploy. Lorem ipsum, dolor sit amet consectetur adipisicing elit. Maiores impedit perferendis suscipit eaque, iste dolor cupiditate blanditiis ratione.SSL certificates. Anim aute id magna aliqua ad ad non deserunt sunt. Qui irure qui lorem cupidatat commodo.Database backups. Ac tincidunt sapien vehicula erat auctor pellentesque rhoncus. Et magna sit morbi lobortis.
| A business type in JSON-LD | no |
| Name | no |
| Telephone | no |
| Address | no |
| Opening hours | no |
| Menu or price list | nothing |
| Cuisine in structured data | no |
| JSON-LD blocks | 0 |
No booking or ordering link found. An agent has nothing to act on.
Everything here comes from fetching the homepage once as a crawler. The report turns it into a score and a list of fixes, with code to paste.