An assistant's crawler fetches the page once, without running JavaScript, and reads the text, the structured data and the links. Below is what it gets from macarthurobstetricsandgynaecology.com.au, taken from the copy the scanner kept.
characters of text without JavaScript
structured data for the business
of 3 AI crawlers turned away at the edge (GPTBot, ClaudeBot)
Title: Macarthur Obstetrics & Gynaecology · language en-AU. First 1,800 of 4,057 characters:
Macarthur Obstetrics & GynaecologySkip to contentSpecialist women’s health care in Campbelltown(02) 4620 9022 · Mon–FriMacarthurObstetrics & GynaecologyFertilityObstetricsGynaecologyThe $99 GuideResourcesContactRequest an appointmentMenuFertilityObstetricsGynaecologyThe $99 GuideResourcesContactRequest an appointmentCall (02) 4620 9022Obstetrics · Gynaecology · FertilityBefore the first test, make a plan.Specialist women’s health care in Campbelltown, with clear next steps for planning pregnancy, fertility concerns, pregnancy and gynaecological health.Request an appointmentStart with fertility careA GP referral is generally required for a Medicare specialist rebate.Choose your next stepWhat brings you here?I’m trying to conceive→I’m pregnant→I have a women’s health concern→Bring your questions. Leave with a clearer next step.Preconception careStart before you start trying.Healthdirect recommends speaking with a doctor before pregnancy so there is time to review medicines, health conditions, immunisations, supplements and any concerns that may affect pregnancy.01Review what matters to youYour history, cycle, medicines, prior pregnancy experience and questions shape the conversation.02Use tests selectivelyInvestigations should answer a clear question, with the limits and next steps explained.03Make decisions with contextAge, timing, health and personal priorities all matter. There is no one-size pathway.Explore fertility careRead Healthdirect guidance →Specialist servicesCare across reproductive health.Start with the concern in front of you. We’ll help clarify what may need assessment, what options may be reasonable, and where to go next.01Fertility & preconceptionPreparation, initial assessment and thoughtful referral pathways for people trying to conceive.↗02ObstetricsI
| A business type in JSON-LD | no |
| Name | no |
| Telephone | +61246209022 (a tel: link, not structured) |
| Address | no |
| Opening hours | no |
| Menu or price list | nothing |
| Cuisine in structured data | no |
| JSON-LD blocks | 2 (MedicalClinic, PostalAddress, WebPage) |
| Link | Role | Where it goes |
|---|---|---|
| macarthurobstetricsandgynaecology.com.au/contact/ | booking | the business's own site |
Everything here comes from fetching the homepage once as a crawler. The report turns it into a score and a list of fixes, with code to paste.