An assistant's crawler fetches the page once, without running JavaScript, and reads the text, the structured data and the links. Below is what it gets from businessinsider.com, taken from the copy the scanner kept.
characters of text without JavaScript
structured data for the business
of 3 AI crawlers turned away at the edge
Title: Business Insider - Latest News in Tech, Markets, Economy & InnovationBusiness InsiderAccount iconAccount icon · language en-US. First 1,800 of 8,856 characters:
Business Insider - Latest News in Tech, Markets, Economy & Innovation Business Tech Markets Lifestyle Military & Defense Reviews Video Level Up Games Community Newsletters Subscribe Read Watch Listen Search Business Strategy Economy Finance Retail Advertising Careers Law Media Real Estate Small Business The Better Work Project Personal Finance Tech Science AI Enterprise Transportation Startups Innovation Markets News Stocks Indices Commodities Crypto Currencies ETFs Lifestyle Entertainment Culture Travel Food Health Education Parenting Military & Defense Politics Reviews Home Kitchen Style Streaming Pets Tech Deals Gifts Tickets Video Big Business So Expensive View From Above Small Business Authorized Account Risky Business Boot Camp Still Standing How Crime Works Life Lessons Games Boxed Pipeline Knighthop Tally Live Events Tech Insider: Growth Mode The Long Play Stream Business Insider Level Up Community Job Scout Subscribe My account Log in Newsletters Saved Articles US edition Deutschland & Österreich España Japan Polska TW 全球中文版 Get the app Business Insider - Top Stories Top stories Millennial women are tired of being girlbosses 8 min read I went to see why Silicon Valley can't stop laughing at Elizabeth Holmes 4 min read Elon Musk is pouring money into the midterms. Here's where he's giving the most. 2 min read Google Labs’ ‘secret society’ way of thanking its most valuable employees 3 min read Tech 2 min read Here's how Tesla's new Roadster is a completely different car from the 2017 version Politics 4 min read 10 things that lasted longer than Katie Zacharia’s time as White House press secretary AI 3 min read Anthropic polled 1,334 of its employees. They're more sure than most of us that AI will take over jobs. Markets 5 min read Th
| A business type in JSON-LD | Organization |
| Name | Axel Springer |
| Telephone | no |
| Address | no |
| Opening hours | no |
| Menu or price list | a menu or price-list page in HTML www.businessinsider.com/bi-job-scout?utm_source=menu |
| Cuisine in structured data | no |
| JSON-LD blocks | 2 (Brand, CollectionPage, ContactPoint, ImageObject, ItemList, ListItem) |
| Link | Role | Where it goes |
|---|---|---|
| www.businessinsider.com/guides/tickets | booking | the business's own site |
| www.businessinsider.com/side-hustle-rental-wedding-camcorder-business- | ordering | the business's own site |
Everything here comes from fetching the homepage once as a crawler. The report turns it into a score and a list of fixes, with code to paste.