An assistant's crawler fetches the page once, without running JavaScript, and reads the text, the structured data and the links. Below is what it gets from theotherpages.org, taken from the copy the scanner kept.
characters of text without JavaScript
structured data for the business
of 3 AI crawlers turned away at the edge
Title: Poets' Corner - Home Page: Introduction, Overview, and Index Summary. First 1,800 of 7,010 characters:
Poets' Corner - Home Page: Introduction, Overview, and Index Summary The Collection currently contains approximately: 7,459 Works by 800 Poets as of 2/5/2022 News and Additions Facebook Page Tumblr Page Events Condensed Author Index Search Tool Subject Index Quick Sampler Bookshelf Our Favorite Poems Faces of the Poets Anonymous and Traditional This is a distributed project created, edited, and maintained by: Bob Blair in Texas, Jon Lachelt in Colorado, Nelson Miller in Georgia, and Steve Spanoudis in Florida, With substantial contributions from volunteers all over the world. Other Pages HOMEAccess the many other collections on this site FAQ Contributors Partial Bibliography Other Works Other Sites About the images:These are digital paintings, created by Steve from historical photographs. (a) Robert Louis Stevenson, based on a Wikimedia Commons image. (b) Edna St. Vincent Millay, based on an image at the Vassar College Library (c) H.D. (Hilda Doolittle), based on an image from the Yale University Library. (d) Paul Laurence Dunbar, from a image at the Ohio Historical Society. (b) Stephen Vincent Ben�t, based on an Encyclopedia Britannica image Poets: A B . C D . E F . G H . I J . K L . M N . O P . Q R . S T . U V . W X . Y Z | Other National Poetry Month Tumblr Archive: April 2021 | April 2020 | April 2019 | April 2018 | April 2017 (note - some spill into May) Special Thanks to the 2021 NPM Contributors: (Nelson) Howard Miller, and Kashiana Singh Introduction Welcome to Poets' Corner, one of the largest and oldest text resources on the web. The goal of this project is to maintain a user-friendly library that is both a useful reference and an appealing place to browse and explore - and there is plenty of material here to explore. The collection covers over 7,300 works by
| A business type in JSON-LD | no |
| Name | no |
| Telephone | no |
| Address | no |
| Opening hours | no |
| Menu or price list | nothing |
| Cuisine in structured data | no |
| JSON-LD blocks | 0 |
No booking or ordering link found. An agent has nothing to act on.
Everything here comes from fetching the homepage once as a crawler. The report turns it into a score and a list of fixes, with code to paste.