An assistant's crawler fetches the page once, without running JavaScript, and reads the text, the structured data and the links. Below is what it gets from rtravel.ae, taken from the copy the scanner kept.
characters of text without JavaScript
structured data for the business
of 3 AI crawlers turned away at the edge (GPTBot)
Title: rtravel · language en. First 1,800 of 34,726 characters:
rtravel English Sign In Sign Up Search Booking My Bookings My Account Travellers Loyalty Select Currency Select Language English عربي Home About Us Contact us Sign In Sign Up Search Booking Hotels Transfers Activities Destination / Hotel Name Hotel Name Search Popular Cities {{pcs_data.popular_cities_name.city_name}} Search Popular Hotel {{pcsh_data.popular_hotel_name.hotel_name}} Check In - Check Out Travellers Rooms 1 Adults 1 2 3 Child 0 1 2 3 Add Rooms Done Nationality Afghanistan African(Central African Republic) African(Comoros) African(South Africa) Aland Islands Albania Algerian American American Samoan Andorran ANGOLA Anguillan Antarctic Antiguan - Barbudan Argentina Armenian Aruban Australian Australian(Norfolk Island) Austrian Azerbaijani Bahamian Bahraini Bangladeshi Barbadian Batswana Belarusian Belgian Belizean Benin Bermuda Bhutan Bolivian Bonaire, Sint Eustatius And Saba(Dutch) Bosnia And Herzegovina Bouvet Island Brazilian British British Virgin Islands British(Indian Overseas Territory) Bruneian Bulgarian BURKINA FASO Burundi Cambodian Cameroonian Canadian Carribean(Saint Kitts And Nevis) Cayman Islands Chad Chilean Chinese CHRISTMAS ISLAND Cocos Island Colombian Congolese Costa Rican Croatian Cuba Curacao(Dutch) Cypriot Czech Danish Danish(Faroe) Djibouti Dominica Dominican (Dominican Republic) Dutch(Saint Vincent And The Grenadines) East Timor Ecuador Egyptian Emirati Equatorial Guinea Eritrea Estonian Ethiopia Falkland Islands Fiji Finnish French French Guiana French Polynesia French Southern Territories French(Dutch) Gabon Gambian Georgian German Ghanaian Gibraltarian Greece Greenland Grenadian Guadeloupe Guam Guatemalan Guernsey Guinea Guinea-Bissau Guyana Haiti Heard Island Honduras Hong Kong Hungarian Icelander Indian Indonesian Iranian IRAQI
| A business type in JSON-LD | Organization |
| Name | rtravel |
| Telephone | no |
| Address | no |
| Opening hours | no |
| Menu or price list | nothing |
| Cuisine in structured data | no |
| JSON-LD blocks | 1 (Organization) |
| Link | Role | Where it goes |
|---|---|---|
| www.rtravel.ae/booking_list.php?action_name=show_customer_booking_list | booking | the business's own site |
Everything here comes from fetching the homepage once as a crawler. The report turns it into a score and a list of fixes, with code to paste.