An assistant's crawler fetches the page once, without running JavaScript, and reads the text, the structured data and the links. This is that view of cbp.gov, from the copy the scanner kept.
characters of text without JavaScript
structured data for the business
of 3 AI crawlers turned away at the edge (GPTBot, ClaudeBot, PerplexityBot)
Title: U.S. Customs and Border Protection | U.S. Customs and Border ProtectionLock · language en. First 1,800 of 5,501 characters:
U.S. Customs and Border Protection | U.S. Customs and Border Protection Skip to main content An official website of the United States government Here’s how you know Here’s how you know Official websites use .gov A .gov website belongs to an official government organization in the United States. Secure .gov websites use HTTPS A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites. Menu Type your search term Travel Travel U.S. Citizens/LPR Mobile Passport Control Canada and Mexico Travel Know Before You Go International Visitors ESTA Know Before You Visit Visa Waiver Program Trusted Traveler Programs TSA PreCheck® Global Entry NEXUS SENTRI FAST Biometrics Overview Environments Enhanced Passenger Processing Privacy Policy Partners Verify My Exit Signage and Informational Materials Media Releases General Aviation Processing General Aviation Airport Fact Sheets General Aviation Processing FAQs Trade Trade Basic Import and Export Exporting a Motor Vehicle Importer/Exporter Tips Importing a Car Internet Purchases ACE: The Import and Export Processing System Deployments Frequently Asked Questions (FAQs) Reports Support Training and Reference Guides Stakeholder Engagement Office of Trade Relations Commercial Customs Operations Advisory Committee (COAC) Trade and Cargo Security Summit (TCSS) Trade Outreach Webinars Small Business Regulatory Enforcement Fairness Act Priority Trade Issues Agriculture and Quota Antidumping and Countervailing Duty (AD/CVD) Import Safety Intellectual Property Rights (IPR) Revenue Textiles/Wearing Apparel Trade Agreements Rulings & Legal Decisions Customs Bulletin and Decisions Electronic Ruling Requirements Federal Register Notices Informed Compliance Publications Border
| A business type in JSON-LD | no |
| Name | no |
| Telephone | no |
| Address | no |
| Opening hours | no |
| Menu or price list | nothing |
| Cuisine in structured data | no |
| JSON-LD blocks | 0 |
| Link | Role | Where it goes |
|---|---|---|
| www.cbp.gov/border-security | ordering | the business's own site |
| careers.cbp.gov/s/career-paths/usbp | ordering | the business's own site |
| www.linkedin.com/company/customs-and-border-protection | ordering | an unrecognised third party |
Everything here comes from one fetch of the homepage as a crawler; the report turns it into a score and fixes, with a kit to paste.