Beeck Center issues guidance to make government websites AI-friendly

Georgetown's Beeck Center published a report on preparing government websites for AI assistants. It recommends auditing bot-blocking settings, adopting a three-tier access system for crawlers such as GPTBot, Claude and Googlebot, and publishing key information as plain text and HTML tables.

• Proposed three tiers: verified crawlers from major providers, questionable tools and unidentified bots
• Critical data should be published as plain text, HTML tables and PDFs with extractable text
• Websites should be retested for AI crawler access after redesigns or CMS changes
• A dedicated person or team should own content accuracy and timeliness