# SEO bots allowlist — substring match (case-insensitive) on User-Agent. # These bots are allowed to GET HTML page routes. They are NEVER allowed on /api/*. Googlebot Bingbot DuckDuckBot Applebot YandexBot Baiduspider Slurp SeznamBot facebookexternalhit Twitterbot LinkedInBot Pinterest WhatsApp TelegramBot Mastodon Discordbot