Google-Extended

About this crawler

Google-Extended is Google’s training crawler. Google's AI training opt-in, separate from regular Googlebot. Sites that block this remain in Google search but get excluded from Gemini / AI Overviews training. Notably absent from findloc.ai's crawler logs so far.

How this page works

1. Every request to findloc.ai passes through a Next.js middleware.
2. If the User-Agent matches a known AI bot pattern, one row is inserted into the ai_crawler_visits Postgres table. Fire-and-forget so the bot’s response isn’t slowed.
3. This page queries that table via three SECURITY DEFINER RPCs (ai_bot_hit_counts, ai_bot_daily_hits, ai_bot_top_paths) on every render.
4. Page response is cached for 1 hour via Next.js ISR — so DB load is bounded even under load, and the freshest number is always at most 60 minutes old.