google.com/goto: Google's anti-scraping update(autom.dev)
528 points by 1e1a 12 hours ago | 424 comments
tl;dr: Google Search now wraps organic result links in `google.com/goto?url=...` using an opaque, Google-specific encoding rather than the readable `google.com/url?q=` format, forcing scrapers to make an additional request to Google (reading the Location header) just to resolve each destination URL. The change, rolling out broadly to logged-out and private sessions as of late August 2026, raises the cost of bulk SERP harvesting and follows other anti-scraping moves like killing `&num=100` and tightening SearchGuard.
HN Discussion:
  • Google has been declining for years; users are switching to alternatives like Yandex, DuckDuckGo, or Mojeek
  • URL redirection is user-hostile, obscures destinations, and continues Google's pattern of obfuscation
  • This anti-scraping move mainly hurts small players while well-resourced scrapers can bypass it
  • The change is harmless to regular users and only affects bots; outrage is unwarranted
  • Speculative/forward-looking ideas like running local indexed search or abandoning SEO in response