Svelte Hacker News logo
  • top
  • new
  • show
  • ask
  • jobs
  • about

Crawling a billion web pages in just over 24 hours, in 2025

andrewkchan.dev

3 points by DocFeind 6 hours ago