Check out Heritrix if you're looking for an open-source webscraping archival too... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

tn_ on Nov 14, 2017 | parent | context | favorite | on: Ask HN: What are best tools for web scraping?

Check out Heritrix if you're looking for an open-source webscraping archival tool: https://webarchive.jira.com/wiki/spaces/Heritrix

Consider applying for YC's Fall 2026 batch! Applications are open till July 27.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact