A hipster web crawler
Go to file
Matt Arnold 352709b82c Inital Commit 2020-12-29 00:06:37 -05:00
README.md Inital Commit 2020-12-29 00:06:37 -05:00
requirements.txt Inital Commit 2020-12-29 00:06:37 -05:00
web2text.py Inital Commit 2020-12-29 00:06:37 -05:00

README.md

Snarfbot

This will eventually be a web crawler that saves websites in plaintext files. For now please enjoy a few cli tools, written as POC. Comments, compliments, complaints, and pull requests accepted.