solene/openbsd-webzine
6
0
Fork 8
Code Issues 1 Pull Requests 1 Projects Releases Wiki Activity
26ca69c87d
openbsd-webzine/public/robots.txt
prx 6ee5c108d6 add favicon 
add humans.txt and robots.txt
generate sitemap
generate atom feed
2021-09-29 15:00:26 +02:00

5 lines
87 B
Plaintext
Raw Blame History

User-agent: *
Disallow:
Crawl-delay: 2
Sitemap: https://webzine.puffy.cafe/sitemap.gz
Reference in New Issue View Git Blame Copy Permalink