pepy.tech

protego

0.5.0
91.47M

Pure-Python robots.txt parser with support for modern conventions