Binary package “python3-robot-detection” in ubuntu disco

Detect web crawlers from HTTP UserAgent (Python 3 version)

 This Python module detects if a given HTTP User Agent is a web crawler.
 It uses the list of registered robots from the robotstxt.org.
 .
 This package contains the Python 3 version of the library.