python-robot-detection - Library for detecting if a HTTP User Agent header is likely to be a bot
| Website: | http://www.celtic-knot-creator.com/robot-detection/ |
|---|---|
| License: | GPLv3+ |
- Description:
robot_detection is a python module to detect if a given HTTP User Agent is a web crawler. It uses the list of registered robots from http://www.robotstxt.org. There is only one, function, ``is_robot`` that takes a string (unicode or not) and returns True iff that string matches a known robot in the robotstxt.org ...
Packages
| python-robot-detection-0.3-1.el7.centos.noarch [27 KiB] |
Changelog
by Aurelien Bompard (2013-05-18):
- Initial package. |