extrcting comments from robots.txt

Description

extrcting comments from robots.txt

Usage

1

Arguments

txt

content of the robots.txt file


Questions? Problems? Suggestions? or email at ian@mutexlabs.com.

Please suggest features or report bugs with the GitHub issue tracker.

All documentation is copyright its authors; we didn't write any of that.