Home
Packages
Datasets
Task Views
R resources
Packages
Toggle theme
Toggle Menu
Home
Packages
robotstxt
rt_get_comments
rt_get_comments function
extracting comments from robots.txt
Copy
robotstxt package
Read PDF manual
Maintainer: Pedro Baltazar
License: MIT + file LICENSE
Last published: 2024-08-29
Useful links
https://github.com/ropensci/robotstxt/issues
https://docs.ropensci.org/robotstxt/
https://github.com/ropensci/robotstxt