Home
Packages
Datasets
Task Views
R resources
Packages
Toggle theme
Toggle Menu
Home
Packages
robotstxt
rt_get_fields_worker
rt_get_fields_worker function
extracting robotstxt fields
Copy
robotstxt package
Read PDF manual
Maintainer: Pedro Baltazar
License: MIT + file LICENSE
Last published: 2024-08-29
Useful links
https://github.com/ropensci/robotstxt/issues
https://docs.ropensci.org/robotstxt/
https://github.com/ropensci/robotstxt