sitemaps function

Retrieve a character vector of sitemaps from a parsed robots.txt object

sitemaps(xp)

Arguments

• xp: A robxp object

Returns

charcter vector of all sitemaps found in the parsed robots.txt file

Examples

imdb <- paste0(readLines(system.file("extdata", "imdb-robots.txt",
               package="rep")), collapse="\n")
rt <- robxp(imdb)
sitemaps(rt)