R programming Web Scraping

Question

I tried to scrape webpage from the below link using R vest package from R programming.

My code is:

library("xml2")
library("rvest")
url<-read_html("https://www.edureka.co/aws-certification-training")
tbls_ls <- url %>%
html_nodes("table") %>%
html_table(fill = TRUE)%>%
gsub("^\\s\\n\\t+|\\s+$n+$t+$", "", .)
View(tbls_ls)

My requirement is that I want to remove \\n,\\t from the result. I want to give pagination to scrape multiple pages, so that I can scrape this webpage with pagination.

Answer 1

Try something like this:

library(rvest)
library(rvest)
library(tidyverse)
urls <- read_html("https://www.edureka.co/aws-certification-training")
pag <- 1:5
read_urls <- paste0(urls, pag)
read_urls %>% 
  map(read_html) -> p

Now, I didn't see any '\\n' or '\\t' patterns in the data sets. Nevertheless, if you want to look for a specific string, you can do it like this.

library(stringr)
str_which(urls, "[your]string_here")