The in-dev htmlunit package for javascript-“enabled” web-scraping without the need for Selenium, Splash or headless Chrome relies on the HtmlUnit library and said library just released version 2.34.0 with a wide array of changes that should make it possible to scrape more gnarly javascript-“enabled” sites. The Chrome emulation is now also on-par with Chrome 72 series (my Chrome beta is at 73.0.3683.56 so it’s super close to very current).
In reality, the update was to the htmlunitjars package where the main project JAR and dependent JARs all received a refresh.
The README and tests were all re-run on both packages and Travis is happy.
If you’ve got a working rJava installation (aye, it’s 2019 and that’s still “a thing”) then you can just do:
install.packages(c("htmlunitjars", "htmlunit"), repos = "https://cinc.rud.is/")
to get them installed and start playing with the DSL or work directly with the Java classes.
FIN
As usual, use your preferred social coding site to log feature requests or problems.
3 Trackbacks/Pingbacks
[…] leave a comment for the author, please follow the link and comment on their blog: R – rud.is. R-bloggers.com offers daily e-mail updates about R news and tutorials on topics such as: Data […]
[…] mentioned {htmlunit} in passing before, but did not put any code in the blog post. Since I just updated {htmlunitjars} […]
[…] mentioned {htmlunit} in passing before, but did not put any code in the blog post. Since I just updated {htmlunitjars} […]