The sergeantđź”— package has a minor update that adds REST API coverage for two “new” storage endpoints that make it possible to add, update and remove storage configurations on-the-fly without using the GUI or manually updating a config file. This is an especially handy feature when paired with Drill’s new, official Docker container since that… Continue reading
Simplifying World Tile Grid Creation with geom_wtg()
Nowadays (I’ve seen that word used so much in journal articles lately that I could not resist using it) I’m using world tile grids more frequently as the need arises to convey the state of exposure of various services at a global (country) scale. Given that necessity fosters invention it seemed that having a ggplot2… Continue reading
Friday #rstats twofer: Finding macOS 32-bit apps & Processing Data from System Commands
Apple has run the death bell on 32-bit macOS apps and, if you’re running a recent macOS version on your Mac (which you should so you can get security updates) you likely see this alert from time-to-time: If you’re like me, you click through that and keep working but later ponder just how many of… Continue reading
Introducing ‘gepetto’ — a Splash-like REST API to Headless Chrome
It’s been over a year since Headless Chrome was introduced and it has matured greatly over that time and has acquired a pretty large user base. The TLDR on it is that you can now use Chrome as you would any command-line interface (CLI) program and generate PDFs, images or render javascript-interpreted HTML by supplying… Continue reading
In-brief: Using Bro connection logs with Apache Drill
If you’ve got a directory full of Bro NSM logs, it’s easy to work with them in Apache Drill since they’re just tab-separated values (TSV) files by default. The most tedious part is mapping the columns to proper types and hopefully this saves at least one person from typing it out manually: SELECT TO_TIMESTAMP(CAST(columns[0] AS… Continue reading
Updates to the sergeant (Apache Drill connector) Package & a look at Apache Drill 1.14.0 release
Apache Drill 1.14.0 was recently released, bringing with it many new features and a temporary incompatibility with the current rev of the MapR ODBC drivers. The Drill community expects new ODBC drivers to arrive shortly. The sergeantđź”— is an alternative to ODBC for R users as it provides a dplyr interface to the REST API… Continue reading
In-brief: splashr update + High Performance Scraping with splashr, furrr & TeamHG-Memex’s Aquarium
The development version of splashr now support authenticated connections to Splash API instances. Just specify user and pass on the initial splashr::splash() call to use your scraping setup a bit more safely. For those not familiar with splashr and/or Splash: the latter is a lightweight alternative to tools like Selenium and the former is an… Continue reading
Connecting Apache Zeppelin and Apache Drill, PostgreSQL, etc.
A previous post showed how to use a different authentication provider to wire up Apache Zeppelin and Amazon Athena. As noted in that post, Zeppelin is a “notebook” alternative to Jupyter (and other) notebooks. Unlike Jupyter, I can tolerate Zeppelin and it’s got some nifty features like plug-and-play JDBC access. Plus it can do some… Continue reading