Author: hrbrmstr
Everything written by hrbrmstr.
Connecting Apache Zeppelin and Apache Drill, PostgreSQL, etc.
A previous post showed how to use a different authentication provider to wire up Apache Zeppelin and Amazon Athena. As noted in that post, Zeppelin is a "notebook" alternative to Jupyter (and other) notebooks. Unlike Jupyter, I can…
Connecting Apache Zeppelin Up to Amazon Athena with an IAM Profile Name
One really cool feature of Zeppelin is the ability for it to wire it up to databases via JDBC and use it interactive queries. A future post will provide instructions for Apache Drill, but this one's about wiring up Amazon Athena and Apache…
Digging into mbox details: A tale of tm & reticulate
I had to processes a bunch of emails for a $DAYJOB task this week and my "default setting" is to use R for pretty much everything (this should come as no surprise). Treating mail as data is not an uncommon task and many R packages exist…
ggplot "Doodling" with HIBP Breaches
After reading this interesting analysis of "How Often Are Americans' Accounts Breached?" by Gaurav Sood (which we need more of in cyber-land) I gave in to the impulse to do some gg-doodling with the "Have I Been Pwnd" JSON data he…
Two new Apache Drill UDFs for Processing UR[IL]s and Internet Domain Names
Continuing the blog's UDF theme of late, there are two new UDF kids in…
New Apache Drill UDF for Processing Twitter Tweet Text
There are many ways to gather Twitter data for analysis and many R and Python (et al) libraries make full use of the Twitter API when building a corpus to extract useful metadata for each tweet along with the text of each tweet. However,…
A new 'boto3' Amazon Athena client wrapper with dplyr async query support
A previous post explored how to deal with Amazon Athena queries asynchronously. The function presented is a beast , though it is on purpose (to provide options for…
Alleviating AWS Athena Aggravation with Asynchronous Assistance
I've blogged about how to use Amazon Athena with R before and if you are a regular Athena user, you've likely run into a situation where you prepare a dplyr chain, fire off a collect() and then…
Visualizing macOS App Usage with a Little Help from osqueryr & mactheknife
Both my osqueryr and macthekinfe packages have had a few updates and I wanted to put together a fun example (it being Friday, and all) for what you can do with them. All my packages are now on GitHub and GitLab and I'll be maintaining them…
Freeing PDF Data to Account for the Unaccounted
I've mentioned @stiles before on the blog but for those new to my blatherings, Matt is a top-notch data journalist with the @latimes and currently stationed in South Korea. I can only imagine how much busier his life has gotten since that…