For every day that passes, more devices come online, more applications are deployed and more data sources are spun up. There has never been a time in our history when data is […]
Analytics with Microsoft Azure
Spark SQL Aggregations – Gotcha!
Background A few months ago we were writing a Spark job to process AWS billing data. The idea was that every day we’d automatically spin up an Amazon EMR cluster which would do […]
Thoughts on Colour
I never even considered this until the last year or so but I stumbled across a website talking about graphs and colour blindness. It turns out that roughly 1 in 10 (~8%) […]