Schema-on-what?
Recently, a customer asked us to help transition a set of data flows from an overwhelmed RDBMS to a “Big Data” system. These data flows had a batch dynamic, and there was some comfort with Pig Latin...
Recent Posts
The Data Architecture Lifecycle
It’s a very exciting time to be in the data world, with new and groundbreaking technologies released seemingly every day. There is every temptation to pick up today’s new shiny, find an excuse to...
Not Just Open Source: 7 High-Value Areas To Consider Commercial Components For Big Data Architectures
The Big Data landscape is largely dominated by powerful free open source technologies. Different configurations and applications of these technologies seemingly consume the majority of mindshare, and...
FTC & Big Data Bias Warnings
A recent WSJ article echoes an FTC report released last Wednesday warning of the possible consequences of bias in Big Data applications. The article identifies a number of valid concerns around...
Big Data Architecture Patterns
Modern business problems require ever increasing amounts of data, and ever increasing variety in the data that they ingest. Aphorisms such as the “three V's” have evolved to describe some of the...
