A stark but recurring reality in the business world is this: when it comes to working with data, statistics and mathematics are rarely the rate-limiting elements in moving the needle of value.  Most firms’ unwashed masses of data sit far lower on Maslow’s heirarchy, at the level of basic nurture and shelter.  What is needed for this data isn’t philosophy, religion, or science — what’s needed is basic, scalable infrastructure.

M. E. Driscoll defines data engineering. This is my job. (By the way, if it sounds like something you’re good at, we are hiring at Etsy. Email me.)