Moving Data [part 2]
So we've put off diving into the world of Apache Spark, purely because we were used to the other tools in industry. One could say, we were in a comfort zone with, for the most part, vendor specific load functions like LOAD DATA INFILE (MySQL), etc. We could move data, and we weren't interested in looking into the new ways of doing things.
However, since we've entered the world of transformations and actions with Apache Spark, it doesn't seem like we will be looking back.
It's a skill set that is rare at this stage in industry, and, it's a sought after skill set.
Come talk to us regarding moving terabytes and terabytes of data in the most efficient way possible.