Mortar has joined Datadog, the leading SaaS-based monitoring service for cloud applications. Read more about what this means here.

Learn About Hadoop

    The engine that allows Mortar to process large amounts of MongoDB data in parallel is Apache Pig on Hadoop. You don't need to know everything about Hadoop, but a little background is helpful. This video provides a great overview of where Hadoop comes from and how it works.


    Note that Mortar's Hadoop clusters run on Amazon Elastic MapReduce (EMR) instead of the video's Greenplum, but the Hadoop concepts are the same. The main differences are that with EMR you can create and destroy new Hadoop clusters whenever you need, at any size you want. Also, EMR is highly optimized to read and write data to Amazon S3.

    If you'd like to learn even more about Hadoop, here are a few other great resources: