Total 18 Posts

Big Data

Basics of Apache Nifi: 2

On our previous video on the basics of Nifi, we covered a brief definition of…

Read More


Data Extrapolation: Learning From Your Big Data

The first step in answering any Big Data-oriented question is to simply obtain the data.…

Read More


Jun 08, 2017

Justin Risch

Justin Risch

Big Data

MongoDB and Apache Spark - Getting started tutorial

MongoDB and Apache Spark are two popular Big Data technologies. In my previous post, I…

Read More


Basics of Apache Nifi: 1

In our previous article on Nifi, we discussed the history, architecture, and features of Apache…

Read More


Streaming With Scala: The Nuance of Real-Time Twitter Data

At Ippon Technologies USA, we're lucky enough to have "Coding Dojos" every 2-4…

Read More


Pokemon GO: A Big Data Learning Opportunity

Nick Peterson and Justin Risch have begun to study Big Data, Spark, Hadoop, and the…

Read More


Feb 16, 2017

Justin Risch

Justin Risch

Big Data

Why NiFi?

In this day and age we are living in, it is not a luxury to…

Read More


Jan 26, 2017

Doug Mengistu

Doug Mengistu

Big Data

Kafka Streams - Scaling up or down

Kafka Streams is a new component of the Kafka platform. It is a lightweight library…

Read More


Spark - Calling Scala code from PySpark

In a previous post, I demonstrated how to consume a Kafka topic using Spark in…

Read More


Apache Spark Datasets

With a Spark 2.0 release imminent, the previously experimental Datasets API will be a…

Read More


Spark & Kafka - Achieving zero data-loss

Kafka and Spark Streaming are two technologies that fit well together. Both are distributed systems…

Read More


A tour of Databricks Community Edition: a hosted Spark service

With the recent announcement of the Community Edition, it’s time to have a look…

Read More


Kafka, Spark and Avro - Part 3 of 3, Producing and consuming Avro messages

This post is the third and last post in a series in which we learn…

Read More


Testing strategy for Spark Streaming - Part 2 of 2

In a previous post, we’ve seen why it’s important to test your Spark…

Read More


Kafka, Spark and Avro - Part 2 of 3, Consuming Kafka messages with Spark

This post is the second post in a series in which we will learn how…

Read More