---
title: Strata+Hadoop World 2016 in New York
description: "Strata+Hadoop World is probably the most important conference about Data Science\nand Data Engineering. The last edition took place in New York last week and\ngathered more than 2000 attendees. With 15 parallel tracks over 2 days of\nconference, that’s more than 160 sessions you could attend! Here"
image: https://blog.ippon.tech/hubfs/Imported_Blog_Media/strata-hadoop-2-1-1-Jan-18-2024-06-02-16-4781-PM.jpg
---
[Skip to main content](https://blog.ippon.tech/stratahadoop-world-2016-in-new-york#main)
[   ](https://ipponusa.com/)
- [Home](https://ipponusa.com)
- [Show submenu for About About](https://ipponusa.com/about-us)
- [Who We Are](https://ipponusa.com/who-we-are)
- [Careers](https://ipponusa.com/careers)
- [Show submenu for Our Partners Our Partners](https://ipponusa.com/our-partners/)
- [AWS](https://ipponusa.com/our-partners/aws/)
- [Snowflake](https://ipponusa.com/our-partners/snowflake/)
- [Databricks](https://ipponusa.com/our-partners/databricks/)
- [Microsoft](https://ipponusa.com/our-partners/microsoft/)
- [Show submenu for Services Services](https://ipponusa.com/services)
- [Snowflake](https://ipponusa.com/service/snowflake-concierge/)
- [Artificial Intelligence](https://ipponusa.com/service/artificial-intelligence/)
- [Data & Analytics](https://ipponusa.com/service/data-analytics/)
- [Cloud Strategy](https://ipponusa.com/service/cloud-strategy/)
- [Platform Modernization](https://ipponusa.com/service/platform-moderization/)
- [Product Innovation](https://ipponusa.com/service/product-innovation/)
- [Operating Model](https://ipponusa.com/service/operating-model/)
- [Blogs](https://blog.ippon.tech/)
- [Success Stories](https://ipponusa.com/success-stories/)
- [Show submenu for Resources Resources](https://ipponusa.com/resources/)
- [eBooks](https://ipponusa.com/ebooks/)
- [The Data Pour](https://info.ippon.tech/the-data-pour)
- [Videos & Webinars](https://info.ippon.tech/videos-and-webinars)
- [Media Center](https://ipponusa.com/media-center/)
Search
Open main navigation
Close main navigation
- [Home](https://ipponusa.com)
- Show submenu for About About
- About
- [About](https://ipponusa.com/about-us)
- [Who We Are](https://ipponusa.com/who-we-are)
- [Careers](https://ipponusa.com/careers)
- Show submenu for Our Partners Our Partners
- Our Partners
- [Our Partners](https://ipponusa.com/our-partners/)
- [AWS](https://ipponusa.com/our-partners/aws/)
- [Snowflake](https://ipponusa.com/our-partners/snowflake/)
- [Databricks](https://ipponusa.com/our-partners/databricks/)
- [Microsoft](https://ipponusa.com/our-partners/microsoft/)
- Show submenu for Services Services
- Services
- [Services](https://ipponusa.com/services)
- [Snowflake](https://ipponusa.com/service/snowflake-concierge/)
- [Artificial Intelligence](https://ipponusa.com/service/artificial-intelligence/)
- [Data & Analytics](https://ipponusa.com/service/data-analytics/)
- [Cloud Strategy](https://ipponusa.com/service/cloud-strategy/)
- [Platform Modernization](https://ipponusa.com/service/platform-moderization/)
- [Product Innovation](https://ipponusa.com/service/product-innovation/)
- [Operating Model](https://ipponusa.com/service/operating-model/)
- [Blogs](https://blog.ippon.tech/)
- [Success Stories](https://ipponusa.com/success-stories/)
- Show submenu for Resources Resources
- Resources
- [Resources](https://ipponusa.com/resources/)
- [eBooks](https://ipponusa.com/ebooks/)
- [The Data Pour](https://info.ippon.tech/the-data-pour)
- [Videos & Webinars](https://info.ippon.tech/videos-and-webinars)
- [Media Center](https://ipponusa.com/media-center/)
- Search
- [Contact Us](https://ipponusa.com/contact/)
[Contact Us](https://ipponusa.com/contact/)
# Strata+Hadoop World 2016 in New York
by [Alexis Seigneurin](https://blog.ippon.tech/author/alexis-seigneurin)
October 6, 2016
[Culture](https://blog.ippon.tech/tag/culture/)
Oct 06, 2016
Strata+Hadoop World is probably the most important conference about Data Science and Data Engineering. The last edition took place in New York last week and gathered more than 2000 attendees. With 15 parallel tracks over 2 days of conference, that’s more than 160 sessions you could attend! Here is my take.
## **Keynotes**
As an introduction to the technical talks, the keynote speakers did a great job showing how our industry takes place in our -real- life, how data can be efficiently used to contribute to better healthcare, better education, better lives…
To name only one, Mar Cabra, head of the Data and Research unit at the International Consortium of Investigative Journalists, explained what techniques they used to analyze the huge amount of data from the Panama Leaks.
The least I can say is that these talks were inspiring.
## **A few suggested talks**
I obviously cannot give a comprehensive transcript of what was presented at Strata. Instead, let me give you a summary of a few sessions I liked.
*Making on-demand grocery delivery profitable with data science –* Jeremy Stanley, VP of Data Science at Instacart, explained how they attempt at optimizing their online grocery deliveries. Customers can order groceries online and shoppers will shop from local grocery stores and deliver to the customers. To keep the customers happy, you need to deliver quickly, meaning you need shoppers to be available. However, if you have too many shoppers, they are under-used and are a cost for the company. Jeremy showed how, version after version, they get better at routing the shoppers. A very complex problem.
*Apache Kafka: The rise of real-time data and stream processing* – Neha Narkhede, cofounder and head of engineering at Confluent, gave an overview of the 3 products that are being developed and supported by Confluent: Kafka, Kafka Connect and Kafka Streams. I was already a great fan of Kafka and Kafka Streams but this talk showed me that Confluent has an extensive roadmap for Kafka Streams, and Neha described how the 3 tools can be assembled to make up the “modern ETL”.
*Parquet performance tuning: The missing guide* – Ryan Blue, an engineer on Netflix’s Big Data Platform team, went through a description of the columnar storage format Apache Parquet. He gave a highly technical talk about how to take advantage of the features of this format and how to avoid some caveats. This shows that choosing a storage format is only the first part of the developer’s job, there’s a lot of tuning to be done after that step.
*Twitter’s real-time stack: Processing billions of events with Heron and DistributedLog* – Karthik Ramasamy, tech lead for real-time analytics at Twitter, went through the challenges of setting up an analytics platform at the scale of Twitter. He described how they created a high-performance replicated log service, [DistributedLog](http://distributedlog.io/?ref=blog.ippon.tech), and how they created [Heron](http://heronstreaming.io/?ref=blog.ippon.tech), a processing engine designed to be “a better Storm”. Heron has been in production at Twitter for 2+ years now and is 4-5 times faster than Storm.
## **A torrent of technologies**
Finally, if there is something to remember from this edition, it is that the industry is very active at creating new technologies. When you think you know the “Data ecosystem” quite well, Strata shows you you’re wrong! Here is a selection of the technologies that were mentioned, some I already knew about, some I found out about during the conference:
- Processing: [Apache Spark](http://spark.apache.org/?ref=blog.ippon.tech), [Apache Apex](https://apex.apache.org/?ref=blog.ippon.tech), [Apache Beam](http://beam.incubator.apache.org/?ref=blog.ippon.tech), [Heron](http://heronstreaming.io/?ref=blog.ippon.tech)
- Data stores: [Pinot](https://github.com/linkedin/pinot?ref=blog.ippon.tech) (OLAP), [Druid](http://druid.io/?ref=blog.ippon.tech), [Apache Kudu](https://kudu.apache.org/?ref=blog.ippon.tech) (analytics)
- Pub-sub: [Kafka](http://kafka.apache.org/?ref=blog.ippon.tech), [Google Cloud Pub/Sub](https://cloud.google.com/pubsub/?ref=blog.ippon.tech)
- Threat detection: [Apache Spot](http://spot.incubator.apache.org/?ref=blog.ippon.tech)
## **How to see the presentations**
Most of the talks have been recorded and will soon be available on O’Reilly’s platform, [Safari](https://www.safaribooksonline.com/?ref=blog.ippon.tech).
Since some speakers have already given the same talks in other conferences, you might also be able to find the recordings from these events or see one of the speaker in one of your local Meetups.
Finally, note that MapR has made available [6 Free ebooks by Ted Dunning and Ellen Friedman](https://www.mapr.com/offers/6ebooks-pdf?ref=blog.ippon.tech).
## Related Articles
##### [ Student • August 12, 2020 Taking Learning Outside of the Classroom and Into the Cloud 6 min read](https://blog.ippon.tech/taking-learning-outside-of-the-classroom-and-into-the-cloud)
##### [ Culture • March 11, 2019 Ippon USA Offers a Helping Hand to Those Impacted By Natural Disaster 6 min read](https://blog.ippon.tech/ippon-usa-offers-a-helping-hand-to-those-impacted-by-natural-disaster)
##### [ Language • April 30, 2018 What is Machine Learning? 3 min read](https://blog.ippon.tech/what-is-machine-learning)
### Comments
### Subscribe to Our Blog!
Stay informed with the latest insights and updates by signing up for our weekly blog newsletter – delivered straight to your inbox!
[Back to blog homepage »](https://blog.ippon.tech/)
Ippon is a consulting and expertise firm, who is convinced that technology is a source of progress for society. We help our clients leverage their digital assets to design an appropriate strategy and deploy their transformation roadmap at scale.
#### Navigation
- [Home](https://ipponusa.com/)
- [About](https://ipponusa.com/about-us/)
- [Services](https://ipponusa.com/services/)
- [Blogs](https://blog.ippon.tech/?__hstc=223043268.1036d82247623b329dfefe4e92697801.1714729179243.1714729179243.1714729179243.1&__hssc=223043268.2.1714729179244&__hsfp=803678701)
- [eBooks](https://ipponusa.com/ebooks/)
- [The Data Pour](https://info.ippon.tech/the-data-pour?__hstc=223043268.1036d82247623b329dfefe4e92697801.1714729179243.1714729179243.1714729179243.1&__hssc=223043268.2.1714729179244&__hsfp=803678701)
[Contact Us](https://ipponusa.com/contact/)
[Join Us](https://ipponusa.com/careers/)
#### Services
- [Data & Analytics](https://ipponusa.com/service/data-analytics/)
- [Cloud Strategy](https://ipponusa.com/service/cloud-strategy/)
- [Artificial Intelligence](https://ipponusa.com/service/artificial-intelligence/)
- [Operating Model](https://ipponusa.com/service/operating-model/)
- [Platform Modernization](https://ipponusa.com/service/platform-moderization/)
- [Product Innovation](https://ipponusa.com/service/product-innovation/)
#### Ippon International
- [France](https://fr.ippon.tech/?__hstc=223043268.1036d82247623b329dfefe4e92697801.1714729179243.1714729179243.1714729179243.1&__hssc=223043268.2.1714729179244&__hsfp=803678701)
- [Australia](https://au.ippon.tech/?__hstc=223043268.1036d82247623b329dfefe4e92697801.1714729179243.1714729179243.1714729179243.1&__hssc=223043268.2.1714729179244&__hsfp=803678701)
- #### Contact
- Ippon Technologies
[3431 West Leigh Street Richmond, VA 23230, USA](https://maps.app.goo.gl/RySm6SAwZnsxeiLz9)
- [(844) 477- 6687](tel:8444776687)
- [Sales@ipponusa.com](mailto:Sales@ipponusa.com)
©Copyright 2024 Ippon USA. All Rights Reserved. | [Terms and Conditions](https://ipponusa.com/privacy-policy/) | [Privacy Policy](https://ipponusa.com/privacy-policy/) | [Website by Skol Marketing](https://skolmarketing.com/)
```json
{
"@context" : "https://schema.org",
"@type" : "BlogPosting",
"author" : {
"@type" : "Person",
"name" : "Alexis Seigneurin",
"url" : "https://blog.ippon.tech/author/alexis-seigneurin"
},
"dateModified" : "2024-01-29T17:50:05.312Z",
"datePublished" : "2016-10-06T15:47:00.000Z",
"headline" : "Strata+Hadoop World 2016 in New York",
"image" : [ "https://blog.ippon.tech/hubfs/Imported_Blog_Media/strata-hadoop-2-1-1-Jan-18-2024-06-02-16-4781-PM.jpg" ],
"mainEntityOfPage" : {
"@id" : "https://blog.ippon.tech/stratahadoop-world-2016-in-new-york",
"@type" : "WebPage"
},
"publisher" : {
"@type" : "Organization",
"logo" : {
"@type" : "ImageObject",
"url" : "https://blog.ippon.tech/hubfs/logo_SVG.svg"
},
"name" : "Ippon Technologies"
}
}
```