Join us for our upcoming meetup on Tuesday, May 22 at the Iterable office.

The agenda for the evening is:

6:00pm: Doors open, food & beverages will be provided
6:30pm: Talk 1 starts: How to use Reindex APIs by Tal Levy
7:00pm: Talk 2 starts: Migrating Data with the Elasticsearch Reindex API by Jie Ren and Thomas Kim
8:30pm: We'll wrap things up

How to use Reindex APIs
This talk surveys the various instances the reindex apis can be used
and how to use them. It will show how to leverage scripting and Ingest Node to help transform documents in the events of mapping changes, re-location of data between clusters, and upgrades. Reindexing is not free; it can take a lot of resources (time, cpu) and potentially fail. We will cover all the tuning available to overcome the realities of real world deployments.

Tal Levy is an Elasticsearch developer (formally on the Logstash team) based in Mountain View, CA. Tal joined Elastic from Quixey where he worked on data systems built with Kafka and Hadoop. When he is not click-clacking on keyboards, you can find him cycling and climbing.

Migrating Data with the Elasticsearch Reindex API
Database migrations are complex operations which require careful planning. Sometimes DB engine upgrades also introduce backward incompatible changes, which adds to the inherent challenges of migrating data to begin with. In this talk we explain our approach to migrating 40TB of data in Elasticsearch 1.4 to 5.6, in the face of demanding business requirements around availability and show the observed changes in throughput and footprint after the migration.

Thomas Kim is an engineer at Iterable. He has been living and working in San Francisco since 2001. He was formerly a tech lead on Workday Search. Prior to that, he was the CTO of a small BI startup and an early engineer at Salesforce. He loves dogs, snowboarding, and statically typed functional programming. Being a bandwagon Warriors fan makes his wife laugh.

Jie Ren dreamt of being in the WNBA as a child, but is a now a software engineer at Iterable. She joined Iterable from Workday where she worked on Recruiting Search and ETL, heavily leveraging Elasticsearch. Prior to that, she used Java to build a web charting library, because she wanted to get instant visual gratification from writing type-safe code. She is currently dabbling in motorcycles.