Elastic Meetup - Every Shard Deserves a Home

Tel Aviv

Jan 13, 2016, 4:00 – 7:00 PM

RSVPs

About this event

Hosting Boaz Leskes, Christoph Wurm and Lee Wright from Elastic.co team. 

18:00-18:20 - Gathering and mingling and welcome words

18:20-18:40 - What's new in Elastic 2.0 by Christoph Wurm, Elastic Engineer

18:40-19:40 - Every Shard Deserves a Home - Shard Allocation in Elasticsearch, by Boaz Leskes

This talk is about the journey of a shard in Elasticsearch. It will cover the mechanics and the reasons for how ES  decides to allocate shards to nodes and how those decisions are executed.

We will start with the assignment of new shards, conforming to the current Allocation Filtering, disk space usage and other factors. Once shards are started, they may be needed to be moved around. This can be due to a cluster topology change, data volumes or when someone instructed ES to so through the index management APIs. 

We will cover these triggers and how ES executes on those decisions, moving potentially tens of gigabytes of data from one node to another, without dropping any search or an indexing request. We will finalize with the mechanics of full/rolling cluster restarts and the recent improvements such as synced flush, delayed assignment on node leave and cancelling ongoing relocations if a perfect match is found.

As always there will be ample room for Q&A about practically anything.

When

When

Wednesday, January 13, 2016
4:00 PM – 7:00 PM UTC

Organizers

  • Arthur Gimpel

    Co-organizer

  • Uri Cohen

    Co-organizer

  • Roy Zanbel

    Co-organizer

Contact Us