Trials and Tribulations of Scaling Elasticsearch at Symantec

Edlio - 12910 Culver Blvd Culver City Los Angeles
Wed, Sep 16, 2015, 7:00 PM (PDT)

About this event

Come join us at the Elastic User Los Angeles September Meeting at Edlio, Inc in Culver City. 

Shyam Odedra, one of Symantec's Sr. Software Engineering will walk through Symantec's trials and tribulations, late nights and share some insights into developing a production ready cluster, 70 plus nodes in just one datacenter!

Agenda:

7:00 - 7:30 PM: 

• Food, drinks, mingling

7:30 – 7:45 PM: 

• Upcoming meeting(s)

• Call for presenters (or venues) 

• Member Introductions 

7:45 – 8:30 PM: 

•  Shyam Odedra from Symantec

8:30 - 9:00 PM: 

• Wrap Up

Title: Our Story: Building a large scale Elasticsearch production cluster end to end.

Abstract:

The core feature of our product is the ability to index and search vast amounts of data fast! For the past 5 years we have run on an Elasticsearch like homebrew solution (nowhere near as powerful!). However, our data is growing at such a vast pace that throwing more resources and money into scaling our current solution just wasn’t paying off. It had essentially reached its end of life. With 5 datacenters globally running our software for hundreds of thousands of end users we needed a new solution. We have spent the past 8 months developing the core functionality of our product around Elasticsearch. We have now successfully deployed this to one of our datacenters. In this talk I will walk you through our trials and tribulations, late nights and share some of our insights into developing a production ready cluster (70 plus nodes in just one datacenter!).

Speaker bio:

Shyam is a Senior Software Engineer at Symantec within the enterprise ‘Information Intelligence’ group. He was involved in the early stages of development with Elasticsearch, starting off with the proof of concept that was given the green light to begin production development. Prior to Symantec Shyam worked at Google in London and various Image Processing startups in the UK. He has unsuccessfully dabbled in building his own startup but the fight continues! Outside of work Shyam WAS a keen cricket player but realizing that America hasn’t quite opened up to a game lasting 5 days he plays in various soccer leagues around LA. Shyam lives in Venice and could be found cycling around the beach until his bike was stolen…

When

Wednesday, Sep 16
7:00 PM - 10:00 PM (PDT)

Where

Edlio
12910 Culver Blvd Culver City

Organizer