Go Big or Go Bigger... Scaling & Maintaining HA ES Clusters

Thomson Reuters - 610 Opperman Dr. Eagan Minneapolis
Tue, Nov 15, 2016, 6:00 PM (CST)

About this event

We're past the prototypes... We've launched... Users are using. Lots of users. Oodles of users, who keep arriving in throngs for the promise of real-enough-time, ES-powered search and insights. Once they get a bite of the goodness, they just want more. They demand it noisily, as if speedy information has become a birth right. The organization is now better, faster, stronger. Take ES away for a few seconds, and there's rioting.

In this meetup, we'll focus on more "mature" ES production clusters that are seeing large amounts of use and/or are processing large amounts of data with quality of service expectations that are "higher than normal" (the definition of HA). A bullet list of discussion points is below.

More Meetup Description:

Enjoy the momentary glory: we've become mission critical! Systems are hooked into our ES end points. We're part of high level status reports. Business executives click and browse our systems while they sip tea and munch crumpets. All seems good, but we know there's more to the story.

If our cluster were an old timey wooden ship, we'd hear the creaking of wood as waves and torsion stress the hull. The sails would be taut and bulging in the wind, stretched to nearly ripping. Dribbles of water would leak into the cargo hold below as planks bend. The ship has made many stops; it's overloaded with treasures. And, we're just about to glide between Scylla and Charybdys -- on the course to home and fame. A grizzled, leathery old sea hand calls out, "Captain, we're sow bellied and taking on water -- we won't make it!"

Changing Metaphors: 

In response to overwhelming load and expectations, we have turned up the ES cluster volume knob to "11" and now the bass is clipping and the high end is raked. So we add power amps, woofers, and tweeters. Lots of them, like stacking lego blocks. The sound becomes crisp and authoritative. Everyone is dancing. Then, bus loads of new folks arrive and the sound needs to reach further. So we freely add more gear, more people, more power: And the party is epic.

Long meetup descriptions aside, we invite you to join us for a discussion of:

• High Availability ES Architecture
• Considerations for Growth and Maintenance 
• Issues that Impact High Scale Performance 
• Dynamic Provisioning Concepts
• Key Metrics to Monitor
• When/How to Get Help

See you there!

When

Tuesday, Nov 15
6:00 PM - 8:00 PM (CST)

Where

Thomson Reuters
610 Opperman Dr. Eagan