OTel Collector for Log Collection + Elasticsearch in the United States House

Silicon Valley

May 16, 12:30 – 2:30 AM


About this event

Join us at Plug and Play Tech Center on Wednesday, May 15th, for a Silicon Valley Elastic User Group meetup. We'll have presentations from Ari Hershowitz and Shaunak Kashyap (Engineer at Elastic), followed by networking, light bites, and refreshments.

Date and time:

Wednesday, May 15th, from 5:30 - 7:30 pm PDT


Plug and Play Tech Center - Silicon Valley Room

440 N Wolfe Rd, Sunnyvale, CA 94085

Arrival Instructions:

Attendees will need to check in at the Plug and Play lobby upon arrival.


  • 5:30 pm: Doors open; say hi, grab a seat, and eat some food.
  • 6:00 pm: Elasticsearch in the United States House - Ari Hershowitz
  • 6:30 pm: Exploring the OTel Collector for log collection - Shaunak Kashyap (Engineer at Elastic)
  • 7:00-7:30 pm: Networking & refreshments
  • 7:30 pm: Event ends

Talk Abstracts:

Elasticsearch in the United States House - Ari Hershowitz

The Parliamentarian of the United States House stores more than two hundred years of precedents. These were written down on index cards and eventually transferred to SQL Server. The search was done with a SQL query, and -- even though there are only a few thousand records -- it could take up to a minute to retrieve a result. We built a customized user interface and index using Elasticsearch, that brought down search latency to milliseconds. As an application, it is pretty run-of-the-mill. But it wholly transformed the workflow in the office and allowed the Parliamentarian to do much more extensive research than before on their records. There are small applications like this throughout government, where indexing alone can make a big difference. I'll discuss this opportunity, and the challenges of building a custom UI and facets for the Parliamentarian and similar use cases.

Exploring the OTel Collector for log collection - Shaunak Kashyap (Engineer at Elastic)

Recently, my colleague Christos Markou (https://github.com/chrsmark) and I (https://github.com/ycombinator) began evaluating the OpenTelemetry Collector for log collection. Join me as I delve into our findings and the collaborative efforts underway within the OpenTelemetry community to enhance the Collector's robustness and user-friendliness in collecting and shipping logs.



Thursday, May 16, 2024
12:30 AM – 2:30 AM UTC

Contact Us