Metrics and Logs - Elastic{Meetup} #40 - Lugano

CSCS Swiss National Supercomputing Centre - Via Trevano 131 Lugano Switzerland
Wed, Jan 30, 2019, 6:00 PM (CET)

About this event

# Schedule

• 18:00 Doors open, Snack and Drinks
• 18:15 Visit to machine room and presentation of CSCS
• 19:00 CSCS Logging and Metrics collector presentation
• 19:30 Metrics and Logs collection
• 20:00 Networking Snacks, Drinks, Beer

# Location

This meetup will be hosted by the Swiss National Supercomputing Centre (CSCS) at Via Trevano 131, 6900 Lugano.

# Talks

## CSCS Logging and Metrics collector presentation by
Conciatore Dino

As the complexity of systems increases and the scale of these systems increases, the amount of system level data recorded increases. Therefore, managing the vast amounts of logs and metrics data is a challenge that CSCS solved with the introduction of a centralized log and metrics infrastructure based on Elasticsearch, Graylog, Kibana, and Grafana. This is a fundamental service at CSCS that provides easy correlation of events bridging the gap from the computation workload to nodes enabling failure diagnosis. Currently, the Elasticsearch cluster at CSCS is handling more than 25 billions of online documents (in one year) and another 50 billions has been archived. The integrated environment from logging and metrics to graphical representation enables powerful dashboards and monitoring displays.

## Metrics and Logs collection by Nicolas Ruflin

How to collect logs and metrics with Filebeat and Metricbeat, store them in Elasticsearch and visualise it in Kibana. This is a walk through the tools with a live demo, including Docker / Kubernetes. Bring your questions so the demo can be adjusted in real time :-)

When

Wednesday, Jan 30
6:00 PM - 9:00 PM (CET)

Where

CSCS Swiss National Supercomputing Centre
Via Trevano 131 Lugano

Organizers

  • Nicolas Ruflin

    Nicolas Ruflin

    Principal Software Engineer I

    View Profile
  • Francois Protopapa

    Francois Protopapa

    Senior Solutions Architect

    View Profile
  • Valentin Crettaz

    Valentin Crettaz

    Consulthys

    Principal Consultant

    View Profile