• 18:00 Doors open, Snack and Drinks
• 18:15 Visit to machine room and presentation of CSCS
• 19:00 CSCS Logging and Metrics collector presentation
• 19:30 Metrics and Logs collection
• 20:00 Networking Snacks, Drinks, Beer
This meetup will be hosted by the Swiss National Supercomputing Centre (CSCS) at Via Trevano 131, 6900 Lugano.
## CSCS Logging and Metrics collector presentation by
As the complexity of systems increases and the scale of these systems increases, the amount of system level data recorded increases. Therefore, managing the vast amounts of logs and metrics data is a challenge that CSCS solved with the introduction of a centralized log and metrics infrastructure based on Elasticsearch, Graylog, Kibana, and Grafana. This is a fundamental service at CSCS that provides easy correlation of events bridging the gap from the computation workload to nodes enabling failure diagnosis. Currently, the Elasticsearch cluster at CSCS is handling more than 25 billions of online documents (in one year) and another 50 billions has been archived. The integrated environment from logging and metrics to graphical representation enables powerful dashboards and monitoring displays.
## Metrics and Logs collection by Nicolas Ruflin
How to collect logs and metrics with Filebeat and Metricbeat, store them in Elasticsearch and visualise it in Kibana. This is a walk through the tools with a live demo, including Docker / Kubernetes. Bring your questions so the demo can be adjusted in real time :-)