Implement a search API to allow typeahead search on files (pdfs, ppts, excel, txt, word etc.)

- Index and shard design for file data

- Design file indexing pipeline

- Using ingest node with ES attachment processor to crack documents and load them in Elasticsearch

- Handling files that contains sensitive information and hence cannot be stored in ES as plain text.

Speakers:

Praveen Chandrasekaran: Data Engineer @ Egen - Praveen is currently working as a Data Engineer at Egen. Worked on projects involving in development of Universal Search Feature using Elasticsearch, Event-driven analytics and aggregation pipeline, MLOps Pipeline and data migrations.

Vatsal Parekh: Software Engineer @ Egen - Vatsal currently working as a Software Engineer at Egen. Worked on projects involving the development of Universal Search Feature using Elasticsearch, Event-driven analytics and aggregation pipeline using microservice architecture and Kafka, and Restful Apis