Using Elasticsearch for Multimodal Search

Wed, Mar 10, 2021, 4:00 PM (EST)

8 RSVP'ed

About this event

Multimodal search, where images and text are combined to form a powerful search, is a rapidly emerging trend.

Retail segments, such as fashion and home design, are one particular driver of multimodal search because they rely heavily on visual search since style is often difficult to describe using text.

However, in addition to visual search, text search is still a required part of the solution because product information, such as item description, item title, category, and brand are generally used to filter the results that are returned as part of the visual search. Thus what is needed is a solution that allows for multimodal search.

In this presentation you will learn about an Elasticsearch plugin that:

· Integrates seamlessly with native Elasticsearch text search to provide multimodal search

· Uses the native Elasticsearch dense_vector field to perform approximate nearest neighbor vector similarity search

· Requires no reindexing of documents to support vector search

· Scales to billion-scale vector similarity search


  • Lindsay Hill

    Lindsay Hill

    Community Organizer

  • Dan Morgan

    Dan Morgan

    Community Organizer

    View Profile
  • Richard Juknavorian

    Richard Juknavorian

    IT Squared

    Community Organizer

    View Profile
  • Theron Roe

    Theron Roe

    Community Organizer

    View Profile