Cohere and Qdrant Multilingual Semantic Search Hackathon

Team formation and Hack Commences

This is an awesome guide for beginners by Kacper Lukawski

Introduction to Vector Databases - by Qdrant 

Introduction, Lablab.ai mission and vision, Paweł Czech and Mathias Asberg

Kick-Off Stream

Intodiction Talk from Hackathon tech partners about possibilities and challenges you will have during this event

Cohere x Qdrant opening

You will discover lablab.ai platform, also Hackathon challenge, tech and prizes

Hackatho guide

Intro to Semantic Search part 1

Intro to Semantic Search part 2

Tips & Tricks for using Qdrant

Qdrant x Cohere: Powering Semantic Search

It's the last moment you can submit your solution for the Hackathon

Submission Deadline

UnderDawgs

saran_sundar

sudharshan106

The dataset we used is Arxiv’s Open access dataset and we used 15000 records from it which contains ML and AI-oriented papers.
We utilized Abstract to create embeddings for each paper. Cohere’s small model was used for creating embeddings which produced 1024 embeddings for each records.

Then the 15000 X 1024 Vectors are uploaded to the created collections in qdrant. Finally, the embeddings are generated for the abstract of chosen articles or the given prompt, and the Qdrant searches for similar texts in the collection and outputs the indices of it.  The distance metric used to measure the similar vectors is Cosine distance.

Besides the recommendation for articles we provided features such as research paper summarization and Translating contents of given paragraphs from English to 8 different languages such as  Tamil, Nepali, Indonesia, Thai, Spanish, Russian , Turkish, and French. The model we used for Language Translation is MBART Large-50-one-to-many  for multilingual machine translation.

The Text  Summarization part is done using cohere’s API

helping academic students get access to relevant research paper with additional features.

"UnderDawgs team on Cohere and Qdrant Multilingual Semantic Search Hackathon Hackathon"

Team Idea

Submission