Next Hackathon
Band of Agents Hackathon
Starts Jun 12, 2026
In late 2023, Vectara introduced the Hughes Hallucination Evaluation Model (HHEM). It's a tool that helps measure how much a language model (LLM) generates text that doesn't make sense or strays from the original content. We looked at various models, both open source like Llama 2 or Mistral 7B, and commercial ones like OpenAI’s GPT-4, Anthropic Claude, or Google’s Gemini. The model showed that there are big differences between these models in how likely they are to produce text that doesn't make sense
Source: https://www.nytimes.com/2023/11/06/technology/chatbots-hallucination-rates.html
We want you to enhance the use of HHEM in our RAG application, ensuring maximum benefits for GenAI. Your participation is genuinely appreciated. Let's work together to boost GenAI applications. Your innovative touch is what we're looking for—apply now!
Top performers will be rewarded with Vectara credits for the best uses of HHEM:
Seize the opportunity to win these valuable credits!
The Hughes Hallucination Evaluation Model (HHEM) Leaderboard assesses how frequently Large Language Models (LLMs) like GPT-4, Google Gemini, or Meta’s Llama 2 generate hallucinations in document summaries. Vectara has open-sourced HHEM to democratize LLM hallucination evaluation, shedding light on performance differences. Initially a Huggingface model with a Github repository, HHEM Leaderboard now accommodates the evaluation of new models. The LLM community is encouraged to submit models for assessment.
This Hackathon is for you if
You are AI enthusiast and developer
You have an startup idea you want to test
You want to build great LLM
The community can judge!
The community judges will review hackathon projects and vote for the best use case, carefully following the rules. For the micro hackathons, the community feedback decides the winner! 🏆
Slingshot 🚀 Slingshot Incubator accelerates AI prototypes into MVPs. To qualify, have a functional AI prototype, a basic business plan, and a team of 2-5. Get mentorship, partner credits, and legal support.
👉 Apply through the Slingshot Application link.
GAIA 🌱 GAIA Accelerator fuels generative AI startups. To qualify, have an AI MVP, be between MVP and seed stage, and relocate to Riyadh, KSA. Receive a $100K investment, expert mentorships, and access to investors.
👉 Apply through the GAIA Application Link and unlock your project's potential!
Submissions from the teams participating in the Unhallucinate Challenge: 24 Hours Fight event and making it to the end 👊
Check out the roster and find teams to join
Next Hackathon
Band of Agents Hackathon
Starts Jun 12, 2026
.png&w=3840&q=75)
.png&w=3840&q=75)
.png&w=3840&q=75)
.png&w=3840&q=75)