Hackathon Challange
In this hackathon, you will build and iterate on an LLM-based application using AI observability to validate the performance of your app.
You can choose between two sets of tools for building your app:
- Tool set 1: The OpenAI Assistants API
- Tool set 2: Llama-Index, MongoDB and GPT-4.
With either choice, you will use TruLens to validate and improve the performance of your application. By bringing together TruEra, OpenAI, Llama-Index, and MongoDB you have the bleeding edge tools at your disposal for building AI applications.
Your challenge is to build a high performing application leveraging either set of tools and validate its performance on key tasks using TruLens. This requires creating a TruLens evaluation suite on the key axis of your app’s performance. If the evaluation identifies failure modes on the app’s critical path, use TruLens to debug and improve the app.
.png&w=3840&q=75)
.png&w=3840&q=75)
.png&w=3840&q=75)