CyberGuardian autonomously collects and delivers the latest information from diverse news sources. We use the Trulens for evaluating and tracking our model responses. It provides programmatic methods for generating different metrics(answer relevance, groundedness, context relevance) on an application run. We have built a scheduler that runs on specific intervals. It fetches real-time news, articles, and blogs regarding to cyber security domain. We store this real-time data in the Mongo DB as vectors. When the user hits a query, our app fetches relevant vectors related to questions and passes them to the LLM model. Then trulens run after that and provides different metrics including costing, no token use with his request, answer relevance, groundedness, and context relevance.
Category tags:"great work. "
Walaa Nasr Elghitany
Lablab Head Judge
"You guys nailed it! But i would like to see a bit more original features"
Theodoros Ampas
Technical Mentor
"The trulens implementation seems excellent, but i think it could have been a more creative implementation"
Shebagi Mitra
Technical Mentor