Edge Runners 3.2

Start

A mix of culture, respect and innovative ideas

Future Sun

SajidHameed

ShauryaS31

Tajmirkhan515

kasayhi

We propose using the LLaMA 3.1:1B model as a local proxy server to manage caches with JSON responses. Here's how the llama model can help us do just that:
Query analysis and optimization
Smart data management in the cache
Optimization of communication with API
Create intelligent cache management policies.
Enrich responses and adding a layer of security and privacy to the application.
Understand user behavior and tailor data to their needs.

We can also approach the problem using the cloud model, when we do not have enough RAM to be able to run llama 3.1:1B. We can then send queries from time to time to the server, which would decide on the cache hierarchy, which would be the most important, and which items would already have a deletion time.



This project uses Redis to store web requests and responses, and employs the LLaMA model to set the TTL for infrequent requests.

"Future Sun team on Edge Runners 3.2 Hackathon"

Team Idea

Submission