Secure-AI
SECURITY - AI WAF (Web Application Firewall)
DERIV
LLMs have recently adopted persistent memory to provide models with better user knowledge and personalisation. However, this introduces a new vector for adversarial manipulation. This report investigates Memory Injection, a threat model where adversaries exploit indirect prompt injection within web content to poison an agent's long-term memory. Employing user manipulation scenarios, we show that memory attacks, should they succeed, are effective at changing model behaviour towards the user, often more so than a direct system prompt. Hence, this highlights the need for more robust evaluations of memory updates in agentic memory systems.
Category tags:Explore more applications
Upcoming AI Hackathons
For Innovators & Creators
For Innovators & Creators
Explore more applications