加载中...
Memory & Context Attacks
Memory poisoning, RAG exploitation, and context manipulation techniques
可用技术
Agent Memory Poisoning
(AMP)Injection of malicious or manipulative information into an agent's long-term memory systems, corrupting its knowledge base and influencing future behaviors.
要点
- •Long-term memory corruption
- •Knowledge base manipulation
- •Persistent behavior modification
Primary Defenses
- •Memory validation and sanitization
- •Source verification for stored information
- •Memory access controls
Key Risks
Context Window Manipulation
(CWM)Exploitation of context window limitations to hide malicious instructions, overflow context buffers, or manipulate conversation history to bypass security controls.
要点
- •Context overflow attacks
- •History manipulation
- •Hidden instruction injection
Primary Defenses
- •Context window management
- •Priority-based context retention
- •System instruction protection
Key Risks
RAG System Poisoning
(RAGP)Injection of malicious documents or data into Retrieval-Augmented Generation (RAG) knowledge bases to poison retrieved context and manipulate agent responses.
要点
- •Knowledge base document poisoning
- •Retrieval result manipulation
- •Vector embedding corruption
Primary Defenses
- •Document validation and sanitization
- •Source authentication
- •Retrieval result verification
Key Risks
Agent Session Hijacking
(ASH)Unauthorized takeover of an ongoing agent conversation or session, gaining access to conversation history, context, and the ability to inject malicious instructions.
要点
- •Session token exploitation
- •Context injection mid-conversation
- •History access and manipulation
Primary Defenses
- •Strong session management
- •Token encryption and rotation
- •Session validation on each request
Key Risks
Direct Memory Injection
(DMI)Direct injection of malicious content into an agent's memory storage systems, bypassing normal conversation flows to insert false memories or corrupted knowledge.
要点
- •Direct storage manipulation
- •Memory API exploitation
- •Conversation bypass
Primary Defenses
- •Strict API authentication
- •Memory write access controls
- •Input validation on storage operations
Key Risks
Context Contamination Attack
(CCA)Gradual contamination of conversation context through subtle injections across multiple interactions, slowly corrupting the agent's understanding and behavior.
要点
- •Gradual contamination
- •Multi-turn corruption
- •Subtle manipulation
Primary Defenses
- •Continuous context validation
- •Contamination detection algorithms
- •Periodic context sanitization
Key Risks
Episodic Memory Replay Attack
(EMRA)Manipulation of episodic memory replay mechanisms to reinforce malicious patterns, false information, or harmful behaviors through repeated memory activation.
要点
- •Memory replay manipulation
- •Pattern reinforcement exploitation
- •Memory consolidation abuse
Primary Defenses
- •Replay validation
- •Consolidation security controls
- •Recall frequency limits
Key Risks
Semantic Memory Corruption
(SMC)Corruption of an agent's semantic memory - general knowledge and facts - through injection of false information that becomes part of the agent's core understanding.
要点
- •Factual knowledge corruption
- •Concept relationship manipulation
- •General knowledge poisoning
Primary Defenses
- •Fact verification systems
- •Knowledge source tracking
- •Semantic consistency checks
Key Risks
Memory Persistence Exploitation
(MPE)Exploitation of memory persistence mechanisms to ensure malicious content remains in agent memory across resets, updates, or cleanup operations.
要点
- •Cleanup bypass
- •Reset resistance
- •Update persistence
Primary Defenses
- •Comprehensive memory cleanup
- •Complete reset procedures
- •Persistence validation
Key Risks
Cross-Session Memory Leakage
(CSML)Exploitation of memory isolation vulnerabilities to access or leak information from other users' sessions or conversations through shared memory systems.
要点
- •Session boundary bypass
- •Memory isolation exploitation
- •Cross-user data access
Primary Defenses
- •Strong memory isolation
- •Session-specific memory spaces
- •Access control enforcement
Key Risks
Learning Process Exploitation
(LPE)Attacking agent learning processes by introducing biased, incomplete, or malicious data during incremental updates, online learning, or feedback loops, causing the agent to learn harmful behaviors or incorrect patterns.
要点
- •Biased training data injection
- •Incremental learning manipulation
- •Feedback loop exploitation
Primary Defenses
- •Learning input validation and sanitization
- •Anomaly detection for learning updates
- •Learning rate limits and boundaries
Key Risks
Knowledge Update Mechanism Vulnerability
(KUMV)Exploiting vulnerabilities in the agent's knowledge update mechanisms by injecting unauthorized updates, bypassing authentication and integrity checks, or manipulating version control systems to introduce malicious knowledge.
要点
- •Unauthorized update injection
- •Authentication bypass
- •Version control manipulation
Primary Defenses
- •Strong update authentication
- •Cryptographic integrity checks
- •Version control with audit trails
Key Risks
Cross-Agent Knowledge Poisoning
(CAKP)Attacking shared knowledge bases used by multiple agents to create systemic poisoning, where corrupted knowledge propagates across interconnected agents, causing cascading errors and compromised decision-making throughout the agent network.
要点
- •Shared knowledge base poisoning
- •Cross-agent propagation
- •Systemic knowledge corruption
Primary Defenses
- •Shared knowledge validation
- •Cross-referencing between agents
- •Knowledge source verification
Key Risks
Ethical Guidelines for Memory & Context Attacks
When working with memory & context attacks techniques, always follow these ethical guidelines:
- • Only test on systems you own or have explicit written permission to test
- • Focus on building better defenses, not conducting attacks
- • Follow responsible disclosure practices for any vulnerabilities found
- • Document and report findings to improve security for everyone
- • Consider the potential impact on users and society
- • Ensure compliance with all applicable laws and regulations
由本目录背后的工程师执行
让你的智能体系统接受红队测试
这里记录的攻击每天都在真实的生产智能体系统上得手。在别人动手之前先测试你的系统:提示注入、越狱、工具滥用和数据外泄,每项发现都附书面修复方案。
€750(原价 €1,500),一周交付,书面报告加讲解通话,9月30日前