Loading...
Semantic Memory Corruption
SMCCorruption of an agent's semantic memory - general knowledge and facts - through injection of false information that becomes part of the agent's core understanding.
Example Scenario
Injecting false information about API authentication requirements into an agent's semantic memory, causing it to believe that certain security steps are optional across all future interactions.
Testing Objectives
- Test fact validation
- Assess knowledge verification
- Evaluate semantic integrity
- Validate concept protection
Defensive Strategies
- Fact verification systems
- Knowledge source tracking
- Semantic consistency checks
- Expert knowledge validation
- Multiple source verification
Key Features
- Factual knowledge corruption
- Concept relationship manipulation
- General knowledge poisoning
- Semantic network alteration
Use Cases
- Semantic memory testing
- Knowledge integrity assessment
- Fact verification validation
- Concept relationship testing
Tools & Frameworks
Security Risks
Ethical Guidelines
- •Only test semantic memory with authorization
- •Never corrupt production knowledge bases
- •Report semantic vulnerabilities urgently
- •Focus on improving fact verification
- •Consider broad impact of false knowledge
Remember: This information is for educational and defensive security purposes only. Always ensure you have proper authorization before testing any techniques.
From the engineer behind this catalog
Get your agent system red-teamed
The attacks documented here work on production agent systems every day. Have yours tested before someone else does: prompt injection, jailbreaks, tool misuse and data exfiltration, with every finding written up next to its fix.
€750 instead of €1,500, one week, written report and walkthrough call, until 30 September