LLM Security
5 articles on LLM Security.
-
Secure by Design
AI-Generated Code Security Risks From an AI-Assisted Rebuild
Over six weeks I rebuilt a 30-year-old poetry site with an AI coding partner and logged every security issue it produced: 59 of them, from a one-line config change that took the whole site down to a 90-minute triple credential leak. Two became actual incidents; a control caught all 59. Here is the pattern behind them, Self-Attested Safety, and the controls that caught every one.
-
LLM Security
Your AI Safety Tool Evaluates Text, Not What Users See -- Here's Why It Matters
Every major AI assistant endorsed a webpage as safe while it displayed a reverse shell command to the human reader. No bug. No jailbreak. A custom font and standard CSS were enough. The flaw is an architectural blind spot -- a rendering-layer trust boundary no AI safety framework has ever specified -- and it changes the threat model for every product team building AI-assisted content evaluation.
-
LLM Security
From Titanic to AI: Ten Human Disasters That Predict How Your Agent Will Fail
AI agents don't invent new ways to fail -- they inherit ours. Peer-reviewed research confirms they amplify human cognitive biases and create feedback loops with no natural circuit breaker. This analysis maps ten catastrophic human failures to the biases that caused them, then projects how an AI agent would have made each one worse.
-
ProductSecurity
What GRP-Obliteration Tells You About Your AI System's Threat Model
Microsoft researchers reversed LLM safety alignment across 15 models using a single adversarial training prompt. The attack exploits a fundamental design flaw: safety implemented as learned behavior can be inverted through training-based attacks. For product security teams deploying AI systems, the lesson is architectural - security properties must be enforced through system design, not statistical tendencies.
-
Secure by Design
When AI Agents Become Attack Surfaces: The Claude Desktop Extensions Remote Code Execution Vulnerability and Autonomous Tool Chaining Without Trust Boundaries
Remote code execution via Claude Desktop Extensions through calendar event injection. AI agents chaining tools without trust boundaries exposes everything.
