AI SECURITY • 345 / 397
Understand how untrusted text, tools and autonomy create new attack paths.
Tool Abuse
Tool abuse occurs when an AI capability is used in an unintended, excessive or harmful way.
Think of it like
Think of Tool Abuse as an input-trust or privilege problem: words can influence software decisions, so boundaries must be explicit.
Real life
Email, documents and web pages can become hostile inputs to AI systems through attacks involving Tool Abuse.
SRE lens
A ticket tool could be abused to spam thousands of issues.
Remember thisTool abuse occurs when an AI capability is used in an unintended, excessive or harmful way.