What is OASB (Open Agent Security Benchmark)?

OASB is an open security benchmark for AI agents, similar to CIS Benchmarks for traditional IT systems. OASB-1 defines 46 security controls across 10 categories including identity, authorization, input security, output validation, credential protection, and more. It provides L1 (Essential), L2 (Standard), and L3 (Hardened) maturity levels.

How do I run OASB compliance checks?

You can run OASB-1 compliance checks using HackMyAgent: npx hackmyagent secure --benchmark oasb-1. Add -l L2 or -l L3 for higher maturity levels. The tool outputs compliance percentage and identifies failed controls with remediation guidance.

What are the OASB maturity levels?

OASB defines three maturity levels: L1 (Essential) covers baseline security every agent should implement. L2 (Standard) adds defense-in-depth controls for production systems. L3 (Hardened) provides maximum security for high-risk or regulated environments.

What categories does OASB cover?

OASB-1 covers 10 security categories: Identity & Provenance, Capability & Authorization, Input Security, Output Security, Credential Protection, Supply Chain Integrity, Agent-to-Agent Security, Memory & Context Integrity, Operational Security, and Monitoring & Response.

Is OASB free and open source?

Yes, OASB is completely free and open source under the Apache-2.0 license. The specification is published at oasb.ai and the compliance scanner (HackMyAgent) is available on npm. Anyone can contribute to improving the benchmark.

OASB Eval is a security product evaluation suite — like MITRE ATT&CK Evaluations but for AI agent security products. It includes 222 standardized attack scenarios across 15 MITRE ATLAS techniques to test whether runtime guards, EDRs, and security products detect real AI agent attacks including process spawning, network exfiltration, and multi-step campaigns.

How does OASB compare to CIS Benchmarks?

OASB is inspired by CIS Benchmarks but designed specifically for AI agents and agentic AI systems. While CIS covers traditional IT infrastructure, OASB addresses AI-specific threats like prompt injection, context manipulation, and capability abuse that don't exist in conventional systems.

OASB

Get Started

Attacks/Context Manipulation/CM-001

INFO

CM-001 Memory Probe

Context Manipulation — Attempts to poison agent context or memory

Description

Probes for persistent memory capabilities

Remediation

Document memory capabilities. Implement user control over memory.

Severity

INFO

OASB Control

8.1

PreviousCA-010 Indirect Code Execution NextCM-002 Context Window Size Probe