Extending RAPTOR

RAPTOR’s unified launcher architecture makes it easy to add new security scanning engines, create custom agents, and extend functionality without changing the core workflow.

Architecture Overview

RAPTOR uses a modular architecture with a unified entry point:

raptor.py (Unified Launcher)
    ↓
    ├── Mode Handlers (mode_scan, mode_fuzz, etc.)
    ↓
    ├── Package Scripts (packages/*/agent.py)
    ↓
    └── Core Utilities (core/config, core/logging, etc.)

Benefits

Single Entry Point

Users only need python3 raptor.py <mode>

Consistent Interface

All modes follow the same pattern

Easy Discovery

All modes shown in --help

Simple Extension

Add engines without changing user workflow

Adding a New Scanner

Follow these steps to add a custom security scanner:

Step 1: Create Package Structure

Create a new package in packages/ with your scanner implementation:

mkdir -p packages/my-scanner
touch packages/my-scanner/__init__.py
touch packages/my-scanner/agent.py
touch packages/my-scanner/scanner.py

packages/my-scanner/
├── __init__.py
├── agent.py          # Main entry point with CLI
└── scanner.py        # Core scanning logic (optional)

Step 2: Implement CLI Interface

Create agent.py with a standard argparse CLI:

#!/usr/bin/env python3
"""
My Scanner - Custom security scanner
"""

import argparse
import sys
from pathlib import Path

# Add to path for core imports
sys.path.insert(0, str(Path(__file__).parent.parent.parent))

from core.config import RaptorConfig
from core.logging import get_logger

logger = get_logger()


def main():
    parser = argparse.ArgumentParser(
        description="My Scanner - Custom security scanner"
    )
    parser.add_argument("--target", required=True, help="Target to scan")
    parser.add_argument("--out", help="Output directory")
    
    args = parser.parse_args()
    
    # Your scanning logic here
    logger.info(f"Scanning {args.target}...")
    
    # Return 0 on success
    return 0


if __name__ == "__main__":
    sys.exit(main())

Follow existing scanners in packages/ for more examples.

Step 3: Add Mode Handler

Open raptor.py and add a new mode handler function:

def mode_my_scanner(args: list) -> int:
    """Run my custom scanner."""
    script_root = Path(__file__).parent
    scanner_script = script_root / "packages/my-scanner/agent.py"
    
    if not scanner_script.exists():
        print(f"✗ Scanner not found: {scanner_script}")
        return 1
    
    print("\n[*] Running my custom scanner...\n")
    return run_script(scanner_script, args)

Step 4: Register Your Mode

In the main() function of raptor.py, add your mode to mode_handlers:

def main():
    # ... existing code ...
    
    # Route to appropriate mode
    mode_handlers = {
        'scan': mode_scan,
        'fuzz': mode_fuzz,
        'web': mode_web,
        'agentic': mode_agentic,
        'codeql': mode_codeql,
        'analyze': mode_llm_analysis,
        'myscan': mode_my_scanner,  # Add your new mode
    }
    
    # ... rest of function ...

Step 5: Update Help Text

Update the help epilog in main() to include your new mode:

epilog="""
Available Modes:
  scan        - Static code analysis with Semgrep
  fuzz        - Binary fuzzing with AFL++
  web         - Web application security testing
  agentic     - Full autonomous workflow
  codeql      - CodeQL-only analysis
  analyze     - LLM-powered vulnerability analysis
  myscan      - My custom security scanner

Examples:
  # My custom scanner
  python3 raptor.py myscan --target /path/to/target
"""

Step 6: Test Integration

# Test help
python3 raptor.py myscan --help

# Test execution
python3 raptor.py myscan --target /path/to/target

# Test mode-specific help
python3 raptor.py help myscan

Complete Example: Dependency Scanner

Here’s a full example of adding a dependency vulnerability scanner:

Create packages/dependency-scan/agent.py

#!/usr/bin/env python3
"""
Dependency Scanner - Check for vulnerable dependencies
"""

import argparse
import json
import sys
from pathlib import Path

sys.path.insert(0, str(Path(__file__).parent.parent.parent))

from core.config import RaptorConfig
from core.logging import get_logger

logger = get_logger()


def scan_dependencies(repo_path: Path) -> dict:
    """Scan for dependency vulnerabilities."""
    logger.info(f"Scanning dependencies in {repo_path}")
    
    findings = []
    
    # Check requirements.txt
    req_file = repo_path / "requirements.txt"
    if req_file.exists():
        logger.info(f"Found {req_file}")
        # Parse and check dependencies
        with open(req_file, 'r') as f:
            for line in f:
                pkg = line.strip()
                if pkg and not pkg.startswith('#'):
                    # Check vulnerability databases
                    # (Implementation details omitted)
                    pass
    
    # Check package.json
    pkg_file = repo_path / "package.json"
    if pkg_file.exists():
        logger.info(f"Found {pkg_file}")
        # Parse and check npm dependencies
        with open(pkg_file, 'r') as f:
            data = json.load(f)
            deps = data.get('dependencies', {})
            # Check each dependency
    
    return {
        "total_dependencies": 10,
        "vulnerable_dependencies": 2,
        "findings": findings
    }


def main():
    parser = argparse.ArgumentParser(
        description="Dependency Scanner - Check for vulnerable dependencies"
    )
    parser.add_argument("--repo", required=True, help="Repository path")
    parser.add_argument("--out", help="Output directory")
    
    args = parser.parse_args()
    
    repo_path = Path(args.repo)
    if not repo_path.exists():
        print(f"✗ Repository not found: {repo_path}")
        return 1
    
    # Run scan
    results = scan_dependencies(repo_path)
    
    # Save results
    out_dir = Path(args.out) if args.out else RaptorConfig.get_out_dir() / "dependency-scan"
    out_dir.mkdir(parents=True, exist_ok=True)
    
    output_file = out_dir / "dependency_report.json"
    with open(output_file, 'w') as f:
        json.dump(results, f, indent=2)
    
    print(f"\n✓ Scan complete")
    print(f"  Total dependencies: {results['total_dependencies']}")
    print(f"  Vulnerable: {results['vulnerable_dependencies']}")
    print(f"  Report: {output_file}")
    
    return 0


if __name__ == "__main__":
    sys.exit(main())

Add to raptor.py

def mode_depscan(args: list) -> int:
    """Run dependency vulnerability scanner."""
    script_root = Path(__file__).parent
    scanner_script = script_root / "packages/dependency-scan/agent.py"
    
    if not scanner_script.exists():
        print(f"✗ Dependency scanner not found: {scanner_script}")
        return 1
    
    print("\n[*] Scanning for vulnerable dependencies...\n")
    return run_script(scanner_script, args)

# Add to mode_handlers
mode_handlers = {
    # ... existing modes ...
    'depscan': mode_depscan,
}

Usage

# Run dependency scan
python3 raptor.py depscan --repo /path/to/code

# Get help
python3 raptor.py help depscan

Creating Custom Agents

RAPTOR supports specialized agents for complex workflows:

Agent Structure

#!/usr/bin/env python3
"""
Custom Agent - Specialized security analysis
"""

import sys
from pathlib import Path

sys.path.insert(0, str(Path(__file__).parent.parent))

from core.config import RaptorConfig
from core.logging import get_logger

logger = get_logger()


class CustomAgent:
    """
    Custom agent for specialized analysis.
    """
    
    def __init__(self, config: dict):
        self.config = config
        self.results = []
    
    def analyze(self, target: Path):
        """Perform specialized analysis."""
        logger.info(f"Analyzing {target}...")
        
        # Your analysis logic
        findings = self._scan_target(target)
        
        # Process results
        self.results.extend(findings)
        
        return self.results
    
    def _scan_target(self, target: Path) -> list:
        """Internal scanning logic."""
        # Implementation
        return []
    
    def generate_report(self, output_path: Path):
        """Generate analysis report."""
        report = {
            "findings": self.results,
            "summary": self._generate_summary()
        }
        
        with open(output_path, 'w') as f:
            json.dump(report, f, indent=2)
        
        return output_path
    
    def _generate_summary(self) -> dict:
        """Generate summary statistics."""
        return {
            "total_findings": len(self.results),
            "by_severity": self._count_by_severity()
        }

Example: API Security Agent

#!/usr/bin/env python3
"""
API Security Agent - Specialized API endpoint analysis
"""

class APISecurityAgent:
    """
    Analyzes API endpoints for security issues:
    - Authentication bypasses
    - Authorization flaws (IDOR)
    - Rate limiting gaps
    - Input validation issues
    """
    
    def __init__(self, config: dict):
        self.config = config
        self.endpoints = []
        self.findings = []
    
    def discover_endpoints(self, codebase: Path):
        """Discover API endpoints in codebase."""
        # Parse routing files
        # Extract endpoint definitions
        # Build endpoint map
        pass
    
    def analyze_authentication(self):
        """Check authentication on each endpoint."""
        for endpoint in self.endpoints:
            if not endpoint.has_auth:
                self.findings.append({
                    "type": "missing_authentication",
                    "endpoint": endpoint.path,
                    "severity": "high"
                })
    
    def analyze_authorization(self):
        """Check for IDOR and broken access control."""
        for endpoint in self.endpoints:
            if endpoint.uses_user_id and not endpoint.validates_ownership:
                self.findings.append({
                    "type": "idor",
                    "endpoint": endpoint.path,
                    "severity": "critical"
                })
    
    def analyze_rate_limiting(self):
        """Check for rate limiting on sensitive endpoints."""
        sensitive_paths = ['/login', '/register', '/api/token']
        for endpoint in self.endpoints:
            if any(path in endpoint.path for path in sensitive_paths):
                if not endpoint.has_rate_limit:
                    self.findings.append({
                        "type": "missing_rate_limit",
                        "endpoint": endpoint.path,
                        "severity": "medium"
                    })

Developing Skills

Skills are reusable expertise modules that can be loaded on-demand.

Skill functionality is currently in alpha. Definition creation works, but auto-loading and execution integration are not yet fully implemented.

Skill Structure

# Skill Name
# Purpose: Brief description
# Token cost: ~XXX tokens
# Triggers: keyword1, keyword2, keyword3

## Context

Provide necessary background and context for this skill.

## Methodology

1. **Step 1:** Description
2. **Step 2:** Description
3. **Step 3:** Description

## Examples

Provide concrete examples of applying this skill.

## Decision Framework

Provide clear decision criteria.

Example: API Authentication Skill

# API Authentication Analysis Skill
# Purpose: Analyze API authentication mechanisms for security flaws
# Token cost: ~350 tokens
# Triggers: API, authentication, auth, bearer token, JWT

## Context

API authentication is critical for security. This skill provides
systematic analysis of authentication mechanisms.

## Methodology

1. **Identify Authentication Type**
   - Bearer tokens
   - API keys
   - OAuth 2.0
   - JWT
   - Basic auth

2. **Check Token Security**
   - Sufficient entropy?
   - Proper expiration?
   - Secure storage?
   - Transmitted over HTTPS only?

3. **Validate Authorization**
   - Token validation on every request?
   - Proper scope checking?
   - No privilege escalation?

4. **Test Edge Cases**
   - Expired tokens rejected?
   - Invalid tokens rejected?
   - Missing tokens rejected?
   - Token reuse prevented?

## Examples

### Insecure JWT Implementation

```python
# Vulnerable: No expiration, no signature verification
token = jwt.encode({'user_id': user_id}, 'secret')

Secure JWT Implementation

# Secure: Expiration, strong algorithm, verified
token = jwt.encode(
    {'user_id': user_id, 'exp': datetime.utcnow() + timedelta(hours=1)},
    os.environ['JWT_SECRET'],
    algorithm='HS256'
)

Decision Framework

INSECURE if ANY:

No authentication required
Weak token generation (predictable)
No expiration (tokens valid forever)
No signature verification
Transmitted over HTTP

SECURE if ALL:

Strong token generation (crypto random)
Short expiration (< 24 hours)
Proper signature verification
HTTPS only
Token validation on every request

### Creating Skills

Use the `/create-skill` command in Claude Code:

User: /create-skill Claude: What successful approach should we save? User: When testing APIs, I always check authentication endpoints first, then rate limiting, then input validation. This finds critical issues faster. Claude: [Extracts patterns] [Validates token budget] Skill: api_security_prioritization Triggers: API, endpoint, REST Size: 380 tokens Create? [Y/n] User: Y Claude: ✓ Saved to: tiers/specialists/custom/api_security_prioritization.md

## Best Practices

### Naming Conventions

<AccordionGroup>
  <Accordion title="Package Names" icon="folder">
    Use lowercase with hyphens:
    - `packages/my-scanner/`
    - `packages/api-analyzer/`
    - `packages/cloud-audit/`
  </Accordion>
  <Accordion title="Mode Names" icon="tag">
    Use descriptive, lowercase names:
    - `myscan`, `depscan`, `apiscan`
    - Avoid generic names like `test` or `check`
  </Accordion>
  <Accordion title="Entry Points" icon="door-open">
    Main entry point should be:
    - `agent.py` for agent-based scanners
    - `scanner.py` for tool wrappers
  </Accordion>
</AccordionGroup>

### Error Handling

```python
def mode_my_scanner(args: list) -> int:
    script_root = Path(__file__).parent
    scanner_script = script_root / "packages/my-scanner/agent.py"
    
    # Check if script exists
    if not scanner_script.exists():
        print(f"✗ Scanner not found: {scanner_script}")
        print(f"  Please ensure packages/my-scanner/agent.py exists")
        return 1
    
    # Check dependencies
    try:
        import required_module
    except ImportError:
        print(f"✗ Missing dependency: required_module")
        print(f"  Install with: pip install required_module")
        return 1
    
    print("\n[*] Running my scanner...\n")
    return run_script(scanner_script, args)

Using Core Utilities

from core.config import RaptorConfig  # Configuration management
from core.logging import get_logger   # Structured logging
from core.sarif.parser import parse_sarif  # SARIF handling

logger = get_logger()

# Get output directory
out_dir = RaptorConfig.get_out_dir() / "my-scanner"
out_dir.mkdir(parents=True, exist_ok=True)

# Use structured logging
logger.info("Starting scan...")
logger.warning("Potential issue detected")
logger.error("Scan failed")

# Parse SARIF files
findings = parse_sarif(sarif_file)

Output Conventions

Save to RAPTOR output directory

out_dir = RaptorConfig.get_out_dir() / "your-scanner-name"

Use structured formats

JSON, SARIF, or other machine-readable formats

Include timestamps

timestamp = datetime.now().strftime("%Y%m%d_%H%M%S")
output_file = out_dir / f"results_{timestamp}.json"

Log to audit trail

logger.info(f"Results saved to {output_file}")

Testing Your Extension

Unit Tests

Create tests in test/:

# test/test_my_scanner.py
import pytest
from packages.my_scanner.agent import scan_target

def test_basic_scan():
    result = scan_target("/tmp/test")
    assert result is not None
    assert "findings" in result

def test_invalid_target():
    with pytest.raises(ValueError):
        scan_target("/nonexistent")

Integration Tests

# Test help
python3 raptor.py myscan --help

# Test with invalid arguments
python3 raptor.py myscan

# Test actual execution
python3 raptor.py myscan --target /tmp/test-target

# Verify output
ls -la out/myscan_*/
cat out/myscan_*/results.json

Verify Output Format

# Check SARIF validity
jq empty out/myscan_*/*.sarif && echo "Valid SARIF"

# Check required fields
jq '.runs[0].results | length' out/myscan_*/*.sarif

Contributing

When contributing new scanners or features:

Pull Request Checklist

Documentation Requirements

README Section

Add usage example to main README.md

Help Text

Clear description in raptor.py --help

Docstrings

Document all public functions

Examples

Provide real-world usage examples

Code Review Guidelines

Consistent style: Follow existing code patterns
Error handling: Handle edge cases gracefully
Documentation: Clear docstrings and comments
Testing: Include basic tests
Dependencies: Minimize external dependencies

Getting Help

Existing Scanners

Check packages/ for examples

Architecture Docs

Review docs/ARCHITECTURE.md

GitHub Issues

Ask questions on GitHub

raptor.py Source

Study the routing pattern

Summary

Adding new capabilities to RAPTOR:

Create packages/my-scanner/agent.py
Add mode_my_scanner() function to raptor.py
Register in mode_handlers dictionary
Update help text
Test integration

The unified launcher makes it easy to expand RAPTOR’s capabilities while maintaining a consistent user experience.

Next Steps

Python CLI

Learn command-line usage patterns

Creating Personas

Develop custom expert personas

API Reference

Core API documentation

Configuration

Configuration options

Documentation Index

​Architecture Overview

​Benefits

Single Entry Point

Consistent Interface

Easy Discovery

Simple Extension

​Adding a New Scanner

​Step 1: Create Package Structure

​Step 2: Implement CLI Interface

​Step 3: Add Mode Handler

​Step 4: Register Your Mode

​Step 5: Update Help Text

​Step 6: Test Integration

​Complete Example: Dependency Scanner

​Create packages/dependency-scan/agent.py

​Add to raptor.py

​Usage

​Creating Custom Agents

​Agent Structure

​Example: API Security Agent

​Developing Skills

​Skill Structure

​Example: API Authentication Skill

​Secure JWT Implementation

​Decision Framework

​Using Core Utilities

​Output Conventions

​Testing Your Extension

​Unit Tests

​Integration Tests

​Verify Output Format

​Contributing

​Pull Request Checklist

​Documentation Requirements

README Section

Help Text

Docstrings

Examples

​Code Review Guidelines

​Getting Help

Existing Scanners

Architecture Docs

GitHub Issues

raptor.py Source

​Summary

​Next Steps

Python CLI

Creating Personas

API Reference

Configuration

Architecture Overview

Benefits

Adding a New Scanner

Step 1: Create Package Structure

Step 2: Implement CLI Interface

Step 3: Add Mode Handler

Step 4: Register Your Mode

Step 5: Update Help Text

Step 6: Test Integration

Complete Example: Dependency Scanner

Create packages/dependency-scan/agent.py

Add to raptor.py

Usage

Creating Custom Agents

Agent Structure

Example: API Security Agent

Developing Skills

Skill Structure

Example: API Authentication Skill

Secure JWT Implementation

Decision Framework

Using Core Utilities

Output Conventions

Testing Your Extension

Unit Tests

Integration Tests

Verify Output Format

Contributing

Pull Request Checklist

Documentation Requirements

Code Review Guidelines

Getting Help

Summary

Next Steps