Variant Analysis
Trail of BitsOfficialPublished by Trail of Bits
- Skill
- Workflow
- Security
- CC-BY-SA-4.0
- No issues found
AutoGineer summary
Written by AutoGineer from the skill’s own files, not by the author
Variant Analysis is a structured process for hunting down recurring bugs. Once a root cause is identified, this skill guides you through defining the vulnerability, creating an exact match pattern, and iteratively generalizing that pattern to discover similar manifestations elsewhere in the codebase. It emphasizes a methodical approach—moving from specific instances to broader pattern families—while providing a framework for triaging findings and documenting the search process to ensure reproducibility and prevent future regressions.
What it does
- Extracts the root cause of a known vulnerability to define search parameters.
- Guides the creation of exact-match patterns to confirm the initial bug.
- Facilitates iterative generalization of patterns to find related bug variants.
- Provides a triage framework to validate findings and assess severity.
- Supports the creation of regression tests and CI rules based on discovered variants.
- Offers a parallelized workflow for large codebases to maximize search efficiency.
When to use it
- Immediately after discovering a vulnerability, logic bug, or bad pattern.
- When you need to determine if a bug exists in other parts of the codebase.
- When refining security queries for tools like CodeQL or Semgrep.
- During systematic code audits following an initial issue discovery.
Advantages
- Reduces the likelihood of leaving similar vulnerabilities unfixed.
- Provides a reproducible methodology for security audits.
- Helps identify the full scope of a root cause beyond the initial finding.
- Prevents regression by generating CI-ready rules from successful patterns.
Usage examples
- “I found a SQL injection in user_controller.py. Are there others like this?”
- The agent will initiate the variant analysis workflow, starting by extracting the root cause and searching for similar patterns across the codebase.
- “Is this the same bug? I found a similar pattern in the auth module.”
- The agent will compare the new finding against the known root cause and guide you through triaging the candidate.
Install
Download the skill as a ZIP:
https://autogineer.com/agent-skills/trailofbits/variant-analysis/downloadUnzip it into the cross-client skills folder of your project:
mkdir -p .agents/skills && unzip variant-analysis.zip -d .agents/skills
Documentation by Trail of Bits
Variant Analysis
Find the other instances of a bug you have already found. One root cause usually has several manifestations, and they are rarely in the module where you found the first one.
When to Use
A vulnerability has been found and you need to search for similar instances
Building or refining CodeQL/Semgrep queries for security patterns
Performing systematic code audits after an initial issue discovery
Analyzing how a single root cause manifests in different code paths
When NOT to Use
Initial vulnerability discovery — use audit-context-building or a domain-specific audit
General code review with no known pattern to search for
Writing fix recommendations — use issue-writer
Understanding unfamiliar code — use audit-context-building first
The Five Steps
Read the reference for a step when you reach it.
1. Understand the original issue. Extract the root cause — why the code is wrong, not what it does — and enumerate the directions a variant could hide in: related identifiers, other manifestations of the same mistake, data-type edge cases. → references/root-cause.md
2. Create an exact match. Write a pattern matching ONLY the known instance and confirm it hits. A pattern that matches nothing means you have misunderstood the bug, and every search built on it is calibrated against the wrong code.
3–4. Generalize one element at a time. Climb from the exact match toward the pattern family, running and reading all matches after each single change. Stop when more than half the matches are noise. → references/searching.md — abstraction ladder, tool selection, false-positive filters
5. Triage. Decide which candidates are real, and say so with a severity attached. → references/triage.md
Then write it up, including the patterns that failed and a CI rule to prevent regression. → references/reporting.md
Running it as a Workflow
This plugin ships /variant-analysis:variants, which runs the five steps across parallel
subagents — one per expansion axis, looping until the sweep stops finding anything new.
Each stage reads the reference above that matches its job.
Use the workflow when the codebase is large or the root cause has many manifestations. Work the steps directly when the search is narrow or you want a say in each generalization.
What Makes Hunts Fail
Narrow scope — searching only the module the original bug was in
Pattern too specific — searching one attribute and missing the family around it
One vulnerability class — chasing a single manifestation of the root cause
Happy-path testing — never trying the null, empty, and boundary cases
Generalizing too fast — abstracting several elements at once, so noise cannot be attributed to any one of them
The first three are covered in root-cause.md and searching.md, the fourth in triage.md.
Resources
CodeQL (resources/codeql/): python.ql, javascript.ql, java.ql, go.ql, cpp.ql
Semgrep (resources/semgrep/): python.yaml, javascript.yaml, java.yaml, go.yaml, cpp.yaml
Report: resources/variant-report-template.md
Files
- ATTRIBUTION.mdAdded by AutoGineer942 B
- LICENSELicence file added by AutoGineer19.7 KiB
- SKILL.md3.8 KiB
- agents/openai.yaml247 B
- assets/trail-of-bits-mark.svg3.0 KiB
- references/reporting.md1.5 KiB
- references/root-cause.md4.1 KiB
- references/searching.md4.5 KiB
- references/triage.md3.5 KiB
- resources/codeql/cpp.ql3.4 KiB
- resources/codeql/go.ql2.0 KiB
- resources/codeql/java.ql2.3 KiB
- resources/codeql/javascript.ql1.7 KiB
- resources/codeql/python.ql2.4 KiB
- resources/semgrep/cpp.yaml2.7 KiB
- resources/semgrep/go.yaml1.8 KiB
- resources/semgrep/java.yaml2.0 KiB
- resources/semgrep/javascript.yaml1.7 KiB
- resources/semgrep/python.yaml2.0 KiB
- resources/variant-report-template.md1.3 KiB
references/triage.md
Triage: Deciding Whether a Candidate Is Real
Strategy for the verification stage. You have candidate locations that resemble a known bug. The job is to determine which ones actually carry it, and to say so with a severity attached.
Argue Against the Candidate
The snippet alone is never enough. Read the surrounding function, the callers, and the type of every value involved, then look specifically for the thing that makes it safe:
A guard earlier in the function or in a decorator/middleware
A sanitizer, validator, or parameterized API between source and sink
A type constraint that makes the dangerous value unreachable
A caller set that never supplies attacker-controlled input
A candidate survives only if you looked for these and did not find them.
Note what is not on that list: having no callers. Code that nothing reaches today is still unprotected code, and a variant hunt is exactly the search that finds it before a caller arrives. Report it at lower severity — see Exploitability below — rather than refuting it as dead.
Exploitability
For a surviving candidate, establish:
Reachable — is there a path from an external entry point to this code?
Controllable — can an attacker influence the value that makes it dangerous?
Unprotected — is the protection named in the root cause genuinely absent here?
A candidate that is reachable and controllable but has a different protection in place is a false positive worth recording, not a finding. A candidate that is unreachable today but unprotected is a real finding at lower severity: say so explicitly, and say what would make it reachable.
Edge Cases That Hide Real Bugs
Test every candidate against these if applicable, because normal-path reasoning misses them.
Null equality bypasses
A common authorization bypass. If both sides of a comparison can be null at the same time, the comparison succeeds for the wrong reason:
# anonymous_user.id is None, guest_order.owner_id is None
# None == None is True, so the check passes for a user who owns nothing
if order.owner_id == current_user.id:
return TrueAsk: what values can each side hold? Can both be null simultaneously? Who can cause that?
Documentation/code mismatch
The function does the opposite of what its name or docstring claims:
def check_restricted_permission(user, perm):
"""Returns True if access should be DENIED."""
if user.has_perm(perm):
return True # BUG: returns "deny" for users who DO have permission
return FalseEvery caller of a function like this is a potential finding, even where the call site looks correct. Verify the return semantics against the name before trusting any use of it.
Others worth testing
Unauthenticated and anonymous callers
Empty strings vs null, zero vs null
Empty arrays and collections
Boundary values at the limits of the type
Severity and Confidence
Attach a severity to every verdict, including informational ones. Do not suppress findings you judge minor: filtering happens downstream, where the full set is visible, and a finding you decline to mention is a finding nobody sees.
Separate the two axes:
Severity — the impact if this is real
Confidence — how sure you are that it is real
Recording False Positives
When a candidate is ruled out, record why it was safe. Grouped by reason, these become the false-positive table in the report, and they are what lets the next stage refine the pattern instead of re-triaging the same matches.
Requirements and compatibility
Works with: Claude Code, Claude apps, OpenAI Codex, GitHub Copilot, Cursor, Gemini CLI, Kiro, OpenCode, Goose, Amp, Roo Code, JetBrains Junie, Factory Droid, Devin (ex-Windsurf), Mistral Vibe, OpenHands, Letta
“Works with” means the tool reads the open Agent Skills format; a skill written for one tool may use features others lack.
Needs: Needs Python
Security
No issues found by our static scan· No issues found
A static scan is not a guarantee. Skills are third-party content: review a skill before you let an agent use it.
Attribution and licence
- Published by
- Trail of Bits
- Publisher
- Trail of Bits (Official)
- Source
- trailofbits/skills · plugins/variant-analysis/skills/variant-analysis · commit e4dd0bb
- Licence
- Creative Commons Attribution-ShareAlike 4.0 International (redistribution allowed)
- LICENSE (added by AutoGineer from LICENSE)
- ATTRIBUTION.md (written by AutoGineer)
- Synced
AutoGineer is not affiliated with or endorsed by Trail of Bits or Trail of Bits.
Download ZIP
The ZIP holds the skill’s files, its licence files and an ATTRIBUTION.md. Download variant-analysis.zip