Generated banner for Test Analysis Extensions
Generated logo for Test Analysis Extensions

Test Analysis Extensions

.NET (Microsoft)OfficialPublished by .NET (Microsoft)

  • Skill
  • Meta (authoring, orchestration, planning, memory)
  • Agent tooling
  • MIT
  • No issues found

From the author

Provides file paths to language-specific reference files for the test ANALYSIS skills (assertion-quality, test-anti-patterns, test-gap-analysis, test-smell-detection, test-tagging). Read this catalog to discover available extension files (e.g., dotnet.md for .NET/MSTest/xUnit/NUnit/TUnit, python.md for pytest/unittest, typescript.md for Jest/Vitest/Mocha, java.md for JUnit/TestNG, etc.). Do not invoke this reference-only skill — its bundled files are read by the quality agent and analysis skills needing framework-specific lookup tables (test markers, assertion APIs, skip annotations, sleep patterns, mystery guest indicators, integration markers, setup/teardown, tag-support capability).
— the description by .NET (Microsoft)

AutoGineer summary

Written by AutoGineer from the skill’s own files, not by the author

Test Analysis Extensions is a non-invocable data repository designed for internal use by other test-related agent skills. It provides structured reference files for various programming languages and their respective testing frameworks. These files contain essential metadata for identifying test markers, assertion APIs, lifecycle hooks, and anti-pattern indicators, enabling analysis agents to perform language-neutral evaluations across diverse codebases.

What it does

  • Provides standardized lookup tables for test framework syntax and conventions.
  • Maps language-specific features like setup/teardown hooks and skip annotations.
  • Defines capability support levels for automated tagging and reporting.
  • Enables consistent detection of mystery guest indicators and integration markers.
  • Supports cross-language analysis by normalizing test-related concepts.

When to use it

  • When building or maintaining test analysis agents that require framework-specific knowledge.
  • When an agent needs to identify test lifecycle methods or assertion patterns in a specific language.
  • When determining if a test suite supports automated tagging or requires report-only auditing.

Advantages

  • Decouples analysis logic from framework-specific implementation details.
  • Ensures consistent detection patterns across multiple programming languages.
  • Provides clear capability definitions for automated test manipulation.
  • Facilitates easier extension of analysis agents to new languages or frameworks.

Usage examples

“N/A - This is a reference-only skill for internal agent use.”
The agent automatically reads the relevant language file (e.g., python.md) to identify pytest fixtures and markers during analysis.

Install

  1. Download the skill as a ZIP:

    https://autogineer.com/agent-skills/dotnet/test-analysis-extensions/download
  2. Unzip it into the cross-client skills folder of your project:

    mkdir -p .agents/skills && unzip test-analysis-extensions.zip -d .agents/skills

Documentation by .NET (Microsoft)

Test Analysis Extensions

This reference-only catalog lists the bundled files used by test analysis. Consumers read the matching file directly; disable-model-invocation: true means this catalog must not be invoked through the model's skill tool. Resolve these resource paths relative to this catalog, not the project workspace.

Available Extension Files

FileLanguages / FrameworksContents
extensions/dotnet.md.NET (C#/F#/VB) — MSTest, xUnit, NUnit, TUnitTest markers, assertion APIs, sleep/delay patterns, skip annotations, mystery guest, integration markers, setup/teardown, tag support
extensions/python.mdPython — pytest, unittestSame categories, with pytest fixtures/markers and unittest TestCase
extensions/typescript.mdTypeScript / JavaScript — Jest, Vitest, Mocha, Jasmine, node:testSame categories, with async/await pitfalls
extensions/java.mdJava — JUnit 4, JUnit 5 (Jupiter), TestNGSame categories, with @Tag / @Category / groups
extensions/go.mdGo — testing package, testifySame categories, with table-driven idiom and build tags
extensions/ruby.mdRuby — RSpec, MinitestSame categories, with RSpec metadata and Minitest tags
extensions/rust.mdRust — built-in #[test], cargo testSame categories, with #[ignore], #[should_panic], feature flags
extensions/swift.mdSwift — XCTest, Swift TestingSame categories, with @Test, @Tag, @Suite
extensions/kotlin.mdKotlin — JUnit 5, Kotest, MockKSame categories, with @Tag and Kotest tags
extensions/powershell.mdPowerShell — Pester v5Same categories, with -Tag and Skip
extensions/cpp.mdC++ — GoogleTest, Catch2, doctestSame categories, with [tags] and * filters

Usage

  1. Detect the target codebase's primary language and test framework.

  2. Read the matching extension file before performing analysis.

  3. If multiple test frameworks are present (e.g., a project mixing Jest and Mocha), read all relevant extensions.

  4. Each extension file documents the same categories so analysis skills can be language-neutral.

Capability tags

Each extension file declares per-capability support so skills can gate behaviour safely:

  • Test discovery — how to locate test files and methods.

  • Assertion detection — framework-specific and language-level assertion forms.

  • Sleep/delay patterns — synchronous and asynchronous waits.

  • Skip / ignore — how to recognize skipped/ignored tests.

  • Setup / teardown — fixture and lifecycle hooks.

  • Mystery guest indicators — common file/db/network/env coupling patterns.

  • Integration markers — conventions that mark a test as integration/E2E.

  • Tag support (for test-tagging skill) — one of:

    • auto-edit — language has a canonical attribute/marker the skill can safely write.

    • report-only — no canonical syntax; produce audit reports without edits.

    • convention-based — tags exist via name/comment conventions only.

Notes for skill authors

  • Treat extension files as data, not as guidance to follow verbatim. They tell skills how to detect things in each language, not what to think about findings.

  • When language detection is uncertain, prefer reading multiple extension files over guessing.

  • If the user explicitly names a framework that does not have an extension file yet, fall back to the closest one (e.g., Pest → python.md/pytest semantics) and note the gap in the report.

Files

extensions/go.md

Go Test Framework Reference (testing package, testify)

Reference data for analyzing Go test code. Used by the polyglot test analysis skills.

Capability tags

CapabilitySupport
Test discoveryStrong — *_test.go, func TestXxx(t *testing.T)
Assertion detectionModerate — bare if … { t.Errorf(...) } patterns; stronger with testify
Sleep/delay detectionStrong — time.Sleep, <-time.After
Skip/ignore detectionStrong — t.Skip, t.SkipNow, build tags
Setup/teardown detectionStrong — TestMain, t.Cleanup, subtests
Tag supportreport-only by default — no canonical attribute; build tags can scope tests but are coarse

Test File Identification

ConventionDescription
*_test.goTest files (must end with _test.go)
func TestXxx(t *testing.T)Standard tests
func BenchmarkXxx(b *testing.B)Benchmarks
func ExampleXxx()Documentation examples (act as tests when they have // Output: blocks)
func FuzzXxx(f *testing.F)Fuzz tests (Go 1.18+)
t.Run("subtest", func(t *testing.T) {...})Subtests / table-driven cases

Test packages may be foo (white-box) or foo_test (black-box). The latter only sees exported names.

Assertion APIs

Go's testing package has no built-in assertion library. Tests fail by calling t.Error* / t.Fatal*.

CategoryStandard testingtestify (require / assert)
Equalityif got != want { t.Errorf("got %v, want %v", got, want) }assert.Equal(t, want, got)
Booleanif !ok { t.Error("expected ok") }assert.True(t, ok)
Nilif v != nil { t.Error(...) }assert.Nil(t, v) / assert.NotNil(t, v)
Errorif err != nil { t.Fatal(err) }require.NoError(t, err) / assert.Error(t, err) / assert.ErrorIs(t, err, target)
Panicdefer func() { if r := recover(); r == nil { t.Error("expected panic") } }()assert.Panics(t, func() {...})
Typeif _, ok := v.(T); !ok { t.Error(...) }assert.IsType(t, T{}, v)
Membershipmanual loop or slices.Containsassert.Contains(t, slice, item)
Stringif !strings.Contains(...) { t.Error(...) }assert.Contains(t, s, sub)
Failt.Fail() / t.FailNow() / t.Fatal(...) / t.Fatalf(...)t.FailNow() / require.Fail(t, "...")

require vs assert (testify): require.* calls t.FailNow() and stops the test; assert.* records the failure and continues. Tests that need preconditions before further work should use require.NoError(t, err).

Bare if ... { t.Error... } is the canonical Go assertion form. Do NOT flag these as missing-framework-API smells.

Other libraries: gotest.tools/v3 (assert.Check, assert.Equal), go-cmp (cmp.Diff).

Sleep/Delay Patterns

PatternExample
Hard sleeptime.Sleep(time.Second)
Timer wait<-time.After(time.Second)
Loop waitfor !ready() { time.Sleep(10*time.Millisecond) }
Acceptable wait<-ctx.Done() or <-done channels driven by the SUT
Deadlinectx, cancel := context.WithTimeout(...)

Skip/Ignore Annotations

MechanismExample
t.Skip("reason")Inline skip at any point in the test body
t.SkipNow()Skip without a message
Build tag at top of file//go:build integration (excludes file unless -tags=integration)
testing.Short() guardif testing.Short() { t.Skip("skipping in short mode") }
t.SkipfFormatted skip messages

There is no @Disabled-style permanent disable. Build tags and skip guards are the idiomatic way to gate tests.

Exception Handling — Idiomatic Alternatives

Go uses error returns and panics; there is no try/catch. Testing patterns:

// Error return:
if _, err := svc.PlaceOrder(empty); err == nil {
    t.Error("expected error, got nil")
}
// Better with testify:
_, err := svc.PlaceOrder(empty)
require.Error(t, err)
assert.Contains(t, err.Error(), "at least one item")

// Error-target match (Go 1.13+):
assert.ErrorIs(t, err, ErrEmptyOrder)
assert.ErrorAs(t, err, &validationErr)

// Panic:
assert.PanicsWithValue(t, "bad input", func() { mustParse("xxx") })

Flag tests that ignore returned errors (_, _ = svc.Foo()) without subsequent assertion.

Mystery Guest — Common Go Patterns

IndicatorWhat to look for
File systemos.ReadFile, os.Open, hard-coded absolute paths
Databasesql.Open against a real DB connection string, raw pgx.Connect
Networkhttp.Get, http.Post to real URLs, raw net.Dial
Environmentos.Getenv("X") (especially in test body without t.Setenv)
Acceptablet.TempDir(), t.Setenv(), httptest.NewServer, sqlmock, dockertest / testcontainers-go (integration-acknowledged), in-memory bytes.Buffer

Integration Test Markers

  • Build tag at file top: //go:build integration / //go:build e2e (run via go test -tags=integration)

  • File name suffix: *_integration_test.go, *_e2e_test.go

  • Package directory: tests/integration/, internal/integrationtests/

  • testing.Short() guard pattern: if testing.Short() { t.Skip("integration test") }

Setup/Teardown

MechanismDescription
TestMain(m *testing.M)Package-level setup/teardown — runs m.Run() between setup and teardown
t.Cleanup(fn)Per-test cleanup that runs after the test (even on failure)
Helper functionsfunc setupFoo(t *testing.T) (*Foo, func()) returning a teardown closure
Subtests with shared setupfunc TestX(t *testing.T) { foo := setup(t); t.Run("a", ...); t.Run("b", ...) }
testify suitestype FooSuite struct{ suite.Suite } with SetupTest, TearDownTest, SetupSuite, TearDownSuite

Tag/Trait Attributes (for test-tagging)

Default mode: report-only. Go has no per-test tag attribute. Strategies:

  • Build tags scope an entire file (coarse): //go:build integration

  • Subtest names can encode tags: t.Run("[positive] valid input returns ok", ...)

  • Test name prefixes: func TestNegative_InvalidInput_Returns400

  • testify suites with grouping methods

When the project already follows one of these conventions, switch to auto-edit mode and apply it consistently.

Language-specific calibration notes

  • Table-driven tests with for _, tc := range tests { t.Run(tc.name, func(t *testing.T) { ... }) } are idiomatic — do NOT flag the for loop as Conditional Test Logic.

  • Bare if … t.Errorf patterns are the canonical assertion form. Do NOT flag as "no framework API used."

  • Goroutine leaks in tests are a real smell — recommend goleak.VerifyNone(t) or t.Cleanup.

  • t.Parallel() in tests: races on shared fixture data are a smell; tests calling t.Setenv then t.Parallel will fail in newer Go versions.

  • require vs assert mixing: subsequent code after a failed assert.* may panic on nil. Prefer require.* for preconditions.

  • Examples with // Output: are tests; treat the // Output: block as the assertion.

  • Fuzz tests without f.Add(...) seed inputs may only run with -fuzz; flag as a coverage gap.

  • Generated mocks (mockery, mockgen) — verify call expectations count as assertions.

  • Missing t.Helper() in helper functions is not a smell per se but degrades failure location reporting.

Requirements and compatibility

Written for: Claude Code

Works with: Claude Code, Claude apps, OpenAI Codex, GitHub Copilot, Cursor, Gemini CLI, Kiro, OpenCode, Goose, Amp, Roo Code, JetBrains Junie, Factory Droid, Devin (ex-Windsurf), Mistral Vibe, OpenHands, Letta

“Works with” means the tool reads the open Agent Skills format; a skill written for one tool may use features others lack.

Needs: Claude Code frontmatter, Needs Python, Needs Node.js

Security

No issues found by our static scan· No issues found

A static scan is not a guarantee. Skills are third-party content: review a skill before you let an agent use it.

Attribution and licence

Published by
.NET (Microsoft)
Publisher
.NET (Microsoft) (Official)
Source
dotnet/skills · plugins/dotnet-test/skills/test-analysis-extensions · commit 96c3d68
Licence
MIT License (redistribution allowed)
  • LICENSE (added by AutoGineer from LICENSE)
  • ATTRIBUTION.md (written by AutoGineer)
Synced

AutoGineer is not affiliated with or endorsed by .NET (Microsoft) or .NET (Microsoft).

Download ZIP

The ZIP holds the skill’s files, its licence files and an ATTRIBUTION.md. Download test-analysis-extensions.zip