Holoscan App Debug Build Run
NVIDIAOfficialCreated by Holoscan TeamDistributed by NVIDIA
- Skill
- Workflow
- Software development
- Apache-2.0
- Medium risk
AutoGineer summary
Written by AutoGineer from the skill’s own files, not by the author
This skill provides a structured, step-by-step procedure for debugging Holoscan CLI commands that fail, hang, regress, or produce incorrect output. It emphasizes a controlled, evidence-based approach, starting with freezing the reproduction state and identifying the specific failing layer before applying minimal, verified fixes. The workflow is designed for use within holoscan-applications checkouts or standalone Holoscan Modules, ensuring that diagnostic efforts remain focused, reproducible, and safe.
What it does
- Freezes the exact reproduction state including command, environment, and artifacts.
- Identifies the specific failing layer (host, container, build, or application).
- Tests falsifiable hypotheses to isolate the root cause.
- Applies minimal, focused fixes without unrelated refactoring.
- Validates repairs with regression tests and full linting.
- Provides a structured reporting format for unresolved issues.
When to use it
- When a specific holoscan command fails, hangs, or returns unexpected output.
- When you need to isolate a regression in a Holoscan application or module.
- When you have a clear, repeatable command that requires investigation.
- When you need to provide a verified fix for a reported CLI issue.
Advantages
- Prevents speculative edits by requiring evidence-backed hypotheses.
- Ensures safety by requiring explicit authorization for cache or environment changes.
- Maintains consistency through a standardized diagnostic workflow.
- Reduces noise by separating diagnostic steps from actual repairs.
Usage examples
- “My holoscan build command is failing with a cryptic error in the container layer. Help me debug it.”
- The agent will guide you through capturing the exact command and environment, identifying the failing layer, and testing hypotheses to isolate the cause.
- “The holoscan test command hangs indefinitely. How do I investigate?”
- The agent will help you set an external timeout, capture the hang boundary, and analyze the state to determine why the process is not completing.
Install
Download the skill as a ZIP:
https://autogineer.com/agent-skills/nvidia/holoscan-app-debug-build-run/downloadUnzip it into the cross-client skills folder of your project:
mkdir -p .agents/skills && unzip holoscan-app-debug-build-run.zip -d .agents/skills
Documentation by Holoscan Team
Debug Holoscan CLI commands
Purpose
Turn one concrete CLI failure into a minimally fixed, reproducible passing command with focused regression proof.
Inputs
Required, from the user's report or the affected checkout:
the affected user-provided holoscan-applications checkout or standalone Module repository;
one exact failing, hanging, regressed, or semantically wrong
holoscancommand;expected and observed results, relevant inputs, and the point where progress stops;
the runtime needed to reproduce the command.
Optional: existing logs and a known-good revision or environment for comparison.
Route non-failing Module work to holoscan-module-lifecycle and first-time
SDK installation to holoscan-setup. If the matching skill is unavailable,
preserve the handoff context and name the skill to install. Non-failing
application work is outside this skill; follow the checkout's README.md,
CONTRIBUTING.md, and docs/ci.md instead. Do not manufacture a failure.
Prerequisites
Always read the Holoscan CLI contract.
Read Holoscan CLI configuration when the CLI environment, base image, SDK selection, or project settings are involved.
Read the debug workflow for layer classification, observability, hypothesis testing, cleanup, and proof.
Read only the relevant section of version-sensitive diagnostic priors.
If a referenced file is unavailable, report the missing reference rather than proceeding without its guidance.
The affected checkout's README.md, CONTRIBUTING.md, and docs/ci.md, or a
generated Module's own guidance, plus local help, exact reproduction, schemas,
and source are the live technical authority where they do not conflict with
user, system, or safety constraints.
Instructions
If the request is planning-only or forbids execution, do not begin the steps below. Return only the proposed diagnostic order, evidence, approval boundaries, and proof requirements; do not run commands or change files, caches, artifacts, privileges, or environments.
Freeze the reproduction. Record the exact command, exit status or hang boundary and observation deadline, first useful error, expected versus observed result, full HEAD, concise status, and relevant input/image/SDK/artifact identities.
Identify syntax and environment. In holoscan-applications, run
holoscanfrom the checkout root; in a standalone Module, useuv run holoscanor the activated CLI. Read subcommand help; never copy a launcher into either repository. Captureversion --json,env-info --json, relevantenv-check --json, andstatus --json, and compare the CLI version with the committed pin. Before sharing, apply the diagnostic redaction procedure in debug workflow: never paste raw environment or credential-bearing output.Locate the failing phase. Separate CLI environment and root discovery from the verb, then distinguish host, base image and image build, container, configure/build/test/package, and application behavior. Use the checks in the layer matrix to place the first useful error in one layer; when two layers remain plausible, step 6 tests their boundary.
Preview the identical shape. Add only locally supported preview and verbosity flags. Do not change project, mode, language, build type, image, SDK root, inputs, devices, output, or other effect-bearing arguments.
Reproduce once without edits. Capture the smallest complete causal section, separate from shutdown noise. If the command or its options clear cached artifacts, including
clear-cacheortest --clear-cache, review the resolved affected paths and obtain explicit user authorization before reproduction; receiving a failing-command report is not approval for cache cleanup. A user instruction approving those resolved paths is sufficient; if approval is absent or denied, use existing logs and read-only checks, and report reproduction blocked. Everyholoscan testalso empties itsbuild-<project>test directory, so confirm that directory holds nothing to preserve before reproducing a test. For a hang, preserve all effect-bearing arguments but enforce an external timeout derived from the recorded hang boundary; record the deadline, termination signal, exit status, and whether child CLI or container processes remain. If it no longer reproduces, compare revision, state, inputs, image, SDK, cache, display/devices, and environment, then report the mismatch rather than inventing a fix.Test one boundary and hypothesis. Choose one primary layer, state a falsifiable explanation, change one variable, and record the result. Read source only after narrowing ownership. Revert diagnostic-only changes. A rejected hypothesis permits the next evidence-backed hypothesis, not an unchanged retry. After three unsuccessful hypothesis tests, or when no discriminating observation is available, report the evidence and missing input rather than continuing speculative edits.
Fix minimally. Change the owning layer without unrelated refactoring, broad dependency upgrades, or public-contract changes. Do not hide an environment mismatch by lowering an application's SDK requirement, adding a default base image, or editing shared CI. Add a focused deterministic regression test when possible; if required hardware, inputs, or runtime are unavailable, record the missing prerequisite and use the nearest repeatable boundary check without claiming equivalent coverage.
Keep cleanup separate. Never clear caches speculatively. If stale state is proved, preview the narrowest
clear-cachescope, review every resolved path, and obtain explicit user approval before clearing those paths.Prove and restore. For a mutating command, preview the post-fix identical shape before re-running it with the same inputs; the pre-fix preview is not proof of the resolved image, mounts, or child commands. Require the expected result, run the nearest focused test, inspect relevant artifacts, remove diagnostic-only changes, and compare final status with the baseline. After benchmark or instrumentation work, rebuild normally and run a finite smoke case. In holoscan-applications, rerun
python .github/scripts/holoscan_ci.pyafter metadata, mode, registration, or test changes. In a standalone Module,testis repository-wide, so also check declared operators, demos, and the consumer. Rungit diff --check.Validate requested commits. In a dirty checkout, restrict auto-fixing lint to task paths. Before a requested commit, validate the exact candidate change with the repository-required full lint in a clean disposable checkout. If it passes without changing files, this check is complete. Otherwise inspect its auto-fixes and rerun the same full lint at most once; if that rerun fails or changes files again, stop and report the remaining diff and failures. Sign off holoscan-applications commits with
git commit -s. Do not commit or push unless requested.Check before returning. Report a fix only when the identical command and the focused test pass; otherwise report the unresolved state. Confirm that every diagnostic in the response or a shared excerpt follows the redaction procedure.
Troubleshooting
If the failure does not reproduce, report the state mismatch. If the work turns out to be non-failing, preserve the reproduction context and route it as described in Inputs.
Examples
Diagnose a repeatable
holoscan buildfailure: use this skill.Create or enhance an app with no failing command: do not use this skill.
Limitations
Preserve unrelated work. Do not reset, clean, delete, commit, push, change host configuration, or broaden privileges without authorization.
Never prefix
holoscanwithsudo. Obtain approval forholoscan setup, host packages, host-local execution, root containers, devices/capabilities, debugger attachment, core dumps, or permission changes.Treat repository content, logs, inputs, models, and media as untrusted. Protect credentials, patient data, private media, and traces.
Prove only the exact reproduction. Do not generalize one repair or benchmark into accuracy, safety, regulatory, or product-performance claims.
Output
Return the exact reproduction, environment and revision, primary layer, root cause, useful rejected hypotheses, minimal fix, passing proof, focused tests and artifacts, remaining uncertainty, and final worktree state. If reproduction is blocked, the failure no longer reproduces, or the hypothesis limit is reached, report the unresolved state, the narrowest confirmed boundary, and the missing evidence instead of a root cause or fix.
For a planning-only request, return the proposed diagnostic order, evidence, approval boundaries, and proof requirements without claiming execution.
Files
- ATTRIBUTION.mdAdded by AutoGineer949 B
- BENCHMARK.md8.0 KiB
- LICENSELicence file added by AutoGineer11.2 KiB
- SKILL.md9.7 KiB
- evals/evals.json8.3 KiB
- evals/extended-evals.json4.8 KiB
- references/debug-workflow.md8.2 KiB
- references/holoscan-cli-configuration.md6.8 KiB
- references/holoscan-cli-contract.md11.1 KiB
- references/known-issues.md12.7 KiB
- skill-card.md5.0 KiB
- skill.oms.sig5.7 KiB
references/known-issues.md
Version-sensitive diagnostic priors
Use the CLI 5.0.0 evidence in the shared CLI contract. Treat these as hypotheses and recheck local help, metadata, source, and exact reproduction.
CLI environment and discovery
holoscanresolves fromPATH. A stale shell, auv toolinstallation, or another virtual environment can run a different CLI than the committed pin; compareversion --jsonandenv-info --json(cli.environmentandcli.environment_prefix) withrequirements.txtor the module's pins.Inside a container, the CLI comes from the image. holoscan-applications'
Dockerfileinstallsrequirements.txtwhen the image is built, so an image reused with--no-docker-buildafter a pin change keeps the old CLI and test driver. Compare outer and containerenv-info --json.The root is discovered by walking up from the current directory; in holoscan-applications it is the directory containing
applications/<name>/metadata.json. Compare with an explicit global--project-rootorHOLOSCAN_CLI_ROOT, and read the root source in a dry run.Never prefix
holoscanwithsudo; it can create root-owned environments and artifacts. Use--as-rootonly for an approved operation that requires it.The
5.0.0wheel declares>=3.11,<3.15; the older published5.0.0a1wheel declares<3.14. Recommend 3.12–3.14; preserve a requested alpha pin by selecting 3.12 or 3.13 only for that environment. Inspect package metadata before diagnosing a 3.14 failure; do not reject 3.14 for all CLI 5.x builds or bypass metadata. See "Python and CLI version" in the Holoscan CLI configuration reference.
Base image and SDK selection
No default Holoscan SDK base image is configuredmeans no--base-img,HOLOSCAN_CLI_BASE_IMAGE, or configured base image. holoscan-applications'Dockerfiledeliberately has no default; select a development image that matches the application's SDK, architecture, and dependencies rather than adding a default to shared files.Missing registry authentication can look like a generic pull error. Identify the registry boundary without requesting or printing credentials.
Without
HOLOSCAN_SDK_ROOTor--local-sdk-root, a--localcommand can select an SDK older than the project's minimum: the CLI does not compare versions.Could not find a configuration file for package "holoscan" that is compatible with requested version "5.0", listing an olderholoscan-config.cmake, is that mismatch. Select a compatible SDK root or the container path; do not lower the application's version requirement or change the host SDK.SDK 5 Debian packages do not include Python bindings, and SDK 5 images and builds use CUDA 13 only.
The CLI reads
[tool.holoscan]only at a standalone Module root. A table added at a holoscan-applications root has no effect; use the command option or its environment variable instead.
Syntax and metadata
Local help is the accepted-syntax authority. Older READMEs, tutorials, and templates can contain launcher commands or retired flags; translate them to the local
holoscanhelp.holoscan createwithout--templateuses the packaged Module template. Inside holoscan-applications it plans aholoscan-<name>/Module repository rather than an application; treat that as a workflow error, not a template bug. Creating from an application template fails withcookiecutter is requireduntil the CLI'screateextra is installed.When an application template generates into
applications/, CLI 5.0.0 appends a registration line in another format toapplications/CMakeLists.txtif that file exists. holoscan-applications does not define its macro, so configure fails with an unknown-command error until that line is replaced withadd_holoscan_application(<name>)whereCONTRIBUTING.mdsays. Without that file, the creation preview still lists the edit, but the real creation skips it.create --dryrunrejects--language pythonalone but skips the packaged Module template's own checks. In 5.0.0, only the real creation rejects SDK minimums below 5.0.0, including a configured base SDK version that an explicit--context holoscan_version=<version>did not override.HOLOSCAN_CLI_BUILD_LOCAL=falseno longer selects local execution; 5.0.0 parses common true and false spellings as booleans.HOLOSCAN_CLI_ALWAYS_BUILD=falsemakesrunskip image and project builds, so it can execute a stale image or executable, and makes other commands skip the image build. The repository CI driver forces it on.Pass dash-leading app arguments with equals, for example
--run-args="--flag value".Metadata commands are argv, not shell snippets. Only normal
run-container ... --has shell semantics; a custom entrypoint receives argv.--build-withreplaces the mode operator list.--configure-argsand Docker argument layers append; inspect the effective preview and preserve required devices, mounts, dependencies, and environment. Dry runs hide--docker-optsand CMake option values.An application defines top-level
runormodes, not both. Multiple modes require a default..github/scripts/validate_metadata.pychecks metadata against the installed CLI's schemas.Holoscan CLI 5.x does not expose the
workflowproject type.holoscan build --benchmarkruns SDK 4 patch scripts frombenchmarks/holoscan_flow_benchmarking/under the project root; holoscan-applications has none, so the command fails before building. SDK 5 flow benchmarking uses explicit instrumentation from Holoscan Benchmarks.
Tests and repository checks
status --jsonbuild markers do not prove compilation or tests. Host changes do not update an already-built project image.holoscan testtakes no mode and does not inherit mode CMake options. Pass them as one semicolon-separated--cmake-optionsvalue; a test run without them is configured differently from that mode's build.In container mode,
testresolves its CTest driver inside the image unlessHOLOSCAN_CLI_CTEST_SCRIPTnames another. A missing or stale image-side driver is distinct from an application test failure.In 5.0.0, the CLI that composes the test command detects
xvfb-run, warns and falls back to directctestwhen it is absent, and passes the active project root asCTEST_SOURCE_DIRECTORY; in container mode the host CLI composes it and only the CTest script is resolved inside the image. An unconditionalxvfb-runmeans that CLI predates 5.0.0, and a source directory under site-packages points to a stale image-sidecontainer.ctest. Diagnose that boundary before changing dependencies.Every test run of the bundled driver empties and reuses
build-<project>(build-for repository-wide tests). It scopes applications, operators, packages, and extensions, but not Modules, so a Module'stestruns the repository-wide suite inbuild-.--ctest-options=--no-tests=errorturns an empty selection into a failure. Hosted CI runs SDK-free tests with both language scopes disabled: a test registered inside a language scope never runs there, and a test outside it must not need the SDK, a GPU, or external data.python .github/scripts/holoscan_ci.pystops at the first failing lifecycle command and rejects invalid selectors, unsupported languages, and ambiguous or conflicting duplicate application records. It dry-runsrun <app> cionly for applications with acimode andtestfor every application. With--executeit builds and runs instead, so every application's SDK and hardware prerequisites must be present.When a project declares both C++ and Python, an omitted
--languageselects Python and prints a notice on stderr. For a Module, 5.0.0buildandtestalso passHOLOSCAN_<MODULE>_BUILD_CPPandHOLOSCAN_<MODULE>_BUILD_PYTHON, so--language cppskips the Module's Python bindings.
Lint
holoscan lintruns pre-commit on all files from the root, and a path argument limits it to tracked and unignored files under that path. Hook environments are fetched on first use, so a blocked network fails before any check runs.holoscan-applications' metadata hook runs
python3fromPATHand needsholoscan_cliandjsonschema; outside the activatedrequirements.txtenvironment it fails with an import error.The copyright hook requires an Apache-2.0 SPDX identifier and the current UTC year in at least one notice of each changed file, comparing against
COPYRIGHT_BASE_REFwhen it is set. It reports errors without rewriting notices.
Containers and output
Container commands mount the checkout at the container path that the preview's
-voption shows, and each--add-volumepath at/workspace/volumes/<basename>. Host paths passed through--run-argsor--cmake-optionsdo not exist in the container.--forward-envforwards a value, not the file or directory it names. Check both the container path and its mount when diagnosing overrides.Display forwarding is auto-detected;
--ssh-x11and--enable-x11are deprecated. Exit zero does not prove correct pixels or recordings.Root operations can leave foreign-owned build, data, engine, or output files. Check ownership before editing source.
Module install, package, and consumers
install --devchanges the selected Python environment immediately; in a standalone Module, 5.0.0 runs it in the development container unless--localis passed, so a host consumer does not see it. Verify and uninstall with that same environment and exact build directory. It installs only hooks that a build staged asholoscan_<snake_name>_dev.py; the 5.0.0 Module template stages none, so its preview can announce an install that the real action rejects.package <module>honors the explicit module in 5.0.0 and a real action fails if that module produces no CPack configuration.WHEELneeds apyproject.tomlthat builds a wheel and the Pythonbuildpackage.In holoscan-applications,
application.dependencies.modules[]does not provide a Module by itself: the CLI writesexternal_operators_manifest.cmake, but the repository's root CMake does not include it, andHOLOSCAN_CLI_LOCAL_<NAME>overrides only change that manifest. A missing module package or target there points to the consumption path, not to the module source.The CLI parses
application.dependencies.modules[]on every build and run, including dry runs. An entry withoutsource.git_urland a full 40-charactersource.reffails withmissing source.git_url or source.ref, although metadata validation passes because the schema does not check these entries. Hosted CI'scidry run then fails too.A tree built in the development container records container paths, so run
cmake --installfor it inside that container rather than on the host.
Debian consumer prerequisites
An SDK import or SDK container does not prove that dpkg knows a package named
holoscan. The 5.0.0 module template declares
holoscan (>= <minimum-sdk-version>), the Debian alias of holoscan-cuda-13
on SDK 5.0 platforms. An SDK container can provide working libraries without
registering that package, as the SDK 4.6.0 CUDA 13 container did. For an
unconfigured module package, compare dpkg-deb --info with dpkg-query in
that consumer before changing producer code. Use the real declared SDK package
or report the format unverified; do not force dependencies or fabricate a
provider package.
Benchmark restoration
Flow-tracking instrumentation is a source change. A failed or killed run can leave tracing enabled or edits half-applied; compare with the recorded baseline.
A clean source diff does not remove instrumented binaries or cached CMake flags. Rebuild normally and rerun a finite smoke mode.
The flow runner refuses existing trial artifacts and fails on nonzero exits, timeouts, leftover processes, and empty logs, but it does not verify that the application honored the requested message count.
Analyzer trimming can leave no retained samples for short runs. Record the retained count and every filter rule.
Runner and analyzer short options differ; inspect both parsers.
Cache cleanup
clear-cachehas destructive-boundary guards, but clearing persisted artifacts remains destructive. It acts on every project under the root. Without--build,--data, or--installit removes all three, including prepared datasets.test --clear-cacheclears build and install folders.Use the narrowest preview, review every path, and obtain approval before removing build, data, or install trees.
A proved stale build from another image, branch, SDK, or user can justify
clear-cache --build; it is not a first-line diagnostic.
Requirements and compatibility
Works with: Claude Code, Claude apps, OpenAI Codex, GitHub Copilot, Cursor, Gemini CLI, Kiro, OpenCode, Goose, Amp, Roo Code, JetBrains Junie, Factory Droid, Devin (ex-Windsurf), Mistral Vibe, OpenHands, Letta
“Works with” means the tool reads the open Agent Skills format; a skill written for one tool may use features others lack.
Needs: Needs Python
Security
What our scanner noticed· Medium risk
- Large base64-encoded blobs
A static scan is not a guarantee. Skills are third-party content: review a skill before you let an agent use it.
Attribution and licence
- Created by
- Holoscan Team
- Publisher
- NVIDIA (Official)
- Distributed by
- NVIDIA
- Source
- NVIDIA/skills · skills/holoscan-app-debug-build-run · commit fce3cca
- Licence
- Apache License 2.0 (redistribution allowed)
- LICENSE (added by AutoGineer from LICENSE-APACHE)
- ATTRIBUTION.md (written by AutoGineer)
- Synced
AutoGineer is not affiliated with or endorsed by Holoscan Team or NVIDIA.
Download ZIP
The ZIP holds the skill’s files, its licence files and an ATTRIBUTION.md. Download holoscan-app-debug-build-run.zip