Deepstream Sop

NVIDIAOfficialCreated by Wind YuanDistributed by NVIDIA

Skill
Tool integration
Software development
Link-only
Medium risk
Has scripts

From the author

Use this skill when building, deploying, evaluating, debugging, or measuring latency for the DeepStream SOP Inference Microservice — a GPU-accelerated FastAPI service that detects whether operators perform assembly-line steps in order via event boundary detection (GEBD) plus VLM classification. Trigger even if the user does not name it: verify operator step sequence, detect missing or out-of-order SOP steps, score factory/work-cell video for procedure compliance, run VLM-based SOP checking on industrial cameras, or call /v1/chat/completions with a file, RTSP, or Basler camera. Also trigger for its internals: SOPVideoProcessor, DeepStream GEBD model (e.g. DDM) via Triton CAPI, nvds_custom_postprocess, Cosmos Reason 1/2 vLLM, SSE streaming, Kafka NvProto/JSON output, Basler/Pylon camera + emulation, Docker compose, chunk-level latency. Do NOT trigger for generic DeepStream pipelines, object detection/tracking, NIM imports, or video summarization.

— the description by Wind Yuan

Install

Get the skill from its source (we cannot redistribute it):
https://github.com/NVIDIA/skills/tree/fce3cca4170be75e82c64920654d56ee2811b005/skills/deepstream-sop

Documentation by Wind Yuan

The licence of this skill does not allow us to copy its documentation. Read it at the source

Files

BENCHMARK.md(opens on GitHub)Not mirrored: opens on GitHub3.4 KiB
SKILL.md(opens on GitHub)Not mirrored: opens on GitHub19.2 KiB
configs/actions.json(opens on GitHub)Not mirrored: opens on GitHub1.3 KiB
configs/nvds_inference_template.txt(opens on GitHub)Not mirrored: opens on GitHub1.9 KiB
configs/nvds_preprocess_template.txt(opens on GitHub)Not mirrored: opens on GitHub2.9 KiB
configs/vlm_prompts.txt(opens on GitHub)Not mirrored: opens on GitHub2.0 KiB
evals/evals.json(opens on GitHub)Not mirrored: opens on GitHub9.7 KiB
references/Dockerfile_reference(opens on GitHub)Not mirrored: opens on GitHub8.7 KiB
references/Emulation_0815-0000.pfs(opens on GitHub)Not mirrored: opens on GitHub3.6 KiB
references/Makefile_custom_postprocess_reference(opens on GitHub)Not mirrored: opens on GitHub1.4 KiB
references/README_reference.md(opens on GitHub)Not mirrored: opens on GitHub6.1 KiB
references/compose_reference.yaml(opens on GitHub)Not mirrored: opens on GitHub9.1 KiB
references/copy_sources_reference.sh(opens on GitHub)ScriptNot mirrored: opens on GitHub1.4 KiB
references/ddm_net_reference.py(opens on GitHub)ScriptNot mirrored: opens on GitHub3.8 KiB
references/ddm_pytorch2.patch(opens on GitHub)Not mirrored: opens on GitHub2.6 KiB
references/eval_sop_prompt.md(opens on GitHub)Not mirrored: opens on GitHub877 B
references/example_sop_prompt.md(opens on GitHub)Not mirrored: opens on GitHub1.0 KiB
references/export_ddm_to_tensorrt_reference.py(opens on GitHub)ScriptNot mirrored: opens on GitHub24.5 KiB
references/ext.proto(opens on GitHub)Not mirrored: opens on GitHub5.9 KiB
references/ext_pb2_reference.py(opens on GitHub)ScriptNot mirrored: opens on GitHub5.1 KiB
references/license.txt(opens on GitHub)Not mirrored: opens on GitHub11.2 KiB
references/messager_reference.py(opens on GitHub)ScriptNot mirrored: opens on GitHub10.9 KiB
references/missing_number_detector_reference.py(opens on GitHub)ScriptNot mirrored: opens on GitHub21.5 KiB
references/nv.proto(opens on GitHub)Not mirrored: opens on GitHub12.0 KiB
references/nv_pb2_reference.py(opens on GitHub)ScriptNot mirrored: opens on GitHub16.1 KiB
references/nvds_custom_postprocess_tensor_reference.cpp(opens on GitHub)Not mirrored: opens on GitHub14.6 KiB
references/package_file_list_reference.txt(opens on GitHub)Not mirrored: opens on GitHub1.9 KiB
references/protos_init_reference.py(opens on GitHub)ScriptNot mirrored: opens on GitHub804 B
references/skill_01_fastapi_endpoints.md(opens on GitHub)Not mirrored: opens on GitHub16.3 KiB
references/skill_02_pydantic_schemas.md(opens on GitHub)Not mirrored: opens on GitHub5.8 KiB
references/skill_03_deepstream_pipeline.md(opens on GitHub)Not mirrored: opens on GitHub23.1 KiB
references/skill_04_config_templates.md(opens on GitHub)Not mirrored: opens on GitHub6.8 KiB
references/skill_05_triton_ddm_model.md(opens on GitHub)Not mirrored: opens on GitHub16.6 KiB
references/skill_05b_custom_postprocess.md(opens on GitHub)Not mirrored: opens on GitHub4.4 KiB
references/skill_06_sop_process_manager.md(opens on GitHub)Not mirrored: opens on GitHub46.7 KiB
references/skill_06b_sop_checker.md(opens on GitHub)Not mirrored: opens on GitHub16.1 KiB
references/skill_07_sse_streaming.md(opens on GitHub)Not mirrored: opens on GitHub5.5 KiB
references/skill_08_basler_camera.md(opens on GitHub)Not mirrored: opens on GitHub11.2 KiB
references/skill_09_docker_build_deploy.md(opens on GitHub)Not mirrored: opens on GitHub12.2 KiB
references/skill_10_test_suite.md(opens on GitHub)Not mirrored: opens on GitHub2.9 KiB
references/skill_11_env_variables.md(opens on GitHub)Not mirrored: opens on GitHub7.8 KiB
references/skill_12_evaluation_workflow.md(opens on GitHub)Not mirrored: opens on GitHub45.4 KiB
references/skill_13_verification_curl.md(opens on GitHub)Not mirrored: opens on GitHub4.0 KiB
references/skill_14_implementation_checklist.md(opens on GitHub)Not mirrored: opens on GitHub8.3 KiB
references/skill_15_latency_measurement.md(opens on GitHub)Not mirrored: opens on GitHub8.0 KiB
references/skill_16_message_schema.md(opens on GitHub)Not mirrored: opens on GitHub14.8 KiB
references/skill_17_camera_latency_measurement.md(opens on GitHub)Not mirrored: opens on GitHub12.0 KiB
references/skill_18_rtsp_streaming_output.md(opens on GitHub)Not mirrored: opens on GitHub23.9 KiB
references/sop_architecture.svg(opens on GitHub)Not mirrored: opens on GitHub16.4 KiB
references/sop_step_checker_reference.py(opens on GitHub)ScriptNot mirrored: opens on GitHub10.5 KiB
references/start_server.sh(opens on GitHub)ScriptNot mirrored: opens on GitHub1.2 KiB
references/test_api_endpoints_reference.py(opens on GitHub)ScriptNot mirrored: opens on GitHub23.1 KiB
references/triton_config_template.pbtxt(opens on GitHub)Not mirrored: opens on GitHub1.5 KiB
references/triton_model_reference.py(opens on GitHub)ScriptNot mirrored: opens on GitHub22.8 KiB
references/utils_reference.py(opens on GitHub)ScriptNot mirrored: opens on GitHub6.1 KiB
references/vllm_inference_reference.py(opens on GitHub)ScriptNot mirrored: opens on GitHub20.7 KiB
skill-card.md(opens on GitHub)Not mirrored: opens on GitHub4.2 KiB
skill.oms.sig(opens on GitHub)Not mirrored: opens on GitHub17.6 KiB

Requirements and compatibility

Works with: Claude Code, Claude apps, OpenAI Codex, GitHub Copilot, Cursor, Gemini CLI, Kiro, OpenCode, Goose, Amp, Roo Code, JetBrains Junie, Factory Droid, Devin (ex-Windsurf), Mistral Vibe, OpenHands, Letta

“Works with” means the tool reads the open Agent Skills format; a skill written for one tool may use features others lack.

Needs: Needs Python