SoftProbe CLI

Appearance

Example: Diagnose a failed replay ​

Audience: AI agent skill (OpenCode, Claude Code, Codex)

Goal: Given a failing replay plan, find failed cases, fetch diff artifact, optionally inspect record logs.

Prerequisites ​

bash
export SP_API_URL=http://127.0.0.1:8090
export SP_TOKEN=<jwt>

Steps ​

1. Confirm backend and list apps ​

bash
sp health --json
sp app list --json

Select appId from data.items[].appId.

2. Find the plan ​

If the user supplied planId, skip. Otherwise:

bash
sp app replays my-app --limit 5 --json

3. List failed cases ​

bash
sp replay case list --plan plan-xyz --failed --page 1 --limit 20 --json

From each item collect diffId, replayId, planItemId, traceId.

4. Fetch diff (artifact) ​

bash
sp replay diff get diff-abc --out-dir .sp-work --json

Parse data.artifact and read the JSON file in a follow-up tool call. Inspect baseMsg vs testMsg.

5. Optional: record logs ​

When failure may be agent-side (no recording, incomplete trace):

bash
sp record logs overview --trace-id <traceId> --json
sp record logs download --trace-id <traceId> --out-dir .sp-work --json

6. Optional: metadata for full-link ​

bash
sp replay metadata <replayId> --json

Use data.fullLink to decide if sp replay compare needs traceId.

Skill prompt snippet ​

markdown
When diagnosing SoftProbe replay failures:
1. Run `sp replay case list --plan <id> --failed --json`
2. For each diffId: `sp replay diff get <id> --out-dir .sp-work --json`
3. Read the artifact file path from JSON; do not parse multi-MB stdout
4. If traceId unknown, ask user for business ID and run `sp trace find`