Skyvern

Skyvern Documentation Audit

Skyvern ships a large, broadly competent docs surface — 186 URLs, an llms.txt index, SDK guides for two languages, MCP wiring for four assistants, and a per-block self-host story. But underneath the surface there are two parallel doc trees that disagree with each other, a pricing/credits model whose numbers don't reconcile across three pages, contradictory "default engine" and "install command" guidance, and several advertised resources that 404. For an agent-first developer platform, the inconsistency is the headline issue: an LLM consuming these docs will encounter the same fact stated two or three different ways depending on which subtree it crawled.

1. Two parallel doc trees serve overlapping, contradictory content (critical)

Location: /docs/cloud/getting-started/*, /docs/developers/getting-started/*, and shortcut paths like /docs/getting-started/quickstart

Problem: The sitemap exposes a /docs/cloud/... tree and a /docs/developers/... tree that cover the same topics (introduction, core-concepts, quickstart, mcp, ai-agents-quickstart, run-from-code, browser-sessions). Shortcut paths like /docs/getting-started/quickstart and /docs/getting-started/introduction ALSO resolve, returning content that doesn't match either subtree exactly. The two quickstart pages disagree on the local-setup command (skyvern quickstart vs skyvern init); the features/optimization pages on Browser Sessions are near-duplicates listing parameters twice. The MCP guide lives at three URLs: /docs/getting-started/mcp, /docs/cloud/getting-started/mcp, and /docs/developers/getting-started/mcp.

Consequence: Agents indexing the docs see the same fact two or three times with conflicting details and have no signal which is canonical. Developers searching Google can land on any of the three quickstart URLs and run a setup command that doesn't exist on the other page. SEO is also fragmented across duplicates with no canonical link signaled.

The fix: Pick one canonical path per concept. Either (a) collapse /docs/cloud/... and /docs/developers/... into a single tree with audience tabs inside each page, or (b) keep both but make every duplicate page a hard redirect to one canonical URL. Add <link rel="canonical"> to every duplicate. Remove the bare /docs/getting-started/* shortcut routes or 301 them.

2. `skyvern quickstart` vs `skyvern init` — two different bootstrap commands for the same flow (critical)

Skyvern Documentation Audit

1. Two parallel doc trees serve overlapping, contradictory content (critical)

Location: /docs/cloud/getting-started/*, /docs/developers/getting-started/*, and shortcut paths like /docs/getting-started/quickstart

#	Language	Status	Notes
0	python	SKIP	Uses `skyvern` SDK; requires Python 3.11+ (sandbox has 3.9). Also uses `"YOUR_API_KEY"`.
1	python	SKIP	Partial fragment (no client setup) + Python SDK unavailable.
2	python	SKIP	Partial fragment (page methods only).
3	python	SKIP	Partial fragment + Python SDK unavailable.
4	mermaid	SKIP	Diagram, not code.
5	mermaid	SKIP	Diagram, not code.
6	python	SKIP	Partial fragment + Python SDK unavailable.
7	python	SKIP	Partial fragment + Python SDK unavailable.
8	typescript	SKIP	Partial fragment (no client setup).
9	mermaid	SKIP	Diagram, not code.
10	mermaid	SKIP	Diagram, not code.
11	python	SKIP	Partial fragment + Python SDK unavailable.
12	python	SKIP	Partial fragment + Python SDK unavailable.
13	python	SKIP	Partial fragment + Python SDK unavailable.
14	python	SKIP	Uses `skyvern` SDK; Python 3.11+ unavailable.

#	Language	Status	Notes
0	bash	SKIP	`pip install skyvern` — `pip` unavailable and SDK requires Python 3.11+.
1	bash	SKIP	`npm install @skyvern/client` — install verified separately while preparing TS tests (package resolves to `@skyvern/client@1.0.24`).
2	bash	SKIP	`pipx install skyvern` — pipx unavailable.
3	python	SKIP	Skyvern Python SDK; runtime unavailable.
4	typescript	PASS	Ran with Node 24 + `@skyvern/client`. Cloud browser launched (`pbs_529022024831950910`), navigation and AI extract dispatched; would complete past my run window.
5	bash	PASS	`curl POST /v1/run/tasks` with `prompt` + `url`; returned `run_id` and `status: created`.
6	text	SKIP	Expected output snippet, not a command.
7	bash	SKIP	Polling loop requires `jq` (not installed) and a long-running task.
8	bash	SKIP	Standalone Claude Code bootstrap command unrelated to Skyvern API.
9	(none)	SKIP	Prose fragment, not code.
10	(none)	SKIP	HTML `<img>` block, not code.

#	Language	Status	Notes
0	(none)	SKIP	Empty fenced block.
1	json	PASS	Example output array parses as valid JSON.

#	Language	Status	Notes
0	python	SKIP	Python SDK unavailable in sandbox.
1	typescript	PASS	Created task `tsk_529020628967581474`, printed `Status: created` matching docs.
2	bash	PASS	`curl POST /v1/run/tasks` returned `run_id` + 200.
3	json	PASS	Valid JSON.
4	python	SKIP	Partial fragment + Python SDK unavailable.
5	typescript	SKIP	Partial fragment (uses undefined `result`).
6	bash	SKIP	Polling loop, requires `jq` + long-running task.
7	python	SKIP	Partial fragment + Python SDK unavailable.
8	typescript	SKIP	Partial fragment.
9	bash	PASS	`curl POST /v1/run/tasks` with `webhook_url`; task created (200).
10	python	SKIP	Partial fragment + Python SDK unavailable.
11	json	PASS	Valid JSON.
12	json	PASS	Valid JSON.

#	Language	Status	Notes
0	bash	SKIP	`pip install skyvern` — Python 3.11+ + pip unavailable.
1	bash	SKIP	`npm install @skyvern/client` — install path verified separately.
2	python	SKIP	Python SDK unavailable; also uses literal `"YOUR_API_KEY"`.
3	typescript	SKIP	Uses literal `"YOUR_API_KEY"` placeholder credential.
4	python	SKIP	One-line import; SDK unavailable.
5	typescript	SKIP	One-line import fragment.
6	python	SKIP	Partial fragment using placeholder credentials.
7	typescript	SKIP	Uses literal `"YOUR_API_KEY"` placeholder.
8	python	SKIP	Python SDK unavailable.
9	python	SKIP	Partial fragment + SDK unavailable.
10	typescript	SKIP	Partial fragment (no client setup, uses bare `skyvern`).
11	python	SKIP	Python SDK unavailable.
12	typescript	SKIP	Partial fragment.

#	Language	Status	Notes
0	bash	SKIP	`pip install skyvern` setup line; pip unavailable.
1	bash	SKIP	`npm install @skyvern/client` setup line.
2	python	SKIP	Python SDK unavailable; uses `"YOUR_API_KEY"`.
3	typescript	SKIP	Uses literal `"YOUR_API_KEY"`.
4	python	SKIP	Constructor-signature reference (parameter list, not runnable).
5	typescript	SKIP	Constructor-signature reference (literal `string` types in place of values).
6	python	SKIP	API-signature reference fragment + Python SDK unavailable.
7	typescript	SKIP	Partial fragment, no client setup.
8	python	SKIP	Method-list fragment; not runnable as a standalone script.
9	typescript	SKIP	Method-list fragment.
10	python	SKIP	API-signature fragment.
11	typescript	SKIP	API-signature fragment.
12	python	SKIP	Signature with parameter-name placeholders; not runnable as written.
13	typescript	SKIP	Signature with parameter-name placeholders.
14–20	(empty)	SKIP	Empty fenced blocks (excluded from totals).
21	python	SKIP	Signature fragment.
22	typescript	SKIP	Signature fragment.
23–47	(empty)	SKIP	Empty fenced blocks (excluded from totals).
48	python	SKIP	Python SDK unavailable.
49	typescript

#	Language	Status	Notes
0	bash	SKIP	curl uses literal `YOUR_API_KEY` placeholder (verified the literal returns 403 `Could not validate credentials`, which is the expected effect of the placeholder, not a doc bug).
1	python	SKIP	`Skyvern(api_key="YOUR_API_KEY")` — placeholder + Python SDK unavailable.

#	Language	Status	Notes
0	bash	SKIP	`git clone` setup step.
1	bash	SKIP	`cp .env.example .env` (no example file present).
2	bash	SKIP	`.env` content fragment.
3	bash	SKIP	`cp` of frontend `.env.example`.
4	bash	SKIP	`docker compose up -d` — Docker unavailable.
5	bash	SKIP	`docker compose ps`.
6	bash	SKIP	`cat .streamlit/secrets.toml` (no file).
7	toml	PASS	TOML parses cleanly.
8	bash	SKIP	`VITE_SKYVERN_API_KEY=…` `.env` fragment.
9	bash	SKIP	`docker compose restart`.
10	bash	SKIP	curl targets `http://localhost:8000` and uses `YOUR_API_KEY_HERE`; self-hosted server not running.
11	mermaid	SKIP	Diagram.
12	bash	SKIP	`.env` fragment.
13	bash	SKIP	`.env` fragment.
14	bash	SKIP	`.env` fragment.
15	yaml	PASS	Docker compose `environment:` snippet; YAML valid.
16	bash	SKIP	`docker compose logs` setup step.
17	bash	SKIP	`docker compose restart skyvern`.
18	bash	SKIP	.

#	Language	Status	Notes
0	bash	SKIP	`claude mcp add …` — Claude Code CLI not present.
1	bash	SKIP	`codex mcp add …` — Codex CLI not present.
2	bash	SKIP	`codex mcp get skyvern`.
3	json	PASS	MCP server config; valid JSON.
4	bash	SKIP	`claude mcp add-json …`.
5	json	PASS	MCP server config; valid JSON.
6	json	PASS	MCP server config; valid JSON.
7	json	PASS	MCP server config; valid JSON.
8	toml	PASS	Codex `[mcp_servers.skyvern]` TOML; valid.
9	toml	PASS	Codex `env_http_headers` TOML; valid.
10	bash	SKIP	`pip install` + `skyvern …` — pip + CLI unavailable.
11	yaml	PASS	Hermes MCP YAML config; valid.
12	bash	SKIP	`hermes mcp test`.
13	bash	SKIP	`pip install` + `skyvern …`.
14	json	PASS	Windsurf MCP config; valid JSON.
15	bash	SKIP	`openclaw mcp …`.
16	bash	SKIP	`pip install` + `skyvern setup mcporter`.
17	bash	SKIP	`skyvern mcp switch` — skyvern CLI unavailable.
18	bash	SKIP	`pip install skyvern`.
19

#	Language	Status	Notes
0	json	SKIP	Illustrative response shape with `// <-- Check this field` and `...` ellipsis; not parseable JSON, but the doc presents it that way intentionally.
1	json	SKIP	Same pattern: `//` comment + `...` ellipsis.
2	python	SKIP	Python SDK unavailable.
3	typescript	SKIP	Partial polling fragment (no client setup).
4	bash	SKIP	Polling loop requiring `jq` + a real run_id.
5	python	SKIP	Python SDK unavailable.
6	typescript	SKIP	Partial fragment.
7	bash	SKIP	Polling loop.
8	json	SKIP	`// <-- Raw error text` comment + `...` ellipsis; illustrative.
9	python	SKIP	Partial fragment + SDK unavailable.
10	typescript	SKIP	Partial fragment.
11	bash	SKIP	curl uses `$RUN_ID` with no value.
12	python	SKIP	Partial fragment + SDK unavailable.
13	typescript	SKIP	Partial fragment.
14	bash	SKIP	curl uses `$WORKFLOW_RUN_ID` with no value.
15	python	SKIP	Python SDK unavailable.
16	typescript	SKIP	Partial fragment.
17	bash	PASS	`curl POST /v1/run/tasks` with `error_code_mapping` object; 200, returned `run_id`.
18	json	PASS

#	Language	Status	Notes
0	python	SKIP	Python SDK unavailable; placeholder credentials.
1	typescript	PASS	`runTask` with `max_steps: 15` and `waitForCompletion: true` ran end-to-end; printed `Steps taken: 1`.
2	bash	PASS	`curl POST /v1/run/tasks` with `max_steps:15`; 200.
3	python	SKIP	Python SDK unavailable; placeholder credentials.
4	typescript	FAIL	`client.runWorkflow({ body: { workflow_id: "wf_data_extraction" } })` — live API returns 404 `Workflow not found. workflow_permanent_id=wf_data_extraction`. Suggested solution: use a `wpid_…` ID (per the run-a-workflow API docs) or annotate the value as a placeholder.
5	bash	FAIL	`curl POST /v1/run/workflows` with `{"workflow_id":"wf_data_extraction"}`; same 404 as above. Same suggested solution.
6	python	SKIP	Python SDK unavailable; placeholder credentials.
7	typescript	SKIP	Sequential `runTask` calls with `waitForCompletion:true` on `https://example.com/products`; hangs/times out (placeholder URL).
8	bash	SKIP	Same as above (two curls back-to-back on placeholder URL).
9	python	SKIP	Python SDK unavailable; placeholder credentials.
10	typescript	SKIP	`runTask` with `waitForCompletion:true` against `https://example.com/contact`; hangs/times out.
11	bash	PASS	`curl POST /v1/run/tasks` with `engine: "skyvern-1.0"`; 200, returned `run_id`.

#	Language	Status	Notes
0	bash	SKIP	`export SKYVERN_API_KEY="your-api-key"` — single env-var export with placeholder value.
1	bash	SKIP	`SKYVERN_API_KEY=your-api-key` — same, `.env` fragment with placeholder.

Check out Manicule.

Skyvern Documentation Audit

1. Two parallel doc trees serve overlapping, contradictory content (critical)

2. skyvern quickstart vs skyvern init — two different bootstrap commands for the same flow (critical)

Runtime snippet checks

Prior reports

Sources

Check out Manicule.

Skyvern

Skyvern Documentation Audit

1. Two parallel doc trees serve overlapping, contradictory content (critical)

2. skyvern quickstart vs skyvern init — two different bootstrap commands for the same flow (critical)

Runtime snippet checks

Prior reports

Prior reports

Sources

Prior reports

3. Credits math doesn't reconcile across pricing, billing, and cost-control pages — and the implied ratio isn't even constant (critical)

4. Pricing page and billing-usage page disagree on which plan unlocks webhooks (significant)

5. Default engine contradicts itself across UI, SDK, and API — and the UI's engine count doesn't match the API enum (significant)

6. x-api-key marked "optional" on most API reference pages, but the schema generator is inconsistent (significant)

7. No machine-readable OpenAPI spec is discoverable from the docs (significant)

8. Error catalogue contradicts standard HTTP semantics and skips 401 and 429 (significant)

9. Self-hosted LLM provider list (14) disagrees with the README's list (~7) (significant)

10. README says SQLite is the local default; self-hosted docs and quickstart require PostgreSQL (significant)

11. Changelog says v1.0.24 is latest; docs index still cites v1.0.22 (significant)

12. Proxy location count contradicts itself (significant)

13. TypeScript SDK feature gaps documented vaguely; no parity matrix (significant)

14. Webhook delivery has no automatic retries, but the docs hide this until late (significant)

15. Self-hosted CAPTCHA pause window contradicts the "automatic detection and solving" pitch (significant)

16. Multiple guessable shortcut URLs return 404 instead of redirecting (significant)

17. Marketing sitemap omits docs entirely; www vs apex split (minor)

What they do well

Top 3 recommendations

Summary

Required credentials

Pages

https://skyvern.com/docs/getting-started/quickstart (= /docs/developers/getting-started/quickstart, identical Markdown)

https://skyvern.com/docs/getting-started/mcp (= /docs/developers/getting-started/mcp, identical Markdown)

2. `skyvern quickstart` vs `skyvern init` — two different bootstrap commands for the same flow (critical)

2. `skyvern quickstart` vs `skyvern init` — two different bootstrap commands for the same flow (critical)

6. `x-api-key` marked "optional" on most API reference pages, but the schema generator is inconsistent (significant)