Skip to content

[skills] Check Sandbox guidance against canonical source - #379

Closed
erulkey wants to merge 2 commits into
mainfrom
elisabeth/sandbox-source-check-20261102
Closed

erulkey wants to merge 2 commits into
mainfrom
elisabeth/sandbox-source-check-20261102

Conversation

@erulkey

@erulkey erulkey commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Superseded approach: use the existing Monday/Thursday drift agent, configured in vercel-labs/vercel-plugin-eve-agent#24 to pull vercel/sandbox:skills/sandbox. That workflow can open reviewed sync PRs. This separate daily detection job is no longer the proposed rollout.

The plugin can pass its local generation check while its bundled Sandbox skill is behind vercel/sandbox. Add a separate daily/manual source check that compares the full canonical skill directory, then verifies the generated skill and copied references against the plugin's overlay and bundled source.

The workflow records the canonical commit and lists changed, missing, or extra files. It is read-only and does not make unrelated PR checks depend on a moving upstream branch. Update the README's Sandbox source link and document the local command and review steps.

The bundled skill currently differs from the canonical source, so the freshness workflow will report that existing drift until a reviewed sync. This PR adds detection; it does not replace or restructure either skill. Scheduling starts after merge. This checks source equivalence; structural skill validation remains part of normal CI.

Validation: 14 focused tests passed, including CLI exit statuses and checks that files remain unchanged. A fresh canonical checkout reports the expected drift; a disposable synced copy built with the existing generator passes. Build, typecheck, skill validation and workflow YAML checks passed. Hosted build-and-test CI passed for 370ab27. An earlier local full-suite run hit a timeout in the existing telemetry harness test. The scheduled source workflow itself remains untested in GitHub before merge.

@vercel
vercel Bot requested a review from molebox November 3, 2026 04:58
@erulkey erulkey closed this Nov 3, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant