Repository navigation
flyte-migrate: add plugins and troubleshoot skills, fix migration guidance from flytesnacks runs - #51
Merged
Conversation
…on guidance Migrating the flytesnacks examples to Flyte 2 by following the flyte-migrate* skills, then running them on a real cluster, surfaced wrong example code and missing guidance. This fixes both: - Add flyte-migrate-plugins: flytekitplugins-* to flyteplugins-* mapping, integrations with no v2 plugin and their replacements, and the three ways a v2 plugin attaches to a task. - Add flyte-migrate-troubleshoot: an error-text index of the failures seen in freshly migrated code, plus a compile -> --local -> remote debug loop. - Fix wrong examples: obstore Bytes has no .decode(), sub-task errors arrive as RuntimeUserError, Image.from_base needs .clone(extendable=True), cache_version maps to behavior="override", FixedRate takes integer minutes. - Cover depends_on (and cycles), sync/async calls, flyte.map partials, wrapping pd.DataFrame, np.ndarray via File, and the Slurm connector. - Static eval scenarios for the two new skills; README skill counts. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Alex Wu <c.alexwu@gmail.com>
cosmicbboy
approved these changes
Oct 29, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
To measure the
flyte-migrate*skills, every Flyte 1 example inflyteorg/flytesnacks(c9b2c44d, 61 folders) was migrated to Flyte 2 by following only these skills, then run on a real cluster (dogfood-gcp,flyte2.12.1). Each first-run failure was traced to a root cause. This PR fixes what those runs showed was wrong or missing in the skills, and adds two new skills about error handling.Optimization result
Run 1 used the skills as released in 0.1.0. The latest run used exactly the skills in this PR. Each run migrated everything from scratch, starting from the v1 source.
Run mode (submitted to the cluster with
flyte run):