Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Indicate that a workflow is fully "containerized" #225

Open
uniqueg opened this issue Aug 10, 2022 · 0 comments
Open

Indicate that a workflow is fully "containerized" #225

uniqueg opened this issue Aug 10, 2022 · 0 comments

Comments

@uniqueg
Copy link
Collaborator

uniqueg commented Aug 10, 2022

We recently had a "bring your own workflow" workshop for our GA4GH Cloud stack, and preparing for that, we were reminded that one can't just reliably run any workflow in the cloud via WES/TES. Dependencies need to be embedded in a workflow, unambiguously and for each step, either as a container image or a Conda package. Of course, having a fully "containerized" or "condarized" workflow still does not guarantee that the workflow will run on any WES or WES/TES stack - but it would arguably be a bare minimum requirement.

Currently, there is no way of knowing whether a workflow resource on TRS meets this requirement - one would have to run the workflow and inspect the error stack.

I don't think that evaluating whether a workflow has all dependencies embedded in this way is a job for TRS (probably similar to #224 in that respect). However, I still wanted to raise this issue to spark a discussion on how this might possibly be achieved. Perhaps this could feed into the discussion on #223 - which would allow users to report back usage stats/info. Depending on how such a solution might be designed, workflows and tools could be amended with important info on workflow validity, cloud compatibility etc.

┆Issue is synchronized with this Jira Story
┆Project Name: Zzz-ARCHIVE GA4GH tool-registry-service
┆Issue Number: TRS-61

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants