Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

integration QC workflow #795

Draft
wants to merge 91 commits into
base: main
Choose a base branch
from
Draft

integration QC workflow #795

wants to merge 91 commits into from

Conversation

dorien-er
Copy link
Contributor

Changelog

... Describe your changes ...

Issue ticket number and link

Closes #xxxx (Replace xxxx with the GitHub issue number)

Checklist before requesting a review

  • I have performed a self-review of my code

  • Conforms to the Contributor's guide

  • Check the correct box. Does this PR contain:

    • Breaking changes
    • New functionality
    • Major changes
    • Minor changes
    • Documentation
    • Bug fixes
  • Proposed changes are described in the CHANGELOG.md

  • CI tests succeed!

dorien-er and others added 30 commits March 6, 2024 11:16
* add script to download scgpt test resources

* Update resources_test_scripts/scgpt.sh

Co-authored-by: Dries Schaumont <[email protected]>

* add drive folders containing data and model

* chmod +x

---------

Co-authored-by: Dries Schaumont <[email protected]>
dorien-er and others added 28 commits April 18, 2024 16:16
Co-authored-by: Dries Schaumont <[email protected]>
* add module for scgpt padding and tokenization

* remove base requirement

* update changelog

* update component name

* expand unit tests, update script with loggers and todo

* fix unit tests

* remove annotation script

* run tests with subsampled data

* use specific model input files instead of directory

* remove unused binning script

* update layer names and handling

* Add script to download scgpt test resources (#750)

* add script to download scgpt test resources

* Update resources_test_scripts/scgpt.sh

Co-authored-by: Dries Schaumont <[email protected]>

* add drive folders containing data and model

* chmod +x

---------

Co-authored-by: Dries Schaumont <[email protected]>

* preproc script

* preproc script

* tokenize and pad script

* tokenize and pad script

* embedding script

* test resourcers and evaluation script

* cross check gene set

* Fix retag for viash-hub not using correct namespace separator (#745)

* CI - Build: Fix second occurance of namespace separator (#746)

* script to download scgpt test data

* remove test resources script

* pad_tokenize module

* updat image

* remove test resources, update inputs

* use pytorch image

* remove integration component

* remove nvidia reqs

* remove load_model option

* adjust preprocessing script

* add scgpt full preproc module

* integration submodule

* integration submodule and add normalize_total flag

* add params

* update scanpy version

* remove branch irrelevant scripts

* update output handling

* update unit tests, add output compression

* update key name input output

* fix test

* update unit tests

* Update CHANGELOG.md

Co-authored-by: Dries Schaumont <[email protected]>

* add pars to logging

---------

Co-authored-by: Dries Schaumont <[email protected]>
* base script and config added

* config extended + logger set up + tests in progress

* config working + script improved + tests in progress

* exception handling, extended tests

* extended tests + better logging

* changelog entry added

* test resource path in config fixed

* python test setup added to config

* PR comments fixed

* updated to use subset data

* remove batch id column logic

* update authors

* resources, tests and dependencies fixes

* update key name input output

* update key name input output

* update var gene names

* update config

* compression param added + minor fixes

---------

Co-authored-by: dorien-er <[email protected]>
Co-authored-by: DriesSchaumont <[email protected]>
@dorien-er dorien-er changed the title Integration qc integration QC workflow Apr 30, 2024
Base automatically changed from scgpt to main June 14, 2024 13:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants