Cellular Genetics Informatics JupyterHub Docker Image

We support a Jupyter Hub server running on Sanger Cloud. Jupyter allows you to run your analysis in multiple environments (R, python, Julia, etc.) and also to create and share notebooks containing your analysis, code, equations and visualizations. We think this is an ideal environment for any kind of downstream analysis. For more details please refer to Jupyter Hub documentation.

Image hierarchy diagram

                    +------+
                    | base |
                    +------+
                        +
                        |
      +-----------------+------------------+
      |                 |                  | 
      V                 V                  V
  +-------+         +--------+         +--------+
  | julia |         | python |         | r-base |
  +-------+         +--------+         +--------+
                        +                  +
                        |                  |
                        |                  V
                        |              +--------+
                        +------------< | r-full |
                        |              +--------+
                        |                  +
                        |                  |
                        V                  V
                +---------------+     +----------+
                | python-r-full |     | teichlab |
                +---------------+     +----------+

Image content

base base image, contains the minimum to launch notebooks
python python image, contains most popular packages for python
julia julia image, contains most popular julia packages for julia
r-base R base image, contains R language kernel and R Studio with minimum packages
r-full R full image, contains most popular R packages for R
python-r-full Python and R full image, contains most popular packages for both Python and R.
teichlab custom image containing the Teichmann lab requirments

base

Operating system: Ubuntu focal 20.04.1 LTS
Additional packages:
- rclone v1.53.2
- go v1.15.3
- singularity v3.6.1
Python v3.8.6

python

Operating system: Ubuntu focal 20.04.1 LTS
Additional packages:
- rclone v1.53.2
- go v1.15.3
- singularity v3.6.1
Python v3.8.6
Python packages:
- cython
- cmake
- numpy
- python-igraph
- pandas
- louvain
- leidenalg
- scanpy
- scikit-learn
- matplotlib
- seaborn
- sccaf
- plotly
- scvi-tools
- bbknn
- h5py
- scvelo
- scirpy
- palantir
- velocyto
- pyscenic

julia

Operating system: Ubuntu focal 20.04.1 LTS
Additional packages:
- rclone v1.53.2
- go v1.15.3
- singularity v3.6.1
Python v3.8.6
Julia v1.5.2
Julia packages:
- IJulia
- CSV
- Gadfly
- RDatasets
- Distances
- StatsBase
- Hadamard
- HDF5
- JLD
- StatsBase
- Statistics
- Embeddings
- DataFrames
- GLM
- LsqFit
- Combinatorics
- Cairo

r-base

Operating system: Ubuntu focal 20.04.1 LTS
Additional packages:
- rclone v1.53.2
- go v1.15.3
- singularity v3.6.1
Python v3.8.6
Python packages:
- rpy2
R version 4.0.3 (2020-10-10) -- "Bunny-Wunnies Freak Out"
RStudio version 1.2.5019
R packages:
- IRkernel
- Rmagic
- BiocManager
- devtools

r-full

Operating system: Ubuntu focal 20.04.1 LTS
Additional packages:
- rclone v1.53.2
- go v1.15.3
- singularity v3.6.1
Python v3.8.6
Python packages:
- rpy2
R version 4.0.3 (2020-10-10) -- "Bunny-Wunnies Freak Out"
RStudio version 1.2.5019
R packages:
- IRkernel
- Rmagic
- BiocManager
- devtools
- tidyverse
- rJava
- umap
- ggplot2
- ggfortify
- igraph
- lsa
- uwot
- optparse
- Seurat
- SummarizedExperiment
- SingleCellExperiment
- DropletUtils
- LoomExperiment
- Rhdf5lib
- scater
- scran
- RUVSeq
- sva
- MultiAssayExperiment
- batchelor
- edgeR
- DESeq2
- BiocParallel
- SC3
- destiny
- pcaMethods
- zinbwave
- GenomicAlignments
- M3Drop
- switchde
- biomaRt
- Matrix.utils
- cellgeni/sceasy
- mojaveazure/loomR
- immunogenomics/harmony
- cole-trapnell-lab/leidenbase
- cole-trapnell-lab/monocle3

python-r-full

Operating system: Ubuntu focal 20.04.1 LTS
Additional packages:
- rclone v1.53.2
- go v1.15.3
- singularity v3.6.1
Python v3.8.6
Python packages:
- cython
- cmake
- numpy
- python-igraph
- pandas
- louvain
- leidenalg
- scanpy
- scikit-learn
- matplotlib
- seaborn
- sccaf
- plotly
- scvi-tools
- bbknn
- h5py
- scvelo
- scirpy
- palantir
- velocyto
- pyscenic
- scrublet
- scanorama
- rpy2
R version 4.0.3 (2020-10-10) -- "Bunny-Wunnies Freak Out"
RStudio version 1.2.5019
R packages:
- IRkernel
- Rmagic
- BiocManager
- devtools
- tidyverse
- rJava
- umap
- ggplot2
- ggfortify
- igraph
- lsa
- uwot
- optparse
- Seurat
- SummarizedExperiment
- SingleCellExperiment
- DropletUtils
- LoomExperiment
- Rhdf5lib
- scater
- scran
- RUVSeq
- sva
- MultiAssayExperiment
- batchelor
- edgeR
- DESeq2
- BiocParallel
- SC3
- destiny
- pcaMethods
- zinbwave
- GenomicAlignments
- M3Drop
- switchde
- biomaRt
- Matrix.utils
- cellgeni/sceasy
- mojaveazure/loomR
- immunogenomics/harmony
- cole-trapnell-lab/leidenbase
- cole-trapnell-lab/monocle3

teichlab

Operating system: Ubuntu focal 20.04.1 LTS
Additional packages:
- rclone v1.53.2
- go v1.15.3
- singularity v3.6.1
- samtools
- bcftools
- bedtools
Python v3.8.6
Python packages:
- numpy
- cython
- python-igraph
- pandas
- louvain
- leidenalg
- gpy
- scanpy
- scikit-learn
- matplotlib
- snakemake
- cmake
- sccaf
- pytest
- plotly
- ggplot
- scvi-tools
- bbknn
- h5py
- velocyto
- spatialde
- scvelo
- wot
- cellphonedb
- pyscenic
- scirpy
- palantir
- rpy2
R version 4.0.3 (2020-10-10) -- "Bunny-Wunnies Freak Out"
RStudio version 1.2.5019
R packages:
- IRkernel
- Rmagic
- BiocManager
- devtools
- tidyverse
- rJava
- umap
- ggplot2
- ggfortify
- igraph
- lsa
- uwot
- optparse
- Seurat
- SummarizedExperiment
- SingleCellExperiment
- DropletUtils
- LoomExperiment
- Rhdf5lib
- scater
- scran
- RUVSeq
- sva
- MultiAssayExperiment
- batchelor
- edgeR
- DESeq2
- BiocParallel
- SC3
- destiny
- pcaMethods
- zinbwave
- GenomicAlignments
- M3Drop
- switchde
- biomaRt
- Matrix.utils
- cellgeni/sceasy
- mojaveazure/loomR
- immunogenomics/harmony
- cole-trapnell-lab/leidenbase
- cole-trapnell-lab/monocle3
- vcfR
- car
- ggpubr
- SoupX
- velocyto-team/velocyto.R
- im3sanger/dndscv

Build order

Order is taken from images/build_list.txt

Build images

Each image is build using a TAG argument.

docker build --build-arg tag_name=$TAG --build-arg parent_image=$PARENT_NAME --tag "$REGISTRY:$IMAGE-$TAG" .

All images can be build at the same time by runnning images/build_parallel

Developer instructions

These are docker images for Cellular Genetics Informatics JupyterHub installation that are based on docker-stacks and used with Zero to JupyterHub with Kubernetes for scientific analysis.

⚠️ images contain poststart scripts that run when the instance is launched and may override default files such as .condarc and .Rprofile from the home directory.

Updating JupyterHub on k8s

Clone the private repository with Cellgeni JupyterHub settings:

git clone  https://gitlab.internal.sanger.ac.uk/cellgeni/kubespray/
cd kubespray/sanger/sites

Add the new user's Github username to auth.whitelist.users or change Docker image at singleuser.image.tag in jupyter-large-config.yaml.
Commit and push your changes so that your colleagues do not override your changes in the following upgrades

git add jupyter-large-config.yaml && git commit -m "Add new users" && git push

Upgrade Jupyter with

helm upgrade jptl jupyterhub/jupyterhub --namespace jptl --version 0.8.0 --values jupyter-large-config.yaml

Wait until the hub's state switches into Running. Monitor through kubectl get pods -n jptl.

User instructions

In your browser go to https://jupyter.cellgeni.sanger.ac.uk.
Use your Github credentials for authentication. It may take some time to load first time.
Now you are ready to run your notebooks!

Read the docs for Cellgeni JupyterHub

Resources

At the moment by default every user is given 50GB (guaranteed) to 200GB (maximum, if available) of RAM and 1 (guaranteed) to 16 (maximum, if available) CPUs. Default storage volume is 100G.

Important notes

JupyterHub environment and storage are not backed up
Keep your notebooks light. Notebooks over 100MB will give you unexpected errors.

Name		Name	Last commit message	Last commit date
Latest commit History 59 Commits
config		config
images		images
poststart		poststart
.gitignore		.gitignore
Dockerfile		Dockerfile
LICENSE		LICENSE
README.md		README.md
poststart.sh		poststart.sh

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Repository files navigation

Cellular Genetics Informatics JupyterHub Docker Image

Image hierarchy diagram

Image content

base

python

julia

r-base

r-full

python-r-full

teichlab

Build order

Build images

Developer instructions

Updating JupyterHub on k8s

User instructions

Resources

Important notes

About

Releases 1

Packages

Languages

License

cellgeni/jupyter-images

Folders and files

Latest commit

History

Repository files navigation

Cellular Genetics Informatics JupyterHub Docker Image

Image hierarchy diagram

Image content

base

python

julia

r-base

r-full

python-r-full

teichlab

Build order

Build images

Developer instructions

Updating JupyterHub on k8s

User instructions

Resources

Important notes

About

Resources

License

Stars

Watchers

Forks

Releases 1

Packages 0

Languages

Packages