Tutorial project for setting up devops flows for data engineers & scientists
Contains commands used locally and in CI/CD flow
- make install
- make init-local
Pipenv is now setup.
Use pipenv shell or pipenv run pytest Dependencies via Pipfile & Pipfile.lock
Can be pushed to:
- requirements.txt
- requirements-dev.txt
Hooks that check that all depencies are in order before pushing
pre-commit install pre-commit run --all-files
setup.py, setup.cfg and .bumpversion.cfg to keep all versions and metadata condensed
CI/CD flow
When a release is abandoned sometimes the tag is not removed. to fix it
git push --delete origin v[version]
- Not working on windows?
- Issues solved linux (yampl, lak, setuptools)?
- R&D best practices (setup.py deprecated?)
- Poetry?
- Pipenv via makefile, not pycharm
- pre-commit install
- java version check (issues v17?)
- Update github actions versions?
- share/switch multiple screens