-
Notifications
You must be signed in to change notification settings - Fork 148
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
records: CMS 2016 SIM record skeletons #3692
base: master
Are you sure you want to change the base?
records: CMS 2016 SIM record skeletons #3692
Conversation
This commit introduces CMS 2016 SIM record skeletons containing only persistent identifiers (title, record ID, DOI). The full record content is not stored in this Git repository due to its size (2.3 GB). The records are available in a separate tarball located at `/eos/opendata/cms/upload/tibor/cms-2016-sim-20241025.zip`. Closes cernopendata#3667
dc7a96e
to
b25cc21
Compare
Check also record skeletons with respect to the record ID and the DOI uniqueness. Closes cernopendata#3667
b25cc21
to
952b104
Compare
68bea91
to
e9c16fc
Compare
a85308f
to
7a66f99
Compare
Introduces several independent `run-tests.sh` fixture-checking commands in order to speed up fixture checking by parallelisation. Renames `run-tests.sh` script options and CI rules to better separate data checks, formatting checks and linting checks. Adds data formatting checks and fixes several JSON data files. Adds `shfmt` formatting checks, `commitlint`, flake8` and `yamllint` linting checks. Removes `pydocstyle` formating checks since we moved to `black` code formatter. Introduces `/run-tests.sh --help` explaining all the checking options. Updates CI environment to Ubuntu 24.04 and latest actions (`actions/checkout@v4`, `actions/setup-node@v4`, `actions/setup-python@v5`). Amends `.editorconfig` to add rules for shell scripts and remove rules for ReST files that are no longer needed after switch to Markdown. BREAKING CHANGE: Refactors `run-tests.sh` script options.
7a66f99
to
83b22ec
Compare
Thanks for the ticket. What about putting the content of those entries on a different github repo, something like opendata_cms_2016? And we could do the same thing for the 40k entries that are not on any repo. Then, on top of that, the current skeleton file is very big (220k lines). What about splitting it in multiple files, |
feat(skeletons): add CMS 2016 SIM record skeletons
This commit introduces CMS 2016 SIM record skeletons containing only
persistent identifiers (title, record ID, DOI). The full record content
is not stored in this Git repository due to its size (2.3 GB). The
records are available in a separate tarball located at
/eos/opendata/cms/upload/tibor/cms-2016-sim-20241025.zip
.ci(check-fixtures): check also record skeletons for persistent IDs
Check also record skeletons with respect to the record ID and the DOI
uniqueness.
ci(check-fixtures): parallelise fixture checking commands
Introduces several independent
run-tests.sh
fixture-checking commandsin order to speed up fixture checking by parallelisation.
Renames
run-tests.sh
script options and CI rules to better separatedata checks, formatting checks and linting checks.
Adds data formatting checks and fixes several JSON data files.
Adds
shfmt
formatting checks,commitlint
, flake8and
yamllint`linting checks.
Removes
pydocstyle
formating checks since we moved toblack
codeformatter.
Introduces
/run-tests.sh --help
explaining all the checking options.Updates CI environment to Ubuntu 24.04 and latest actions
(
actions/checkout@v4
,actions/setup-node@v4
,actions/setup-python@v5
).Amends
.editorconfig
to add rules for shell scripts and remove rulesfor ReST files that are no longer needed after switch to Markdown.
BREAKING CHANGE: Refactors
run-tests.sh
script options.Closes #3667