Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Compliance checker output no longer appears in pipeline log #233

Open
mhidas opened this issue Apr 12, 2021 · 1 comment
Open

Compliance checker output no longer appears in pipeline log #233

mhidas opened this issue Apr 12, 2021 · 1 comment
Labels

Comments

@mhidas
Copy link
Contributor

mhidas commented Apr 12, 2021

Originally, when a file fails the compliance checks, the output from the checker detailing issues with the file used to be included in the pipeline logs, like this:

2020-05-04 11:24:30,000 ERROR tasks.ANMN_NRS_BGC[c50a3498-1663-4a40-8c76-a2d667aba5d0] log for failed file 'IMOS_ANMN-NRS_CDEKOSTUZ_20190118T005755Z_NRSNSI_FV01_Profile-SBE19plus_C-20190916T235239Z.nc'


------------------------------------------------------------------------------------------------------------------------
                                             IOOS Compliance Checker Report                                             
                                                        imos:1.4                                                        
                   http://content.aodn.org.au/Documents/IMOS/Conventions/IMOS_NetCDF_Conventions.pdf                    
------------------------------------------------------------------------------------------------------------------------
                                                   Corrective Actions                                                   
IMOS_ANMN-NRS_CDEKOSTUZ_20190118T005755Z_NRSNSI_FV01_Profile-SBE19plus_C-20190916T235239Z.nc has 1 potential issue


                                                        Required                                                        
------------------------------------------------------------------------------------------------------------------------
Name       Reasoning
abstract:  Global attribute 'abstract' missing.
2020-05-04 11:24:30,000 ERROR tasks.ANMN_NRS_BGC[c50a3498-1663-4a40-8c76-a2d667aba5d0] ComplianceCheckFailedError: the following files failed the check step: ['IMOS_ANMN-NRS_CDEKOSTUZ_20190118T005755Z_NRSNSI_FV0
0_Profile-SBE19plus_C-20190916T235239Z.nc', 'IMOS_ANMN-NRS_CDEKOSTUZ_20190118T005755Z_NRSNSI_FV01_Profile-SBE19plus_C-20190916T235239Z.nc']

These lines are still appearing in some pipeline logs, but I've found several cases where they are missing, e.g. tasks.ANMN_WA[1c0fc565-74fc-4d88-a5ce-5a6da8394625]. This means a file is failing the checks, but it's not easy to see what the problem is from the log.

@mhidas
Copy link
Contributor Author

mhidas commented Nov 2, 2021

See tasks.DWM_SOTS[27fe365b-bc71-4d9f-97bf-e1ac3619079c] for another example

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant