Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Data Extraction prints unnecessary logs slowing it down [Scott] #2

Open
RoyMudie opened this issue Nov 23, 2021 · 0 comments
Open

Data Extraction prints unnecessary logs slowing it down [Scott] #2

RoyMudie opened this issue Nov 23, 2021 · 0 comments

Comments

@RoyMudie
Copy link

Version: 4.2.4
Instance: NHS instance
Pipeline: See attached screenshots
Reproduce:
Extract big amount of data (30+ million) from one catalogue
Behaviour: RDMP logs the same message once for each batch
"eventType:OnInformation
description:You have chosen the following columns to be ignored: TestReportID, LabNumber, TestIdentifier, record_id, SCAN_REF_NO, script_id, SpecimenNo
source:HICPluginInteractive.DataFlowComponents.CHIColumnFinder
time:23/03/2021 17:29:00"
Expected behaviour: Print the message once only for the whole extraction

image

image

Zsolt Szarka added a comment - 25/Mar/21 9:07 AM
The issue has just been emailed to: "[email protected]", with subject: "(RDMPSUP-153) Data Extraction prints unnecessary logs slowing it down ", attachment(s): "CHI Column Finder.png" , "Pipeline Source.png" and content:

Could you please check the description is correct, and let me know if I missed anything
Roy Mudie added a comment - 03/Nov/21 3:57 PM
Note: possibly part of HICPlugin componenet

https://jira.hic.dundee.ac.uk/browse/RDMPSUP-153

@RoyMudie RoyMudie changed the title Data Extraction prints unnecessary logs slowing it down Data Extraction prints unnecessary logs slowing it down [Scott] Nov 23, 2021
@tznind tznind transferred this issue from HicServices/RDMP Nov 23, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant