Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Performance when reading large .mat file with nested structs #163

Closed
aitorperezzz opened this issue Mar 5, 2021 · 3 comments
Closed

Performance when reading large .mat file with nested structs #163

aitorperezzz opened this issue Mar 5, 2021 · 3 comments

Comments

@aitorperezzz
Copy link

Hi, I am trying to read a large .mat file (approximately one gig) on Linux and I am seeing that accessing variables inside nested structs takes a long time (about 15 seconds when the nesting level is around 3). Is this to be expected? Is there any way to improve performance?

I can provide versions of the library, compiler, os and general environment if needed.

@aitorperezzz aitorperezzz changed the title General question about performance when reading large .mat file with nested structs Performance when reading large .mat file with nested structs Mar 5, 2021
@tbeu
Copy link
Owner

tbeu commented Mar 6, 2021

See also #55, #65 and #140. I am afraid it is the best we can achieve currently.

Can you run

/usr/bin/time -f "%es %MK" ./tools/matdump file.mat > log1.txt
/usr/bin/time -f "%es %MK" ./tools/matdump -d file.mat > log2.txt

and provide the stdout. If you have a simple m script to create such a MAT file in MATLAB I would be interested, too.

I also created https://github.com/tbeu/matioPerformance (on Win OS only) to compare MAT file reading, but it is not up to date regarding the version of libmatio.dll.

@tbeu tbeu added the duplicate label Mar 19, 2021
@tbeu
Copy link
Owner

tbeu commented Mar 19, 2021

Closing as duplicate of #65.

@tbeu tbeu closed this as completed Mar 19, 2021
@tbeu
Copy link
Owner

tbeu commented Oct 21, 2023

@aitorperezzz FYI: https://github.com/tbeu/matioPerformance is updated to the upcoming libmatio v1.5.24.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants