asammdf

ASAM MDF measurement data file parser

These details have not been verified by PyPI

Project links

Homepage

GitHub Statistics

View statistics for this project via Libraries.io, or by using our public dataset on Google BigQuery

Project description

asammdf is a fast parser/editor for ASAM (Associtation for Standardisation of Automation and Measuring Systems) MDF (Measurement Data Format) files.

asammdf supports both MDF version 3 and 4 formats.

asammdf works on Python 2.7, and Python >= 3.4

Project goals

The main goals for this library are:

to be faster than the other Python based mdf libraries
to have clean and easy to understand code base

Features

read sorted and unsorted MDF v3 and v4 files
files are loaded in RAM for fast operations
handle large files (exceeding the available RAM) using load_measured_data = False argument
extract channel data, master channel and extra channel information as Signal objects for unified operations with v3 and v4 files
time domain operation using the Signal class
- Pandas data frames are good if all the channels have the same time based
- usually a measuremetn will have channels from different sources at different rates
- the Signal class facilitates operations with such channels
remove data group by index or by specifing a channel name inside the target data group
create new mdf files from scratch
append new channels
filter a subset of channels from original mdf file
cut measurement to specified time interval
convert to different mdf version
export to Excel, HDF5, Matlab and CSV
merge multiple files sharing the same internal structure
add and extract attachments
mdf 4.10 zipped blocks
mdf 4 structure channels

Major features not implemented (yet)

for version 3
- functionality related to sample reduction block (but the class is defined)
for version 4
- handling of bus logging measurements
- handling of unfinnished measurements (mdf 4)
- full support mdf 4 channel arrays
- xml schema for TXBLOCK and MDBLOCK
- partial conversions
- event blocks

Usage

Check the examples folder for extended usage demo.

Documentation

http://asammdf.readthedocs.io/en/latest

Installation

asammdf is available on

github: https://github.com/danielhrisca/asammdf/
PyPI: https://pypi.org/project/asammdf/

Dependencies

asammdf uses the following libraries

numpy : the heart that makes all tick
numexpr : for algebraic and rational channel conversions
matplotlib : for Signal plotting
wheel : for installation in virtual environments

optional dependencies needed for exports

pandas : for DataFrame export
h5py : for HDF5 export
xlsxwriter : for Excel export
scipy : for Matlab .mat export

Benchmarks

Python 3 x86

Benchmark environment

3.6.1 (v3.6.1:69c0db5, Mar 21 2017, 17:54:52) [MSC v.1900 32 bit (Intel)]
Windows-10-10.0.14393-SP0
Intel64 Family 6 Model 94 Stepping 3, GenuineIntel
16GB installed RAM

Notations used in the results

nodata = asammdf MDF object created with load_measured_data=False (raw channel data not loaded into RAM)
compression = mdfreader mdf object created with compression=blosc
compression bcolz 6 = mdfreader mdf object created with compression=6
noDataLoading = mdfreader mdf object read with noDataLoading=True

Files used for benchmark:

183 groups
36424 channels

Open file	Time [ms]	RAM [MB]
asammdf 2.5.4 mdfv3	898	289
asammdf 2.5.4 nodata mdfv3	631	121
mdfreader 0.2.6 mdfv3	3431	460
mdfreader 0.2.6 compression mdfv3	4722	184
mdfreader 0.2.6 compression bcolz 6 mdfv3	4624	940
mdfreader 0.2.6 noDataLoading mdfv3	1824	120
asammdf 2.5.4 mdfv4	1943	333
asammdf 2.5.4 nodata mdfv4	1547	153
mdfreader 0.2.6 mdfv4	6326	881
mdfreader 0.2.6 compression mdfv4	7354	594
mdfreader 0.2.6 compression bcolz 6 mdfv4	7379	1303
mdfreader 0.2.6 noDataLoading mdfv4	4343	530

Save file	Time [ms]	RAM [MB]
asammdf 2.5.4 mdfv3	434	293
asammdf 2.5.4 nodata mdfv3	461	128
mdfreader 0.2.6 mdfv3	8901	483
mdfreader 0.2.6 noDataLoading mdfv3	10331	483
mdfreader 0.2.6 compression mdfv3	9247	450
mdfreader 0.2.6 compression bcolz 6 mdfv3	8775	941
asammdf 2.5.4 mdfv4	687	339
asammdf 2.5.4 nodata mdfv4	775	162
mdfreader 0.2.6 mdfv4	6943	901
mdfreader 0.2.6 noDataLoading mdfv4	8039	901
mdfreader 0.2.6 compression mdfv4	7061	860
mdfreader 0.2.6 compression bcolz 6 mdfv4	6811	1320

Get all channels (36424 calls)	Time [ms]	RAM [MB]
asammdf 2.5.4 mdfv3	754	298
asammdf 2.5.4 nodata mdfv3	18535	134
mdfreader 0.2.6 mdfv3	79	460
mdfreader 0.2.6 nodata mdfv3	108596	333
mdfreader 0.2.6 compression mdfv3	673	188
mdfreader 0.2.6 compression bcolz 6 mdfv3	298	942
asammdf 2.5.4 mdfv4	759	339
asammdf 2.5.4 nodata mdfv4	20622	163
mdfreader 0.2.6 mdfv4	78	880
mdfreader 0.2.6 nodata mdfv4	155000	752
mdfreader 0.2.6 compression mdfv4	677	602
mdfreader 0.2.6 compression bcolz 6 mdfv4	322	1310

Convert file	Time [ms]	RAM [MB]
asammdf 2.5.4 v3 to v4	5772	693
asammdf 2.5.4 v3 to v4 nodata	28056	486
asammdf 2.5.4 v4 to v3	5828	692
asammdf 2.5.4 v4 to v3 nodata	32825	630

Merge files	Time [ms]	RAM [MB]
asammdf 2.5.4 v3	13135	1220
asammdf 2.5.4 v3 nodata	52395	336
asammdf 2.5.4 v4	15282	1259
asammdf 2.5.4 v4 nodata	59918	359

Python 3 x64

Benchmark environment

3.6.2 (v3.6.2:5fd33b5, Jul 8 2017, 04:57:36) [MSC v.1900 64 bit (AMD64)]
Windows-10-10.0.14393-SP0
Intel64 Family 6 Model 94 Stepping 3, GenuineIntel
16GB installed RAM

Notations used in the results

nodata = asammdf MDF object created with load_measured_data=False (raw channel data not loaded into RAM)
compression = mdfreader mdf object created with compression=blosc
compression bcolz 6 = mdfreader mdf object created with compression=6
noDataLoading = mdfreader mdf object read with noDataLoading=True

Files used for benchmark:

183 groups
36424 channels

Open file	Time [ms]	RAM [MB]
asammdf 2.5.4 mdfv3	744	368
asammdf 2.5.4 nodata mdfv3	536	192
mdfreader 0.2.6 mdfv3	2763	546
mdfreader 0.2.6 compression mdfv3	4007	267
mdfreader 0.2.6 compression bcolz 6 mdfv3	3897	1039
mdfreader 0.2.6 noDataLoading mdfv3	1493	197
asammdf 2.5.4 mdfv4	1793	439
asammdf 2.5.4 nodata mdfv4	1317	249
mdfreader 0.2.6 mdfv4	5520	1319
mdfreader 0.2.6 compression mdfv4	7009	1031
mdfreader 0.2.6 compression bcolz 6 mdfv4	7082	1755
mdfreader 0.2.6 noDataLoading mdfv4	4724	952

Save file	Time [ms]	RAM [MB]
asammdf 2.5.4 mdfv3	459	369
asammdf 2.5.4 nodata mdfv3	524	200
mdfreader 0.2.6 mdfv3	8607	579
mdfreader 0.2.6 noDataLoading mdfv3	9265	578
mdfreader 0.2.6 compression mdfv3	8242	542
mdfreader 0.2.6 compression bcolz 6 mdfv3	7787	1039
asammdf 2.5.4 mdfv4	572	446
asammdf 2.5.4 nodata mdfv4	512	260
mdfreader 0.2.6 mdfv4	6248	1341
mdfreader 0.2.6 noDataLoading mdfv4	7095	1340
mdfreader 0.2.6 compression mdfv4	6455	1296
mdfreader 0.2.6 compression bcolz 6 mdfv4	6067	1771

Get all channels (36424 calls)	Time [ms]	RAM [MB]
asammdf 2.5.4 mdfv3	605	379
asammdf 2.5.4 nodata mdfv3	9065	209
mdfreader 0.2.6 mdfv3	66	546
mdfreader 0.2.6 nodata mdfv3	80570	418
mdfreader 0.2.6 compression mdfv3	628	270
mdfreader 0.2.6 compression bcolz 6 mdfv3	273	1040
asammdf 2.5.4 mdfv4	611	448
asammdf 2.5.4 nodata mdfv4	12484	262
mdfreader 0.2.6 mdfv4	64	1319
mdfreader 0.2.6 nodata mdfv4	117087	1189
mdfreader 0.2.6 compression mdfv4	637	1041
mdfreader 0.2.6 compression bcolz 6 mdfv4	301	1762

Convert file	Time [ms]	RAM [MB]
asammdf 2.5.4 v3 to v4	4640	849
asammdf 2.5.4 v3 to v4 nodata	21774	589
asammdf 2.5.4 v4 to v3	4842	854
asammdf 2.5.4 v4 to v3 nodata	26222	728

Merge files	Time [ms]	RAM [MB]
asammdf 2.5.4 v3	10062	1408
asammdf 2.5.4 v3 nodata	30880	497
asammdf 2.5.4 v4	13109	1503
asammdf 2.5.4 v4 nodata	41532	565

Project details

These details have not been verified by PyPI

Project links

Homepage

GitHub Statistics

View statistics for this project via Libraries.io, or by using our public dataset on Google BigQuery

Release history Release notifications | RSS feed

7.4.2

Mar 12, 2024

7.4.1

Jan 26, 2024

7.4.0

Jan 18, 2024

7.3.18

Oct 25, 2023

7.3.17

Oct 25, 2023

7.3.16

Oct 20, 2023

7.3.15

Oct 19, 2023

7.3.14

Aug 3, 2023

7.3.13

Jul 14, 2023

7.3.12

Apr 6, 2023

7.3.11

Apr 5, 2023

7.3.10

Apr 4, 2023

7.3.9

Mar 31, 2023

7.3.8

Mar 29, 2023

7.3.7

Mar 28, 2023

7.3.6

Mar 28, 2023

7.3.5

Mar 27, 2023

7.3.4

Mar 22, 2023

7.3.3

Mar 21, 2023

7.3.2

Feb 3, 2023

7.3.1

Feb 3, 2023

7.3.0

Feb 2, 2023

7.2.0

Dec 5, 2022

7.1.1

Aug 2, 2022

7.1.0

Jun 24, 2022

7.0.7

Feb 2, 2022

7.0.4

Jan 26, 2022

7.0.3

Jan 5, 2022

7.0.2

Dec 15, 2021

7.0.1

Dec 9, 2021

7.0.0

Dec 6, 2021

6.4.4

Sep 8, 2021

6.4.2.dev4 pre-release

Sep 8, 2021

6.4.0

Sep 6, 2021

6.3.2

Aug 11, 2021

6.3.1

Jul 30, 2021

6.3.0

Jul 23, 2021

6.2.0

Feb 2, 2021

6.1.2

Jan 5, 2021

6.1.0

Jan 4, 2021

6.0.1

Dec 7, 2020

6.0.0

Dec 7, 2020

6.0.0.dev12 pre-release

Nov 3, 2020

6.0.0.dev10 pre-release

Oct 27, 2020

5.23.1

Sep 24, 2020

5.23.0

Sep 24, 2020

5.22.0

Aug 26, 2020

5.21.0

Jul 9, 2020

5.20.6

May 19, 2020

5.20.5

May 8, 2020

5.20.4

May 8, 2020

5.20.3

May 7, 2020

5.20.2

Apr 30, 2020

5.20.1

Apr 27, 2020

5.20.0

Apr 22, 2020

5.20.0.dev27 pre-release

Apr 14, 2020

5.19.21

Feb 4, 2021

5.19.20

Feb 3, 2021

5.19.19

Feb 3, 2021

5.19.18

Jan 24, 2021

5.19.17

Oct 20, 2020

5.19.16

Apr 9, 2020

5.19.15

Apr 9, 2020

5.19.14

Apr 6, 2020

5.19.13

Apr 5, 2020

5.19.12

Apr 3, 2020

5.19.11

Apr 3, 2020

5.19.10

Apr 2, 2020

5.19.9

Mar 26, 2020

5.19.8

Mar 24, 2020

5.19.7

Mar 19, 2020

5.19.6

Mar 19, 2020

5.19.5.dev0 pre-release

Mar 16, 2020

5.19.4

Mar 16, 2020

5.19.3

Mar 13, 2020

5.19.2

Mar 12, 2020

5.19.1

Mar 6, 2020

5.19.0

Mar 6, 2020

5.18.2

Mar 5, 2020

5.18.1

Mar 4, 2020

5.18.0

Feb 22, 2020

5.17.3

Feb 12, 2020

5.17.2

Feb 11, 2020

5.17.1

Feb 6, 2020

5.17.0

Feb 6, 2020

5.16.5

Feb 5, 2020

5.16.4

Feb 5, 2020

5.16.3

Jan 28, 2020

5.16.2

Jan 27, 2020

5.16.1

Jan 27, 2020

5.16.0

Jan 27, 2020

5.15.1

Jan 6, 2020

5.15.0

Jan 6, 2020

5.14.5

Dec 11, 2019

5.14.4

Dec 11, 2019

5.14.3

Dec 6, 2019

5.14.2

Dec 6, 2019

5.14.1

Nov 28, 2019

5.14.0

Nov 28, 2019

5.13.18

Nov 27, 2019

5.13.17

Nov 27, 2019

5.13.16

Nov 25, 2019

5.13.15

Nov 22, 2019

5.13.14

Nov 20, 2019

5.13.13

Nov 18, 2019

5.13.12

Nov 15, 2019

5.13.11

Nov 12, 2019

5.13.10

Nov 7, 2019

5.13.9

Nov 5, 2019

5.13.8

Nov 5, 2019

5.13.7

Nov 5, 2019

5.13.6

Oct 25, 2019

5.13.5

Oct 25, 2019

5.13.4

Oct 25, 2019

5.13.3

Oct 25, 2019

5.13.2

Oct 24, 2019

5.13.1

Oct 21, 2019

5.13.0

Oct 21, 2019

5.12.0

Oct 7, 2019

5.11.0

Sep 18, 2019

5.10.3

Jul 16, 2019

5.10.2

Jul 11, 2019

5.10.1

Jul 8, 2019

5.10.0

Jun 24, 2019

5.9.2

Jun 7, 2019

5.9.1

Jun 6, 2019

5.9.0

Jun 3, 2019

5.8.4

May 29, 2019

5.8.3

May 17, 2019

5.8.2

May 17, 2019

5.8.1

May 17, 2019

5.8.0

May 16, 2019

5.7.0

May 9, 2019

5.6.0

May 3, 2019

5.5.1

Apr 30, 2019

5.5.0

Apr 25, 2019

5.4.1

Apr 4, 2019

5.4.0

Apr 3, 2019

5.3.1

Apr 2, 2019

5.3.0

Apr 2, 2019

5.2.0

Mar 25, 2019

5.1.3

Mar 19, 2019

5.1.2

Mar 19, 2019

5.1.1

Mar 12, 2019

5.1.0

Mar 7, 2019

5.0.4

Mar 5, 2019

5.0.3

Mar 2, 2019

5.0.2

Mar 1, 2019

5.0.1

Feb 28, 2019

5.0.0

Feb 26, 2019

4.7.12

May 29, 2019

4.7.11

Feb 18, 2019

4.7.10

Feb 12, 2019

4.7.9

Feb 1, 2019

4.7.8

Jan 30, 2019

4.7.7

Jan 22, 2019

4.7.6

Jan 16, 2019

4.7.5

Jan 16, 2019

4.7.4

Jan 12, 2019

4.7.3

Jan 11, 2019

4.7.2

Jan 9, 2019

4.7.1

Jan 5, 2019

4.7.0

Jan 4, 2019

4.6.0

Dec 14, 2018

4.5.0

Dec 4, 2018

4.4.2

Dec 1, 2018

4.4.1

Nov 28, 2018

4.4.0

Nov 28, 2018

4.3.1

Nov 23, 2018

4.3.0

Nov 15, 2018

4.2.0

Nov 8, 2018

4.1.6

Nov 5, 2018

4.1.5

Oct 30, 2018

4.1.4

Oct 30, 2018

4.1.3

Oct 30, 2018

4.1.2

Oct 26, 2018

4.1.1

Oct 4, 2018

4.1.0

Sep 14, 2018

4.0.2

Sep 11, 2018

4.0.1

Sep 11, 2018

4.0.0

Sep 11, 2018

3.5.0

May 23, 2018

3.4.3

May 12, 2018

3.4.2

May 9, 2018

3.4.1

May 9, 2018

3.4.0

May 1, 2018

3.3.1

Apr 4, 2018

3.3.0

Apr 3, 2018

3.2.1

Mar 5, 2018

3.2.0

Mar 2, 2018

3.1.1

Feb 27, 2018

3.1.0

Feb 20, 2018

3.0.3

Feb 15, 2018

3.0.2

Feb 15, 2018

3.0.1

Feb 14, 2018

3.0.0

Feb 6, 2018

2.8.3

Feb 5, 2018

2.8.2

Jan 30, 2018

2.8.1

Dec 18, 2017

2.8.0

Dec 4, 2017

2.7.1

Nov 9, 2017

2.7.0

Nov 9, 2017

2.6.7

Nov 2, 2017

2.6.6

Oct 31, 2017

2.6.5

Oct 30, 2017

2.6.4

Oct 27, 2017

2.6.3

Oct 20, 2017

2.6.2

Oct 12, 2017

2.6.1

Oct 10, 2017

2.6.0

Oct 9, 2017

This version

2.5.4

Oct 3, 2017

2.5.3

Sep 25, 2017

2.5.2

Sep 13, 2017

2.5.1

Sep 12, 2017

2.5.0

Sep 11, 2017

2.4.3

Sep 1, 2017

2.4.2

Sep 1, 2017

2.4.1

Aug 31, 2017

2.4.0

Aug 29, 2017

2.3.2

Aug 23, 2017

2.3.1

Aug 22, 2017

2.3.0

Aug 22, 2017

2.2.0

Aug 21, 2017

2.1.2

Aug 18, 2017

2.1.1

Aug 16, 2017

2.1.0

Aug 3, 2017

2.0.0.post1

Jul 31, 2017

1.1.0

Jul 16, 2017

1.0.1

Jul 11, 2017

1.0.0

Jul 10, 2017

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

asammdf-2.5.4.tar.gz (60.8 kB view hashes)

Uploaded Oct 3, 2017 Source

Hashes for asammdf-2.5.4.tar.gz

Hashes for asammdf-2.5.4.tar.gz
Algorithm	Hash digest
SHA256	`f1a967d1002ee349bf24365cc472053264eb038299bc4ec90060dad4528d3520`
MD5	`73e4196f0bb6759e7dfa058edad27569`
BLAKE2b-256	`ed4680a02206a9507a23beaff66afbd0c6ceacf5d41f8294e9f48915643c6c41`