HDF5 to root

IMPORTANT:

I somehow messed up the code in the version that I uploaded yesterday.
It was working, but it was full of unnecessary repeated function definitions.

Download please the following (fix) version:
hdf2root.tar.gz (4.39 KB)

Cheers,
Alberto

Hi Alberto,

The code compiles now but I run into this runtime error now. I have libhdf5_cpp.so.6 but not 8 in my /usr/lib64.

[wht34@icarus hdf2root]$ ./hdf2root --ver lux10_20130611T0605_f000001_eb00014.hdf5 lux10_20130611T0605_f000001_eb00014.hdf5.root
./hdf2root: error while loading shared libraries: libhdf5_cpp.so.8: cannot open shared object file: No such file or directory
[wht34@icarus hdf2root]$ ldd hdf2root.e | grep libhdf5_cpp.so.8
libhdf5_cpp.so.8 => not found

Okay, I found these libraries in

/usr/local/hdf5/lib/ … but the program is looking for it in /usr/lib64…

If i make symblic links for the two missing libraries. The program runs but doesn’t give any output.

sudo ln -s /usr/local/hdf5/lib/libhdf5.so.8 /usr/lib64/libhdf5.so.8
sudo ln -s /usr/local/hdf5/lib/libhdf5_cpp.so.8 /usr/lib64/libhdf5_cpp.so.8
[wht34@icarus hdf2root]$ ./hdf2root lux10_20130611T0605_f000001_eb00014.hdf5 lux10_20130611T0605_f000001_eb00014.hdf5.root
Converting …
[wht34@icarus hdf2root]$ ll
total 12M
-rw-r–r--. 1 wht34 caselux 275 Mar 25 12:06 env.csh
-rwxr-xr-x. 1 wht34 caselux 373 Mar 26 15:04 env.sh
lrwxrwxrwx. 1 wht34 caselux 10 Mar 26 15:53 hdf2root -> hdf2root.e
-rw-r–r--. 1 wht34 caselux 14K Mar 26 14:44 hdf2root.cc
-rwxr-xr-x. 1 wht34 caselux 157K Mar 26 15:53 hdf2root.e
-rw-r–r--. 1 wht34 caselux 462 Mar 26 14:44 hdf2root.hh
-rw-r–r--. 1 wht34 caselux 12M Mar 26 14:55 lux10_20130611T0605_f000001_eb00014.hdf5
-rw-r–r--. 1 wht34 caselux 615 Mar 26 15:06 Makefile

Hello,

If the hdf5 libraries are located at /usr/local/hdf5/lib, the include files should be at /usr/local/hdf5/include.
In the configuration script you should define:
export HDF5CPP= /usr/local/hdf5
export LD_LIBRARY_PATH=$HDF5CPP/lib:$LD_LIBRARY_PATH

By the way, in which system are you trying to build the program?
DYLD_LIBRARY_PATH is used for macos, for linux systems it is LD_LIBRARY_PATH the variable which holds the path to the needed libraries.

Cheers,
Alberti

Hi Alberto,

I am on SLC6, so I changed the DYLD_LIBRARY_PATH to LD_LIBRARY_PATH as you showed. The code compiles but nothing happen when I ran the executable.

[wht34@icarus hdf2root]$ echo $HDF5CPP
/usr/local/hdf5
[wht34@icarus hdf2root]$ echo $LD_LIBRARY_PATH
/usr/local/hdf5/lib:/usr/share/root//lib:/usr/share/clhep/install/lib:/usr/share/geant4/install/lib/geant4/Linux-g++:/usr/share/clhep/install/lib:/usr/share/root//lib

[wht34@icarus hdf2root]$ make
Linking hdf2root.e
g++ -fPIC -pthread -m64 -I/usr/share/root/include -I/usr/local/hdf5/include -I. hdf2root.cc -o hdf2root.e -L. -L/usr/share/root/lib -lCore -lCint -lRIO -lNet -lHist -lGraf -lGraf3d -lGpad -lTree -lRint -lPostscript -lMatrix -lPhysics -lMathCore -lThread -pthread -lm -ldl -rdynamic -L/usr/local/hdf5/lib -lhdf5_cpp

[wht34@icarus hdf2root]$ ./hdf2root.e test.hdf5
Converting …
[wht34@icarus hdf2root]$ ll
total 24M
-rw-r–r--. 1 wht34 caselux 275 Mar 25 12:06 env.csh
-rwxr-xr-x. 1 wht34 caselux 365 Apr 2 14:48 env.sh
lrwxrwxrwx. 1 wht34 caselux 10 Apr 2 14:52 hdf2root -> hdf2root.e
-rw-r–r--. 1 wht34 caselux 14K Mar 26 14:44 hdf2root.cc
-rwxr-xr-x. 1 wht34 caselux 157K Apr 2 14:52 hdf2root.e
-rw-r–r--. 1 wht34 caselux 462 Mar 26 14:44 hdf2root.hh
-rw-r–r--. 1 wht34 caselux 615 Mar 26 15:06 Makefile
-rw-r–r--. 1 wht34 caselux 12M Mar 26 16:11 test.hdf5

Hello,
Thanks to your interest I have updated the code into a more professional fashion.
I have tried it and it works in both linux and mac os platforms.
Give it a try: github.com/delaossa/hdf2root

In the config folder there are various examples of configuration files.
Pick up the most similar to your system and modify it accordingly.
Good luck!

Hi Alberto,

The git version of your code compiles fine but the executable still doesn’t do anything to the hdf5 test file.
It’ll just say converting … , but no root output comes out with hdf2root test.hdf5 test.root.
Here’s the log for the compilation and my env.sh file.

#!/bin/bash

MAC flag

#export PLATFORM=linux
export ROOTSYS=/usr/share/root/
export LD_LIBRARY_PATH=$ROOTSYS/lib:$LD_LIBRARY_PATH
export PATH=$ROOTSYS/bin:$PATH
export HDF5CPP=/usr/local/hdf5
export LD_LIBRARY_PATH=$HDF5CPP/lib:$LD_LIBRARY_PATH
export HDF2ROOT=/home/wht34/SVN/Scratch/wht34/hdf2root-master
export LD_LIBRARY_PATH=$HDF2ROOT/lib:$LD_LIBRARY_PATH
export PATH=$HDF2ROOT/bin:$PATH

wht34@icarus hdf2root-master]$ source config/env.sh
[wht34@icarus hdf2root-master]$ make
make[1]: Entering directory /home/wht34/SVN/Scratch/wht34/hdf2root-master/src' Compiling hdf2root_methods.cc g++ -c -O2 -Wall -fPIC -pthread -m64 -I/usr/share/root/include -I/usr/local/hdf5/include -I/home/wht34/SVN/Scratch/wht34/hdf2root-master/inc -I. hdf2root_methods.cc Building shared library /home/wht34/SVN/Scratch/wht34/hdf2root-master/lib/libhdf2root.so ... g++ -shared hdf2root_methods.o -o /home/wht34/SVN/Scratch/wht34/hdf2root-master/lib/libhdf2root.so -L/usr/share/root/lib -lCore -lRIO -lTree -L/usr/local/hdf5/lib -lhdf5 -lhdf5_cpp Done Compiling hdf2root.cc g++ -c -O2 -Wall -fPIC -pthread -m64 -I/usr/share/root/include -I/usr/local/hdf5/include -I/home/wht34/SVN/Scratch/wht34/hdf2root-master/inc -I. hdf2root.cc Linking hdf2root.o g++ -O2 -m64 -o hdf2root.e hdf2root.o -L/usr/share/root/lib -lCore -lRIO -lTree -L/usr/local/hdf5/lib -lhdf5 -lhdf5_cpp -L/home/wht34/SVN/Scratch/wht34/hdf2root-master/lib -lhdf2root ln -sf /home/wht34/SVN/Scratch/wht34/hdf2root-master/src/hdf2root.e /home/wht34/SVN/Scratch/wht34/hdf2root-master/bin/hdf2root rm hdf2root.o make[1]: Leaving directory/home/wht34/SVN/Scratch/wht34/hdf2root-master/src’

Strange… What happens if you just execute the hdf2root program without any input parameters?
This is what i get:

[code][Behemoth] ~/plasma/software/hdf2root $> hdf2root

Usage: hdf2root [–seq] <inFile.h5> <outFile.root(=inFile.root)>

        --seq  Enables sequential mode. 
        --ver  Enables print out. 

[/code]

I get the same thing. Do you have a hdf5 file that I can test this program on? Maybe the file I have may not work with your program.

[wht34@icarus hdf2root-master]$ hdf2root

Usage: hdf2root [–seq] <inFile.h5> <outFile.root(=inFile.root)>

        --seq  Enables sequential mode. 
        --ver  Enables print out.

Actually by renaming the extension of my hdf5 to h5 the program does convert the h5 to root. The output created a bunch of broken trees however. Do you know if there’s any specially formatting of the hdf5 file in order to make this conversion to .root?

[wht34@icarus hdf2root-master]$ hdf2root test.h5 test.root
Converting test.h5 …
Error in TBranch::TLeaf: Illegal data type for nb_seqs/nb_seqs/c
Error in TBranch::TLeaf: Illegal data type for nb_chs/nb_chs/c
Error in TBranch::TLeaf: Illegal data type for trig_ch/trig_ch/c
Error in TBranch::TLeaf: Illegal data type for pulse_detect_pretrigger/pulse_detect_pretrigger/c
Error in TBranch::TLeaf: Illegal data type for pulse_end_posttrigger/pulse_end_posttrigger/c
Error in TBranch::TLeaf: Illegal data type for baseline_average_samples/baseline_average_samples/c
Error in TBranch::TLeaf: Illegal data type for sampling_freq_MHz/sampling_freq_MHz/c
Error in TBranch::TLeaf: Illegal data type for delay_buffer/delay_buffer/c
Error in TBranch::TLeaf: Illegal data type for vptg/vptg/c
Error in TBranch::TLeaf: Illegal data type for save_pair/save_pair/c
Error in TBranch::TLeaf: Illegal data type for baseline_freeze_enable/baseline_freeze_enable/c
Error in TBranch::TLeaf: Illegal data type for timestamp_clear/timestamp_clear/c
Error in TBranch::TLeaf: Illegal data type for end_address_threshold/end_address_threshold/c
Error in TBranch::TLeaf: Illegal data type for read_xlm/read_xlm/c
Error in TBranch::TLeaf: Illegal data type for water_thresh/water_thresh/c
Error in TBranch::TLeaf: Illegal data type for max_pulse_length/max_pulse_length/c
Error in TBranch::TLeaf: Illegal data type for write_log_files/write_log_files/c
Error in TBranch::TLeaf: Illegal data type for max_file_time_secs/max_file_time_secs/c

Hello,
Good. That means that the program works to such an extend…
It is true that the program filters the input files to have the .h5 extension. I have just fixed that and now it also accepts .hdf5 extensions. Update it from the git repository to get that version if you want.

Take into account that I made the program for my personal purpose and decided to shared it with others.
Normally, I only have to convert relatively simple hdf5 files and the program does its job.
But it is very likely that your files are more complex and/or they contain some elements that cannot be currently handled by hdf2root.

Would you send me one of your files so I can take a deeper look to it?
Another solution, if you are familiar with C++, is that you implement the missing features that you need and contribute to the hdf2root utility. The Git repository is also meant for that and you can “fork” the project, develop what you want, and eventually merge with the original one if success.
Are you up for this?

Cheers,
Alberto

Dear delaossa,
thanks to your code I has been able to convert hdf file to root file (I just modified the extension from hdf5 to hdf).
I tried to visualize my root file with TreeViewer but I have some problem. And I would like understand if is just my fault or the output root file have some limit to fix. Probably not.
My hdf file has X value, Y value, Z value (equal to X value), a dataset called DATA that is a matrix 360X1024 and another dadaset with the errors of DATA so another matrix 360X1024.
Using TreeViewer when I put in in x_empty the Y value, in y_empty the X value (for my case the axis are inverse) and in z_empty the DATA. I try to plot I get out just a 2 dimensional graph in 3D plot and I and he is not able to associated the columns whit X-axes and the row with Y-axes, so I don’t have a surfacer as I would like have. It depends because the z_empty want a vector and not a matrix? I put in some information about my root file end I put in also the root file to better understand. What I would like see is a 3D plot with all my data…

[code]echo "root [3] TFile f2(“120195_120199.root”);
root [4] gDirectory->pwd()
120195_120199.root:/
root [5] .ls
TFile** 120195_120199.root Dump of HDF file
TFile* 120195_120199.root Dump of HDF file
KEY: TTree root;1 DataSets in root group
KEY: TTree entry1;1 DataSets in entry1 group
KEY: TTree data1;1 DataSets in data1 group
KEY: TTree root_att;1 Attributes of root group
KEY: TTree entry1_att;1 Attributes of entry1 group
KEY: TTree data1_att;1 Attributes of data1 group

data1->Print()


*Tree :data1 : DataSets in data1 group *
*Entries : 1 : Total = 2978283 bytes File Size = 2976213 *

  •    :          : Tree compression factor =   1.00                       *
    

*Br 0 :DATA : DATA[362][1024]/F *
*Entries : 1 : Total Size= 1483316 bytes File Size = 1482824 *
*Baskets : 1 : Basket Size= 32000 bytes Compression= 1.00 *

*Br 1 :X : X[1024]/F *
*Entries : 1 : Total Size= 4635 bytes File Size = 4165 *
*Baskets : 1 : Basket Size= 32000 bytes Compression= 1.00 *

*Br 2 :Y : Y[362]/F *
*Entries : 1 : Total Size= 1985 bytes File Size = 1517 *
*Baskets : 1 : Basket Size= 32000 bytes Compression= 1.00 *

*Br 3 :Z : Z[1024]/F *
*Entries : 1 : Total Size= 4635 bytes File Size = 4165 *
*Baskets : 1 : Basket Size= 32000 bytes Compression= 1.00 *

*Br 4 :errors : errors[362][1024]/F *
*Entries : 1 : Total Size= 1483326 bytes File Size = 1482826 *
*Baskets : 1 : Basket Size= 32000 bytes Compression= 1.00 *
";[/code]

Hi Alberto,
your code works fine, but looks like it skips datetime objects (such as 18-char-long YYYYMMDDHHMMSS.mmm), since non-supported.
Could this feature be added?
Alex

FYI (just ignore me), but here is some code (in C++) to do the reverse: