Memory issue when trying to convert RDF to pandas using AsNumpy


Please read tips for efficient and successful posting and posting code

Please fill also the fields below. Note that root -b -q will tell you this info, and starting from 6.28/06 upwards, you can call .forum bug from the ROOT prompt to pre-populate a topic.

ROOT Version: Not Provided
Platform: Not Provided
Compiler: Not Provided


Dear experts,

I am trying to convert a large number of rdfs to in pandas dataframe using

mixed_dfs = {}

for key, rdf in mixed_rdfs.items():
    print(f" Converting RDF '{key}'...")
    try:
        df = pd.DataFrame(rdf.AsNumpy())
        mixed_dfs[key] = df
    except Exception as e:
        print(f"❌ Failed to convert RDF '{key}': {e}")

print("Converted All")

 

Converting RDF 'mixed_0_0_rdf'...
❌ Failed to convert RDF 'mixed_0_0_rdf': data type '<f0' not understood
 Converting RDF 'mixed_1_0_rdf'...
❌ Failed to convert RDF 'mixed_1_0_rdf': data type '<f0' not understood
 Converting RDF 'mixed_2_0_rdf'...
❌ Failed to convert RDF 'mixed_2_0_rdf': data type '<f0' not understood
 Converting RDF 'mixed_3_0_rdf'...
❌ Failed to convert RDF 'mixed_3_0_rdf': data type '<f0' not understood
 Converting RDF 'mixed_4_0_rdf'...
❌ Failed to convert RDF 'mixed_4_0_rdf': data type '<f0' not understood
 Converting RDF 'mixed_5_0_rdf'...
❌ Failed to convert RDF 'mixed_5_0_rdf': data type '<f0' not understood
 Converting RDF 'mixed_6_0_rdf'...
❌ Failed to convert RDF 'mixed_6_0_rdf': data type '<f0' not understood
 Converting RDF 'mixed_7_0_rdf'...
❌ Failed to convert RDF 'mixed_7_0_rdf': data type '<f0' not understood
 Converting RDF 'mixed_8_0_rdf'...
❌ Failed to convert RDF 'mixed_8_0_rdf': data type '<f0' not understood
 Converting RDF 'mixed_9_0_rdf'...
❌ Failed to convert RDF 'mixed_9_0_rdf': data type '<f0' not understood
 Converting RDF 'mixed_10_0_rdf'...
❌ Failed to convert RDF 'mixed_10_0_rdf': data type '<f0' not understood
 Converting RDF 'mixed_11_0_rdf'...
❌ Failed to convert RDF 'mixed_11_0_rdf': data type '<f0' not understood
 Converting RDF 'mixed_12_0_rdf'...
❌ Failed to convert RDF 'mixed_12_0_rdf': data type '<f0' not understood
 Converting RDF 'mixed_13_0_rdf'...
❌ Failed to convert RDF 'mixed_13_0_rdf': data type '<f0' not understood
 Converting RDF 'mixed_14_0_rdf'...
❌ Failed to convert RDF 'mixed_14_0_rdf': data type '<f0' not understood
 Converting RDF 'mixed_15_0_rdf'...
❌ Failed to convert RDF 'mixed_15_0_rdf': data type '<f0' not understood
 Converting RDF 'mixed_16_0_rdf'...
❌ Failed to convert RDF 'mixed_16_0_rdf': data type '<f0' not understood
 Converting RDF 'mixed_17_0_rdf'...
❌ Failed to convert RDF 'mixed_17_0_rdf': data type '<f0' not understood
 Converting RDF 'mixed_18_0_rdf'...
❌ Failed to convert RDF 'mixed_18_0_rdf': data type '<f0' not understood
 Converting RDF 'mixed_19_0_rdf'...
❌ Failed to convert RDF 'mixed_19_0_rdf': data type '<f0' not understood
Converted All
cling JIT session error: Cannot allocate memory
cling JIT session error: Cannot allocate memory
cling JIT session error: Cannot allocate memory

But this fails as you can see.

I am not sure what is causing this error even though I have permissible data types

ROOT Version:6.30/02

Using JupyROOT: JupyROOT 6.30/02

Platform: Jupyter notebooks

Could you retry with ROOT 6.36.04 ? Some things were fixed in the menatime.