fossilesque@mander.xyzM to Science Memes@mander.xyzEnglish · 4 months agoPandasmander.xyzimagemessage-square8fedilinkarrow-up119
arrow-up119imagePandasmander.xyzfossilesque@mander.xyzM to Science Memes@mander.xyzEnglish · 4 months agomessage-square8fedilink
minus-squareKausta@lemm.eelinkfedilinkEnglisharrow-up0·4 months agoYou havent seen anything until you need to put a 4.2gb gzipped csv into a pandas dataframe, which works without any issues I should note.
minus-squarethisfro@slrpnk.netlinkfedilinkEnglisharrow-up0·4 months agoI raise you thousands of gzipped files (total > 20GB) combined into one dataframe. Frankly, my work laptop did not like it all that much. But most basic operations still worked fine tho
You havent seen anything until you need to put a 4.2gb gzipped csv into a pandas dataframe, which works without any issues I should note.
I raise you thousands of gzipped files (total > 20GB) combined into one dataframe. Frankly, my work laptop did not like it all that much. But most basic operations still worked fine tho