this post was submitted on 02 Aug 2024
343 points (97.5% liked)

Science Memes

11148 readers
2177 users here now

Welcome to c/science_memes @ Mander.xyz!

A place for majestic STEMLORD peacocking, as well as memes about the realities of working in a lab.

Rules

  1. Don't throw mud. Behave like an intellectual and remember the human.
  2. Keep it rooted (on topic).
  3. No spam.
  4. Infographics welcome, get schooled.

This is a science community. We use the Dawkins definition of meme.

Research Committee

Other Mander Communities

Science and Research

Biology and Life Sciences

Physical Sciences

Humanities and Social Sciences

Practical and Applied Sciences

Memes

Miscellaneous

founded 2 years ago
MODERATORS
Sal@mander.xyz
fossilesque@mander.xyz
SciBot@mander.xyz
343
Pandas (mander.xyz)
submitted 3 months ago by fossilesque@mander.xyz to c/science_memes@mander.xyz
36 comments fedilink hide all child comments
 
you are viewing a single comment's thread
view the rest of the comments
[–] gigachad@sh.itjust.works 5 points 3 months ago (2 children)

I guess it's more of a critique of how bad CSV is for storing large data than pandas being inefficient

[–] zaphod@sopuli.xyz 13 points 3 months ago (2 children)

CSV is not optimal, but then someone shows up and gives you 60GB of JSON instead of 600MB of CSV.

[–] Diplomjodler3@lemmy.world 4 points 3 months ago

Why do you have to personally attack me like that?

[–] naught@sh.itjust.works 3 points 3 months ago

Or they dump their entire 6gb SQL database, customer info and all, into a SQL file that you have to load into a mariadb docker container when you just needed a subset that you were going to turn into csv anyway ☺️

[–] ikilledlaurapalmer@lemmy.world 4 points 3 months ago

Fine! .csv.gz ftw!