SchwertImStein@lemmy.dbzer0.com to Programmer Humor@programming.devEnglish · 2 years agomuskrat's data eng expert's hard drive overheats while processing 60k rowslemmy.dbzer0.comimagemessage-square292linkfedilinkarrow-up1988arrow-down114
arrow-up1974arrow-down1imagemuskrat's data eng expert's hard drive overheats while processing 60k rowslemmy.dbzer0.comSchwertImStein@lemmy.dbzer0.com to Programmer Humor@programming.devEnglish · 2 years agomessage-square292linkfedilink
minus-squareeasily3667@lemmus.orgdeleted by creatorlinkfedilinkEnglisharrow-up145·edit-21 year agodeleted by creator
minus-squarenaught@sh.itjust.workslinkfedilinkarrow-up60·2 years agoi mean its even excel sized depending on how many columns. This is seriously sad and alarming
minus-squareeasily3667@lemmus.orgdeleted by creatorlinkfedilinkEnglisharrow-up11·edit-21 year agodeleted by creator
minus-squarewise_pancake@lemmy.cadeleted by creatorlinkfedilinkarrow-up3·2 years agoHoly shit if this ids lm issue that’s too funny
minus-squaremorrowind@lemmy.mllinkfedilinkarrow-up50·2 years agoSqlite can easily handle millions of rows. Don’t sell it short
minus-squareThe_Decryptor@aussie.zonelinkfedilinkEnglisharrow-up9·2 years agoHow about a 6.4TB sqlite database? https://boyter.org/posts/searchcode-bigger-sqlite-than-you/
minus-squareKorhaka@sopuli.xyzlinkfedilinkEnglisharrow-up4·2 years agoI have an sqlite db that is a few GB in size, game saves using the format. Sadly almost all blob data, would love to play with it if it was a bit more readable
minus-squareeasily3667@lemmus.orgdeleted by creatorlinkfedilinkEnglisharrow-up1·edit-21 year agodeleted by creator
deleted by creator
i mean its even excel sized depending on how many columns. This is seriously sad and alarming
deleted by creator
Holy shit if this ids lm issue that’s too funny
Sqlite can easily handle millions of rows. Don’t sell it short
How about a 6.4TB sqlite database?
https://boyter.org/posts/searchcode-bigger-sqlite-than-you/
Should be enough to hold 60k rows
I have an sqlite db that is a few GB in size, game saves using the format. Sadly almost all blob data, would love to play with it if it was a bit more readable
deleted by creator
60k is single json file