I just ran it for the first time... I've run windirstat many times including in the last two weeks and yes, this is very fast. According to its timing it took 3.63 seconds to scan my drive... I'm not sure if it really took almost 3 minutes for windirstat, but it did take a long time, so it's plausible. More importantly, ~ 4 seconds is much easier to wait for.
It is - it ‘cheats’ by reading off the NTFS MFT, similarly to another indispensable piece of Windows software Everything Search, both of which I miss keenly on my underprovisioned work Mac.
I think about this problem often in life because of my tendency to procrastinate. Only the long term effects that cause me serious paranoia get any real attention (failing to meet social expectations, major health issues, large-figure finance problems). It’s absolutely necessary to define the constraints before they define you. This requires a lot of forward thinking and effort but considering how little time we get on this earth… worth it
I recently ran `df` and was surprised to see that I'd used more than half of the two terabyte SSD in my laptop. So, being apparently atypically proactive, my first action was delete all of the target directories in my Rust projects and was equally surprised to see that it freed up nearly 10% of my disk usage (~200 GB)!
If you're on MacOS and suspect a lot of space is taken by multiple copies of the same files, use fclones to turn them into APFS clones. (You can also use this on Linux, as ext4 supports hard links, but only if you're sure the duplicates won't diverge.)
And i am wondering what do people even fill their storage with, and why do they need so much. In my case it is ~200-300 out of 1TB on 2 laptops, 37 out of 128gb on phone. And i don't even actively manage it.
I have one single video game I play that takes up around 650GB, so I have a dedicated drive for it. And between 1 and 2 TB of movies, TV, and photos. Everything else is ephemeral/scratch space for whatever I'm working on.
I used to be into amateur movie making and editing, and back then I needed many TB of space for the stuff I pulled off my cameras before it got edited down.
I have 2TB filled and I need more. I make music so I need a lot of storage for my instruments and samples. This is measured in tens and often hundreds of gigabytes. I also play games. Games' sizes range wildly from 10 to 200 GBs. I also do gamedev. The textures get big and get duplicated between projects. Programming (npm modules for example), add to this personal data, media archives and 2TB is not enough
The problem with filling up a ssd is that it writes and rewrites the same blocks over and over defeating the built in wear leveling.
Filling an ssd creates the one situation where nand wear out is a problem.
If you're on Windows, WizTree (https://diskanalyzer.com/) is great for figuring out what's consuming your storage space.
On Linux/macOS you can use `du` from the command line (or ask an AI to make a convenience wrapper for you).
On Linux, ncdu is really good in the terminal. Filelight on KDE and Baobab on Gnome are really nice GUIs.
I've yet to encounter any issues with gdu for linux. Highly reccomended
> 46x faster than windirstat
Thats a pretty bold claim, but is it really that much faster?
I just ran it for the first time... I've run windirstat many times including in the last two weeks and yes, this is very fast. According to its timing it took 3.63 seconds to scan my drive... I'm not sure if it really took almost 3 minutes for windirstat, but it did take a long time, so it's plausible. More importantly, ~ 4 seconds is much easier to wait for.
It is - it ‘cheats’ by reading off the NTFS MFT, similarly to another indispensable piece of Windows software Everything Search, both of which I miss keenly on my underprovisioned work Mac.
I like erdtree or dust instead of du.
DaisyDisk is also a great option on Mac.
Asked Claude to look at my full disk. Thought for 1 minute
It found 114GB of Hugging Face models, 17GB worth of models in an obscure app I tested once. In places I would've never thought to look.
I'd never have never found these myself.
Problem solved. For now!
I think about this problem often in life because of my tendency to procrastinate. Only the long term effects that cause me serious paranoia get any real attention (failing to meet social expectations, major health issues, large-figure finance problems). It’s absolutely necessary to define the constraints before they define you. This requires a lot of forward thinking and effort but considering how little time we get on this earth… worth it
I recently ran `df` and was surprised to see that I'd used more than half of the two terabyte SSD in my laptop. So, being apparently atypically proactive, my first action was delete all of the target directories in my Rust projects and was equally surprised to see that it freed up nearly 10% of my disk usage (~200 GB)!
I’ve also noticed this with rust. Those target directories can get huge.
"Save" is cheap. "I might need this sometime later."
Delete is expensive. "Am I positive I'll never need this again?"
As a consequence, "cheap" actions (saves) accumulate, "expensive" ones (deletes) accrue until cheap becomes expensive as space becomes tight.
Ultimately, options become:
- Find criteria for rapidly assessing what data can be deleted.
- Purchase cheap archival storage and migrate old data to that.
- A media or device crash induces loss of arbitrarily-selected data.
This is a variation of Parkinson's Law https://en.wikipedia.org/wiki/Parkinson%27s_Law: "Data expands to fill the space available for storage."
If you're on Windows, MacOS or Linux, a great tool for interactively discovering and deleting large folders and files is dua:
https://github.com/Byron/dua-cli
If you're on MacOS and suspect a lot of space is taken by multiple copies of the same files, use fclones to turn them into APFS clones. (You can also use this on Linux, as ext4 supports hard links, but only if you're sure the duplicates won't diverge.)
My harddrive at 1tb has around the same amount of free space in % as my previous computer with just 256gb.
And i am wondering what do people even fill their storage with, and why do they need so much. In my case it is ~200-300 out of 1TB on 2 laptops, 37 out of 128gb on phone. And i don't even actively manage it.
I have one single video game I play that takes up around 650GB, so I have a dedicated drive for it. And between 1 and 2 TB of movies, TV, and photos. Everything else is ephemeral/scratch space for whatever I'm working on.
I used to be into amateur movie making and editing, and back then I needed many TB of space for the stuff I pulled off my cameras before it got edited down.
What video game!? I've seen games that reach up to the already crazy number of 100gb, but I usually just don't install those, with few exceptions
My photo library is around 700 gb.
Photos, movies, MP3, SDKs for various kinds of systems, PDFs (and PS) of computing papers collected during the last 35 years, and naturally games.
I have 2TB filled and I need more. I make music so I need a lot of storage for my instruments and samples. This is measured in tens and often hundreds of gigabytes. I also play games. Games' sizes range wildly from 10 to 200 GBs. I also do gamedev. The textures get big and get duplicated between projects. Programming (npm modules for example), add to this personal data, media archives and 2TB is not enough
probably. wish there was a way to find out. hint: not logs or updates.
I bought a 8tb drive just before prices exploded so I'm alright