Thanks to dust I deleted a 70 gig file on my drive

Dust is a rewrite of du (in rust obviously) that visualizes your directory tree and what percentage each file takes up. But it only prints as many files fit in your terminal height, so you see only the largest files. It’s been a better experience that du, which isn’t always easy to navigate to find big files (or atleast I’m not good at it.)

Anyway, found a log file at .local/state/nvim/log that was 70gb. I deleted it. Hope it doesn’t bite me. Been pushing around 95% of disk space for a while so this was a huge win 👍

Rambi,

A 70gb log file?? Am I misunderstanding something or wouldn’t that be hundreds of millions of lines

Mo5560,

I’ve definitely had to handle 30gb plain text files before so I am inclined to believe twice as much should be just as possible

TheAnonymouseJoker,
@TheAnonymouseJoker@lemmy.ml avatar

MINI GUIDE TO FREEING UP DISK SPACE (by a datahoarder idiot who runs on 5 gigs free space on 4 TB)

You will find more trash with the combination of 4 tools. Czkawka (duplicates and big files), Dupeguru (logs), VideoDuplicateFinder by 0x90d, and tune2fs.

VDF finds duplicates by multiple frames of a video, and with reversing frames, and you can set similarity % rate and duration of videos. It is the best tool of its kind with nothing to match it, and uses ffmpeg as backend.

There is a certain amount of disk space reserved on partitions for root or privileged processes, but users who create /home partition separately do not need this reserved space there. 5% space is reserved by default, no matter if your disk is 1 TB, 2 TB or 4 TB. To change this, use command sudo tune2fs -m N (where N is % you want to reserve, can be put to 0% for /home, but NEVER touch root, swap or others, use GParted to check which is which partition).

Regular junk cleaning on Linux can be done with BleachBit. Wipe free disk space once in 3-6 months atleast.

On Windows, use PrivaZer instead of BleachBit.

Since all of these are GUI tools (except tune2fs which requires no commandline hackerman knowledge), this guide is targeted towards tech literacy level of users who can atleast replace crack EXEs in pirated games on Windows.

lemmy_nightmare,
@lemmy_nightmare@sh.itjust.works avatar

What about the video similarity finding tool built into Czkawka? Is it not as good as VDF?

TheAnonymouseJoker,
@TheAnonymouseJoker@lemmy.ml avatar

No, not even a contest. Nothing compares to VDF.

anagram3k,
@anagram3k@lemmy.ml avatar

ncdu is the best utility for this type of thing. I use it all the time.

dan,
@dan@upvote.au avatar

Try dua. It’s like ncdu but uses multiple threads so it’s a lot faster., especially on SSDs.

bizdelnick,

I usually use something like du -sh * | sort -hr | less, so you don’t need to install anything on your machine.

digdilem,

Almost the same here. Well, du -shc *|sort -hr

I admin around three hundred linux servers and this is one of my most common tasks - although I use -shc as I like the total too, and don’t bother with less as it’s only the biggest files and dirs that I’m interested in and they show up last, so no need to scrollback.

When managing a lot of servers, the storage requirements when installing extra software is never trivial. (Although our storage does do very clever compression and it might recognise the duplication of the file even across many vm filesystems, I’m never quite sure that works as advertised on small files)

netchami,

I think something might be wrong with your Neovim if it aggregated 70 gigs of log files.

Aatube,
@Aatube@kbin.social avatar

don't worry, they've just been using neovim for 700 years, it'll be alright

nik282000,
@nik282000@lemmy.ca avatar

So I found out that qbittorrent generates errors in a log whenever it tries to write to a disk that is full…

Everytime my disk was full I would clear out some old torrents, then all the pending log entries would write and the disk would be full again. The log was well over 50gb by the time I figured out that i’m an idiot. Hooray for having dedicated machines.

rutrum,
@rutrum@lm.paradisus.day avatar

If you have ideas please let me know. I’m preparing to hop distros so I’m very tempted to ignore the problem, blame the old distro, and hope it doesn’t happen again :)

netchami,

I would have to look at the log file. Some plugin probably has an issue and writes massive amounts of data to the log every time you use Neovim. Monitor the growth of the log file and contact me via DM if it goes crazy again, I’m gonna try to figure out what’s going on.

yote_zip,

Try ncdu as well. No instructions needed, just run ncdu /path/to/your/directory.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • •
  • linux@lemmy.ml
  • localhost
  • All magazines
    •
    Loading…
    Loading the web debug toolbar…
    Attempt #