Whoa! What Happened To All The Disk Space On My Google Cloud Platform Free Tier Debian VPS?

Not_OlesNot_Oles Hosting ProviderContent Writer
edited September 2023 in LES Talk

Introduction

For over four years now I have been enjoying a Google Cloud Platform (GCP) Free Tier Debian VPS. During this time, Debian's package system cache has grown to use more than half of the VPS's 10 GB of file storage space to cache .deb package files. This post explains the history and the use of this wonderful, free VPS (Thanks, Google!); shows the size of the package cache; and explains how to reclaim the large amount of disk space used for the cache.

VPS Creation in 2019

According to the Google Cloud Console, my e2-micro instance was created on January 27, 2019. That was more than four and a half years ago!

Larger File System Size Possible Within Current GCP Free Tier Limits

Looking at the current GCP Free Tier Resource Limits suggests that the Compute Engine limit is "30 GB-months standard persistent disk." My VPS is only 10 GB, so maybe, when I need it, I could increase the file system size to add an additional 20 GB.

VPS Use

This GCP VPS has been in modest, but continuous, steady use throughout more than four years. It serves my tiny personal website, holds a few small backup files, and runs TinyProxy. Tinyproxy works great for accessing certain websites in the US when I am in Mexico.

I log in to the VPS frequently. I wouldn't say every week for sure, but, if I am working on something, I log in many times in one week. Of course, to update the VPS's Debian operating system, I regularly run apt-get update and then apt-get upgrade.

Running EOL Debian 10 Buster

My GCP VPS is still running Debian 10 Buster (End of Life (EOL) a year ago, September 10, 2022), which might be okay, because the check-support-status utility doesn't list any installed packages without Long Term Support (LTS).

root@gc:~# man check-support-status
root@gc:~# check-support-status
root@gc:~# echo $?
0
root@gc:~# 

Great VPS Uptime!

Usually I run the w command when I log in. Here's what I saw today. 590 days of uptime isn't bad!

root@gc:~# w
 20:43:01 up 590 days, 16:55,  1 user,  load average: 0.00, 0.00, 0.00
USER     TTY      FROM             LOGIN@   IDLE   JCPU   PCPU WHAT
tom      pts/0    187.189.238.2    19:30    0.00s  0.08s  0.01s sshd: tom [priv]    
root@gc:~# 

Low Free Disk Space

One thing I have noticed is that free disk space on the VPS has been decreasing. Here is what free disk space looked like earlier today.

root@gc:~# df -h .
Filesystem      Size  Used Avail Use% Mounted on
/dev/sda1       9.8G  8.7G  673M  93% /
root@gc:~# 

The VPS image was set up without a swap partition. Since I might want to add more website or backup files, install additional utilities, or even add a swap file, I thought the remaining 673 MB might be a little small. I decided to take a look around and see if I could find a place or a few places where I could remove a big file that no longer was needed.

root@gc:/# du -sh /home/tom /var/www
77M     /home/tom
67M     /var/www
root@gc:/# 

Hmm! It didn't look like my home directory or even my website files were too piggy! Looking some more, I was surprised to find that /var was using a lot of space!

root@gc:/# du -sh /var
5.9G    /var
root@gc:/# 

Wow! "Lots of logs?" I wondered.

root@gc:/# du -sh /var/*
1.2M    /var/backups
5.7G    /var/cache
156M    /var/lib
4.0K    /var/local
0       /var/lock
13M     /var/log
3.3M    /var/mail
4.0K    /var/opt
0       /var/run
8.7M    /var/spool
12K     /var/tmp
67M     /var/www
root@gc:/# 

What's using all that space in /var/cache?

root@gc:/# du -sh /var/cache/*
108K    /var/cache/apparmor
5.7G    /var/cache/apt
3.8M    /var/cache/debconf
20K     /var/cache/ldconfig
2.5M    /var/cache/man
4.0K    /var/cache/private
root@gc:/# 

Oh! It's the package system! Four years of .deb files live there! 5.7 GB! Looking at the full output of the below command without the pipe to wc, it was instantly clear that all except the first five of the 346 output lines were .deb files. That's 341 .deb files! Together, the 341 cached .deb files used more than half of my VPS's disk space!

root@gc:/# ls -l /var/cache/apt/* | wc
    346    3090   28173
root@gc:/# 

About .deb Files

Binary .deb files are packages containing binaries which are "directly useable by dpkg." Source .deb files contain source code.

Luckily for small VPSes, after the system has been updated, the .deb files may be removed.

How To Reclaim Disk Space

From man apt-get:

       clean
           clean clears out the local repository of retrieved package files. It removes
           everything but the lock file from /var/cache/apt/archives/ and
           /var/cache/apt/archives/partial/.

After running apt-get clean the VPS got its empty disk space back! 6.4 GB available instead of 673 MB!

root@gc:~# apt-get clean
root@gc:~# ls -l /var/cache/apt/*
total 4
-rw-r----- 1 root root    0 Jan 24  2019 lock
drwx------ 2 _apt root 4096 Sep 13 21:22 partial
root@gc:~# du -sh /var/cache/apt
64K     /var/cache/apt
root@gc:~# df -h .
Filesystem      Size  Used Avail Use% Mounted on
/dev/sda1       9.8G  3.0G  6.4G  32% /
root@gc:~# 

Disabling The Cache

One possible way to prevent running out of disk space might be to disable the caching of .deb files. From man 5 apt-conf:

DIRECTORIES

       [ . . . ]

       Dir::Cache contains locations pertaining to local cache information, such as the two
       package caches srcpkgcache and pkgcache as well as the location to place downloaded
       archives, Dir::Cache::archives. Generation of caches can be turned off by setting
       pkgcache or srcpkgcache to "".

Please see also this old Bug #753531 from 2014, which was very fun to read because it almost said rm -rf /*!

It seems possibly safer and generally less work all around to leave the .deb caching defaults as they are. It's easy to empty the cache once in awhile with apt-get clean.

Conclusion

For small Debian VPSes which have been in use a long time, you might want to run apt-get clean to reclaim the large amount of disk space used by the apt cache.

I hope everyone gets the servers they want!

Comments

  • Once again a great article <3. In each of your articles I learn at least one thing I did not know before. Thank you for the time and effort you put in to make this happen.

    I mainly run AlmaLinux 8 these days and run a cron job once a month. For yum I run:

    yum clean packages

    I am currently traveling in mostly remote areas until sometime in April 2024. Consequently DM's sent to me will go unanswered during this time.
    For staff assistance or support issues please use the helpdesk ticket system at https://support.lowendspirit.com/index.php?a=add

  • Every time I run apt update, and upgrade/dist-upgrade (if any), I'll make sure it ends with an apt clean :smiley:

    Thanked by (3)Not_Oles Ganonk FrankZ
  • flipsflips OG
    edited September 2023

    I had like 3 GB of journal data in a couple of my Debian VPSes, so I ran journalctl --vacuum-time=2d.
    (Also possible: --vacuum-size=100M etc ...)

    Thanked by (3)FrankZ Not_Oles someTom
  • btw, Doesn't GCP free tier apply only for the first year?

    Thanked by (1)Not_Oles
  • Not_OlesNot_Oles Hosting ProviderContent Writer

    @Ganonk said:
    btw, Doesn't GCP free tier apply only for the first year?

    I believe GCP Free Tier Compute Engine VPS is free forever, subject to monthly usage limits. I believe the initial $300 credit expires in 90 days if unused. Please check https://cloud.google.com/free and especially https://cloud.google.com/free/docs/free-cloud-features .

    Have a great day! :)

    Thanked by (1)cxg

    I hope everyone gets the servers they want!

  • @Not_Oles said:

    @Ganonk said:
    btw, Doesn't GCP free tier apply only for the first year?

    I believe GCP Free Tier Compute Engine VPS is free forever, subject to monthly usage limits. I believe the initial $300 credit expires in 90 days if unused. Please check https://cloud.google.com/free and especially https://cloud.google.com/free/docs/free-cloud-features .

    Have a great day! :)

    WoW! nice sharing ;) thankyou. i will try again

    Thanked by (1)Not_Oles
  • @Not_Oles said:

    @Ganonk said:
    btw, Doesn't GCP free tier apply only for the first year?

    I believe GCP Free Tier Compute Engine VPS is free forever, subject to monthly usage limits. I believe the initial $300 credit expires in 90 days if unused. Please check https://cloud.google.com/free and especially https://cloud.google.com/free/docs/free-cloud-features .

    Have a great day! :)

    Only 1GB bandwidth per month? :open_mouth:

    Thanked by (1)Not_Oles
  • Not_OlesNot_Oles Hosting ProviderContent Writer

    @dosai said:

    @Not_Oles said:

    @Ganonk said:
    btw, Doesn't GCP free tier apply only for the first year?

    I believe GCP Free Tier Compute Engine VPS is free forever, subject to monthly usage limits. I believe the initial $300 credit expires in 90 days if unused. Please check https://cloud.google.com/free and especially https://cloud.google.com/free/docs/free-cloud-features .

    Have a great day! :)

    Only 1GB bandwidth per month? :open_mouth:

    Yeah, the second of the linked pages says 1 GB per month for Compute Engine. There also is App Engine, for which 1 GB per day is available. On the good side, GCP Free Tier is free, and it's very dependable. Thanks, Google!

    Thanked by (1)dosai

    I hope everyone gets the servers they want!

  • edited September 2023

    My Debian upgrade snippet is always:

    apt update ; apt upgrade ; apt dist-upgrade ; apt autoremove ; apt autoclean

    Localepurge can be nice too if you want to free up space and don't need additional language support. https://manpages.debian.org/bullseye/localepurge/localepurge.8.en.html

    Thanked by (2)FrankZ Not_Oles

    Cheap dedis are my drug, and I'm too far gone to turn back.

  • @flips said:
    I had like 3 GB of journal data in a couple of my Debian VPSes, so I ran journalctl --vacuum-time=2d.
    (Also possible: --vacuum-size=100M etc ...)

    I have that in crontab everyday on low disk Debians :D

    Thanked by (2)Not_Oles flips

    Haven't bought a single service in VirMach Great Ryzen 2022 - 2023 Flash Sale.
    https://lowendspirit.com/uploads/editor/gi/ippw0lcmqowk.png

  • @CamoYoshi said:
    My Debian upgrade snippet is always:

    apt update ; apt upgrade ; apt dist-upgrade ; apt autoremove ; apt autoclean

    Localepurge can be nice too if you want to free up space and don't need additional language support. https://manpages.debian.org/bullseye/localepurge/localepurge.8.en.html

    Can also use apt autopurge. :)

    Thanked by (2)FrankZ CamoYoshi
  • Not_OlesNot_Oles Hosting ProviderContent Writer

    @CamoYoshi said:
    My Debian upgrade snippet is always:

    apt update ; apt upgrade ; apt dist-upgrade ; apt autoremove ; apt autoclean

    Localepurge can be nice too if you want to free up space and don't need additional language support. https://manpages.debian.org/bullseye/localepurge/localepurge.8.en.html

    FWIW, note that clean and autoclean are different. From man apt-get:

           clean
               clean clears out the local repository of retrieved package files. It removes
               everything but the lock file from /var/cache/apt/archives/ and
               /var/cache/apt/archives/partial/.
    
           autoclean (and the auto-clean alias since 1.1)
               Like clean, autoclean clears out the local repository of retrieved package files.
               The difference is that it only removes package files that can no longer be
               downloaded, and are largely useless. This allows a cache to be maintained over a
               long period without it growing out of control. The configuration option
               APT::Clean-Installed will prevent installed packages from being erased if it is set
               to off.
    
    Thanked by (1)CamoYoshi

    I hope everyone gets the servers they want!

  • Hi @Not_Oles , I don't know if the IP brings any security issues to you, but I would anonymize the output of "w" if I were you ;) Use 1.1.1.1 or 8.8.8.8 instead ;)

    Thanked by (1)Not_Oles
  • It was discussed before the article was published and since it is CGNAT should not be an issue.

    Thanked by (1)Not_Oles

    I am currently traveling in mostly remote areas until sometime in April 2024. Consequently DM's sent to me will go unanswered during this time.
    For staff assistance or support issues please use the helpdesk ticket system at https://support.lowendspirit.com/index.php?a=add

  • Ok then, but anyways I always try to anonymize IPs even if they are CGNAT, no need to bring any incomming traffic on my ISP anyways :)

    Thanked by (2)FrankZ Not_Oles
  • Not_OlesNot_Oles Hosting ProviderContent Writer

    Hi @MrEd! Thanks for helping! It's really appreciated! <3

    @FrankZ This is the second or maybe even the third time some kind person has mentioned my CGNAT IP being exposed. Maybe, in the future, I should obfuscate the IP just to save everybody the trouble. I really, really appreciate it when people correct my mistakes, so I don't want to waste the wonderful resource which is other guys here watching my back. Thank you, guys! <3

    Thanked by (1)FrankZ

    I hope everyone gets the servers they want!

  • AuroraZeroAuroraZero Moderator
    edited September 2023

    @Not_Oles I stole the space for one of many, many irons I have in the fire. So sorry no refunds, chargebacks, or UNO reverse cards will be accepted.

    It is all the Yeti's now mwahahahahah! :p

    Thanked by (2)Not_Oles FrankZ

    Free Hosting at YetiNode | Cryptid Security | URL Shortener | LaunchVPS | ExtraVM | Host-C | In the Node, or Out of the Loop?

  • Not_OlesNot_Oles Hosting ProviderContent Writer

    @AuroraZero Oh my! I've been Yetihacked, and I didn't even know until you told me!

    Thanked by (2)AuroraZero FrankZ

    I hope everyone gets the servers they want!

  • Thanked by (2)Not_Oles Ganonk

    Free Hosting at YetiNode | Cryptid Security | URL Shortener | LaunchVPS | ExtraVM | Host-C | In the Node, or Out of the Loop?

  • edited September 2023

    pacman -Scc for cleaning cache of Arch linux, and here are corresponding commands of other major distributions in this Rosetta page.
    Or if the memory is big enough, you can set the cache directory to a tmpfs directory.

    Thanked by (2)Not_Oles FrankZ

    MicroLXC is lovable. Uptime of C1V

  • Not_OlesNot_Oles Hosting ProviderContent Writer

    @bliss Thanks again for your comment! I went to look at the Rosetta page to which you linked. It's helpful to have the pacman equivalent commands for major distributions all together in one place!

    Thanked by (1)bliss

    I hope everyone gets the servers they want!

  • @Not_Oles said:

    @dosai said:

    Only 1GB bandwidth per month? :open_mouth:

    Yeah, the second of the linked pages says 1 GB per month for Compute Engine. There also is App Engine, for which 1 GB per day is

    Are you able to stay under 1 GB/month, or do you normally run over? Or maybe it's one of those things where if you run over a few GB the charge is so small they don't even bother running your card?

    Thanked by (1)Not_Oles
  • Not_OlesNot_Oles Hosting ProviderContent Writer

    @JBB said:

    @Not_Oles said:

    @dosai said:

    Only 1GB bandwidth per month? :open_mouth:

    Yeah, the second of the linked pages says 1 GB per month for Compute Engine. There also is App Engine, for which 1 GB per day is

    Are you able to stay under 1 GB/month, or do you normally run over? Or maybe it's one of those things where if you run over a few GB the charge is so small they don't even bother running your card?

    I haven't paid careful attention to how much bandwidth my GCP Free Tier instance is using. Except for an occasional Google Voice video call, the instance typically is neither serving or proxying video or music. So it's probably not using much bandwidth. Nevertheless, as you suggest, there indeed have been a couple of months when I have wondered about possibly having used a little more than 1 GB. Since I haven't been charged yet, all I can say is, "Thanks Google!" <3

    I hope everyone gets the servers they want!

  • havochavoc OGContent Writer

    Check out the promotion they've got on T2A VM type...north of 200+ discount per month till March. It's their new ARM line. That's a pretty chunk instance. Pity it is time limited

    Checked it yesterday and seems to be working as expected

    Thanked by (2)FrankZ Not_Oles
  • Did you forget what happened to their "free tier" of email hosting?
    Free forever -> Free for current users -> Pay now or GTFO

    Thanked by (1)Janevski

    Artificial intelligence is no match for our natural stupidity.
    Time flies like an arrow; fruit flies like a banana.

  • edited September 2023

    @somik said:
    Did you forget what happened to their "free tier" of email hosting?
    Free forever -> Free for current users -> Pay now or GTFO

    And they did it over night, with no noticeable notice.
    Like, hello, today your mails and files are locked, subscribe to our plans to access them.

    If i were Google, i'd at least put a yellow banner message on top, a month or two ahead.
    Google is no better than Indian ransomware.

  • @Janevski said:

    @somik said:
    Did you forget what happened to their "free tier" of email hosting?
    Free forever -> Free for current users -> Pay now or GTFO

    And they did it over night, with no noticeable notice.
    Like, hello, today your mails and files are locked, subscribe to our plans to access them.

    If i were Google, i'd at least put a yellow banner message on top, a month or two ahead.
    Google is no better than Indian ransomware.

    Well, actually they did send notices to the admin emails. So that part I am not unhappy with. I am sad that I had to pack up my emails and leave or pay $5 per user per month, even for personal usage...

    Artificial intelligence is no match for our natural stupidity.
    Time flies like an arrow; fruit flies like a banana.

  • @Janevski said: Google is no better than Indian ransomware.

    I love India (Bharat).
    I've chatted with some Indians online and in real life, whom I think are polite and reasonable.

    MicroLXC is lovable. Uptime of C1V

Sign In or Register to comment.