Disk quota exceeded ... but no quota are defined.
 

Hello to All,

my debian server is freezed with quota exceeded but there is no quota installed on it.

Debian version is :
uname -a
Linux vps622 2.6.32-042stab103.6 #1 SMP Wed Jan 21 13:07:39 MSK 2015 i686 GNU/Linux

No quota are setup and disk is not full as only 3% of usage are reported :

sudo df -h

Filesystem Size Used Avail Use% Mounted on
/dev/simfs 160G 3.8G 157G 3% /
tmpfs 205M 72K 205M 1% /run
tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs 410M 0 410M 0% /run/shm

mount does not indicate quota setup :

/vz/private/622 on / type simfs (rw,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /run type tmpfs (rw,nosuid,noexec,relatime,size=209716k,mode=755)
tmpfs on /run/lock type tmpfs (rw,nosuid,nodev,noexec,relatime,size=5120k)
tmpfs on /run/shm type tmpfs (rw,nosuid,nodev,noexec,relatime,size=419420k)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)

sudo du -ch /run
72K /run
72K total

But all services are freezed with quota exeeded errors.
when I log :
zsh: locking failed for /home/bruno/.histfile: disk quota exceeded: reading anyway

Or in postfix logs :
Mar 24 04:44:52 vps622 postfix/cleanup[2727]: warning: mail_queue_enter: create file incoming/181079.2727: Disk quota exceeded
..etc..

Also MySQL also cannot be started.
Once rebooted the server is fine only few minutes before facing quota exceeded.

I cannot find any quota setup.
And indeed there is no quota packages installed neither.

dpkg -l | grep quota
---> nothing.

How to check this quota problem ?
Thanks for any help or clue.

Bye

What do you see in /var/log/messages and what is the output of: df -i? Any changes recently made to the machine?

What's this simfs? I am not aware of this filesystem type. If you are using paid servers then admin have limited disk usage.

[RESOLVED] Disk quota exceeded ... but no quota are defined.
 

The server is a VPS (Virtual Private Server) one.
Indeed the inodes were full.

sudo df -i
Filesystem Inodes IUsed IFree IUse% Mounted on
/dev/simfs 500000 500000 500000 100% /
..etc..

So filesystem needs some files cleanup...
I identified which directory was full of files with following command executed from root location /:

/: sudo find . -xdev -type f | cut -d "/" -f 2 | sort | uniq -c | sort -n

After few iterations I found the directory : /usr/local/pnp4nagios/var/spool which contains more than 300.000 files.
Need to work on this later, but to resolve the current issue I stopped nagios and delete its spool directory.
Then everything is up & running OK.

sudo df -i
Filesystem Inodes IUsed IFree IUse% Mounted on
/dev/simfs 500000 167715 332285 34% /
..etc..

Thanks for your attention.
Bruno

Nice! That is what I thought. It is better to create partitions with larger number of inodes if you expect them to get full. Had similar issue with database server in past and had to go with higher inode number at the time of partition creation.