How many users are we talking about here?
I'm not too familiar with the EL varieties, but you may know that X, and particularly KDE, are pretty heavy items -- they can be CPU intensive.
So, if any number of different users were logged in and using X/KDE sessions, the CPU would certainly become quite heavily loaded up. Compounding this might be un-closed sessions, unterminated processes or applications, etc.
Maybe, based on just the little bit of info you provided, a lighter desktop would be better in your situation, rather than KDE.