I am running a server with scientific linux 6.1 I beleive. Certain commands like man and tree instead of printing the right character will print �������. This only happens for characters like (,),|.',`. I am also having this issue with a arch install on a different machine but to a lesser extent. The arch machine only prints ������� for `. The scientific install is headless but the arch is not.
My friend suggested that it might be that I am missing fonts. I downloaded every font yum had to offer but it did not fix my issue. Thanks for the help.

This may be due to encoding, and your default language. Could you post both of what you are using?

My default language is English and the encoding is what ever it is by default.
A quick google search reveals

% local | grep LC_CTYPE
Binary file (standard input) matches

I am not sure if this is what you are asking for or not

Just a update.
I believe there is something wrong with my laptop that I am using to ssh into my server instead of the server. I have had the same issue displaying some text on other servers which have been confirmed to be working.