It seems like this is the default behavior for "xterm".
The simplest way to override this without modifying your default "Documents" path (that might cause annoyances in xfce programs) is to create or edit the "~/.bashrc" file and append to it the following code:
Code:
if [ "$TERM" = "xterm" ]; then
cd ~
fi