Nobody really wants to deal with email delivery beyond relaying it off to a remote host these days. I mean, c’mon! It’s 2011, not 2001! Even the more configurable MTAs like Exim and Postfix are overkill when you just want a system to be able to send email out.
sudo apt-get install bsd-mailx ssmtp
You’ll need to configure sSMTP with at least the hostname of the remote server to relay outgoing mail to, but otherwise that’s it. Simple.