Joomla has been a huge pain for me. I built my first website with it and obviously had no idea what I was doing, so just about everything that could have gone wrong did - and I'm pretty sure that was the vulnerability that hacked my email server a few years ago.
Wordpress is a lot more intuitive, and it is a great platform for publishing content-based sites. Add in all the great free templates and plugins, and you can get things pretty customized without too much effort or technical know-how.
Of course, if you know your way around Joomla it is pretty powerful and there is a lot you can do with it beyond simple informational pages. Then again, isn't Drupal rather similar? I hear that one recommended a lot, as well, but I haven't had any personal experience with it.