You can also edit the config.php and find+replace, but Wordpress and plugins have a bad habit of serialization. It's faster if you know what you're doing, but it could easily turn into a nightmare real fast. Just use that plugin above, I use it to migrate entire sites to new servers and new domain names. It's pretty intuitive and self explanatory.
Good luck!
