Check out the following link:
http://www.mozilla.org/support/firefox/profile#backup
And if the folder seems to be empty (files are hidden under Windows Explorer), you may download the Total Commander, set the "Show system files / hidden files" option in its config options and easily do the backup.