No, the man DOES have rights even before he knows if the woman is pregnant. They just arent aware of it in most cases. Even lawyers are unaware of "putative fathers registries"
ie:
http://www.putativefather.org/
You can retain your legal rights as a parent, if you know about them.
You have to register, and make attempts (as you naturally would do) to contact, help and support the care and interests of your baby. But above all, you have to quit saying that men have no rights.
Call information and ask for your local Putative Fathers Registry. If you are on the list, your baby can NOT be put up for adoption right out from under you.