PVC would be ideal if you were setting up something new. Repiping your whole house would be a little more than a day project to say the least.
If you can find out exactly what the issue is there's lots of stuff you can put inline (sediment filters, stuff to change the ph, etc) and that's probably worth looking into.
If you do decide to replace leaky sections with PVC, and they're hot water sections remember the max temp for PVC is 140.