Correct. You should remove him "AS SOON" as the fry become free-swimming.
Though it's cool to observe his parenting, you can never be sure when his hormones will flip, and babies become tummy-yummies.
By then, of course, you should have cultivated your infusoaria to feed the fry with -- yes, it's the best food and improves the chances of survival --
j-