I own duplexes, tripexes, fourplexes and fiveplexes.
If the numbers are good, which means better than breaking even every month because of course there will be insurance, maintenance and utilities (if your tenants are not paying for them).
I would go for it, if you need a good mortgage broker in Canada let me know
DH