I agree with that, but you're talking about raising children and then getting hung up on pregnancy.
As a single father, you're much more likely to get familial and community help than a single mother. People will be falling all over themselves to sypport you. Mothers do not get that.
As a single father, you'll get nearly every slack in the world. The fact that you stuck around will become proof of your superioe morality over EVERYTHING. You will get every benefit of the doubt. Single mothers don't get that either. After all, if they didn't have loose morals in the first placez they wouldn't be single mothers.
I could go on, but the point here is that as a single father you will not be punished societally for your single parenthood in the numerous ways that moms are. That means that parenting will be easier for you.
Is it harder to acquire a child? Yes. Significantly? Arguable. Everything after acquisition? It will not be any harder, and in a lot of ways it will be easier and better.
There aren't more songle fathers because most men don't really want the full burden of child care. That's not a moral judgement. People should only become parents if they're fully willing to make that investment and sacrifice. It's better to know you don't really want it than be stuck and be a bad parent because of it.