Sounds like your true regrer is letting other people's opinions inform your choices too much, rather than not having children because you didn't choose to not have children per se, you ran out of time by following someone else's dictates rather than your own desires.

Had you followed the advice of a pronatalist though, you would likely refrer having had children for exactly the same reason.