No, you were a bad feminist because you let that one comment undermine you and call into question your confidence.
That's okay. We've all been bad feminists and drop the ball from time to time.
Get up. Dust yourself off. Learn the lesson. Next time, keep that spine stiff. Be fierce and Be feral about your right to be confident. Don't fritter it away on someone else's bullshit.