Comes from that children's song The Itsy Bitsy Spider. But then morphed to itty bitty by baby talk.

Itty Bitty is something you usually hear little girls and mothers say.

But yes, generally it means small and insignificant.