One time David Garmo (one of the most bad ass competitors from my affiliation, just went to worlds last year) told my coach and a few of us that were there:
"You want to know what makes me good? I'm not the strongest person, you all are probably stronger than me. I'm not the fastest person either. I'm not even that flexible, but you know what I do have? I've been to 70-80+ tournaments and have been put in every situation you can imagine."
I thought that was a very interesting thing to hear from a high level competitor because sometimes it can feel intimidating when we aren't as physically gifted/conditioned as other people in our craft, but hard work and experience can overcome any physical advantage
P.S. That doesn't mean working on our physical attributes won't help, its just a piece of the puzzle!