Should Only A Trans Actor/Actress Play A Trans-Character?

There is debate going on over the part of a trans-character being played by a straight guy in "The Dallas Buyers Club." Jay Leto said in the interview on HuffPost Live about the controversy that,

"I think it's wonderful for actors to be able to play roles that are outside of themselves," Leto told HuffPost Live. "That being said, you wouldn't want to stick a transgender person with only transgender roles. So it goes both ways. That's what makes art and acting really exciting is you get a chance to learn about other people and stretch and push yourself."

So should only a trans- actor/actress play the part of a trans-character?

I see both sides, what Mr. Leto said is true that it would be a great challenge to play a trans-person. But I also see that the only jobs we get are playing trans-characters. I can’t think of any trans-actor/actress who played a non-trans character, can you? So when a non-trans actor/actress plays a trans-character it takes a job away from us.