Probably depends on the person, the context and how they feel.So what toilet is a trans person going to use. They going to have to piss against the wall?
Many work places have unisex toilets which are individual units.
In public places it can be more challenging. I've got trans friends/colleagues who don't necessarily like 'presenting' in the wider public and would think twice about going into a toilet if they were - for fear of the abuse they'd get.
Also know someone who does 'present' and gets around it by using the disabled loo in pubs, again because of the potential for abuse.
All of the above are obviously problematic. As Charro says, it's a really challenging topic.