As it happens we have the perfect control experiment in this regard- the other riders in the pro-peleton who are riding under an AAF, or who have recently had one. We don't know who they are, because their status was not leaked to the whole world. Are you suggesting that they be exposed and binned out of the Tour as well? That sounds to me a very extreme position.
Froome's case is a right ballache for all concerned but it is the UCI causing all of the aggravation - leaking it in the first place [or was it a hack?, either way it's terrible] and then failing to resolve it for months and months.
No they won't be looking at them; their presence doesn't damage the image of the TdF since they are unknown to the wider audience.
They'll look at the Di Luca's, the Fuentes cases and indeed Boonen who they once (tried to) ban(ned). They'll look at those cases and then they'll decide if the measure is in proportion to the perceived damage that the TdF will suffer with Froome being present. With Froome being present, the Tour won't be about the mountains, TT's ... ; it will be about Froome's (perceived) doping and the resulting legal consequences. Not about a race, just another vaudeville.
The failing to resolve is for a large part Froome and Sky's fault tbf, he's been stalling the whole thing for ages. He wants to take a part of his probably suspension during off-season; they are (rightly) gambling on the incompetent UCI doping committee. Also apparently they've already offered him a settlement, but he refused ...
If they simply prove UCI's incompetence and Sky stalling the whole thing, then they'll be okay.