Very possible; he gets firm support from the GOP, which craves power, but if that erodes or splits he's in a bad state. And I think the views on his salaciousness is split between people who don't care/like it and those who put this aside/ignore it on the promises of his policies. If he can't make stuff happen, that support could easily erode.
Then again, the economy looks to be up in the short term, and this makes people happy, so maybe he will be smart (he is smart, just his ego gets in the way) and not touch anything and ride the crest of economic success.