I don't hate the electoral college for much the reason you suggest. However, our society is being drawn to those cities by economics. If that continues, we need to seriously re-assess the electoral college to ensure that the majority of our people are not being governed by the will of the minority, which is what happens when the popular vote and electoral college don't match up.Personally, I would want the primary system to be changed first.
I'm probably in the minority but I like the electoral college (look at all the different states, communities the candidates were visiting). My concern with a direct popular vote is that outreach would be limited to LA, Chicago, NYC
Basically we're in a really tough spot where the urban and rural votes generally disagree on pretty much everything.