Presidential Elections

It seems silly to be that despite being a democracy, our country can get into a situation where the person with the most votes is not elected president. The people of a state should not be represented as one whole unified people with the same opinion, and their votes should not be treated like they are either. Why not just have citizen's votes directly correlate to the person they want as President? That seems much more fair to me. It also seems like  with the current system of electoral votes that despite changes in preference for the presidential nominees, it would be harder to have the non-incumbent party's candidate elected. The whole concept of electoral votes in place of a direct vote sounds silly to me.