The problem with that is that if we lose the semi then the 4th team ends up getting home advantage over the 2nd/3rd side.
Not necessarily, it could be done the same was as the play-offs here where the highest ranked team in the final gets to host it.