I still have the problem and no answers.
Hello,
If you wish to remove the localhost portal alias you could access the database tables. - Go to:
the Portal Alias Table
In there you can delete the localhost alias.
I would try adding the local host alias back in to the table underneath the IP address alias, hopefully this should mean it searches for the IP address alias first.
Let me know if that helps, thanks,