Actually, if the opposite occurred, I'd be just as outraged.
Once you are employed, there should be a legitimate reason to fire you. People's livelihoods are dependent on this. Your employer finding you too hot is not a valid reason. This is reflected in Australian legislation by the way, as it always has been - without a doubt, this would qualify for Unfair Dismissal here. Would you want to live in a world where employers can fire employees for any reason? There's a reason why we protect employees from exploitation.
Whether or not there is gender discrimination, it is discrimination based on physical appearance, which in Victoria is
prohibited under the Equal Opportunity Act.