I got a mid nineties score from a regional school with no math, science or languages. Humanities were all my Year 12 subjects. You can do well without mathematics, just make sure it does not impact on satisfying the prerequisites of your tertiary preferences. I would always advise you pursue your passions and that you do not fawn to the interests of your friends. Also, you may find that even teachers will looking at your disapprovingly if you were once part of their faculty, but, to be honest, do not give an iota about their maladjusted perspective on what subjects have intellectual rigor. I have had mathematics teachers tell me that "My subjects are easy"; well, if that is the case, why am I prepping essays all week and reading tonnes of texts? To be honest, I doubt she ever sat in any literature or philosophy classes.