Hey I actually wanted to make the switch before my year 12 along with a few friends based on the same maths/science argument. It's definitely possible but just know that you'll be doing exactly as much writing/ideas study and preparation (if not more) (it will just be about language in society rather than characters/themes in a book), PLUS you'll have the catch-up content and the unfamiliar format of writing in english language, which has a different focus compared to english mainstream.
Each and every one of my friends regretted the decision to pick up english language (thought they still would have disliked regular english along with me) and ended up with, in my opinion, lower scores than they might have gotten had they not made the swap.
BUT, in your case it might be different. For example our school has only one very small english language year 12 class and the teacher isn't very experienced and wasn't able to help a few of my friends as much as they wanted.
If you are interested in making the swap, I suggest you look into what the real differences are over summer. If the tradeoff between talking about language rather than themes seems worth it to motivate you/keep you interested (and some of the stuff in englang is legitimately interesting/makes you think about language in a completely new way), then go ahead! Just don't think it's a completely maths/science version of english, you will still have to write and study in more or less the same way.