Wow! At the minute I'm looking at the ethics of stem cell research and human cloning for my religion and society class and came to many similar conclusions. On the whole, people are a lot more willing to accept medical uses of these sciences but are resistant to using them for cosmetic reasons.
If I recall correctly, in
Homo Deus Yuval Harari Noah argued that most things with a potential downside (such as gene editing, cybernetics, AI, probably a bunch of others) would be unable to be stopped, because we couldn't justify blocking medical research, but once the research is done it won't just be limited to positive uses (cosmetics is mostly neutral, but he talked about examples like building a better soldier). Made sense to me.