I think you can try both at the same time actually.
You got an awesome taste from your friends on what clothing design can be. Do you have a theater in your school, or a local professional one? You can try costume design for more of the “this is what it’s like as work” idea. I’m not going to lie, you might even find work as a sculptor in theater, but your background in sculpting will definitely feed your experience as a costume designer or even just in costume construction. So you could spend two years in consume construction as a hobby and decide that’s what you really do, then move into a master program with fashion design.
I’m not in retail anymore, and I never did clothing retail, but working in theater costuming has really changed my ideas. Like, I know I am fat because at my height and weight my bmi puts me well in obese territory. But measuring people a few inches taller has put an interesting spin in my head. I know someone with the same bust size who is three inches taller and now I understand why some “large” sizes will fit both of us even though by size my cup is several sizes larger than her.
People have been telling me for years that I’m “not fat”. I know they are delusional because of the numbers, but seeing other people with similar measurements does actually put it into perspective.