They stay if you're playing regularly, like 1 player or 2 player if you load up mame and just start umk3. However, if you're playing a network game on kailerra, you'll have to do them again with the other person if you want to use mileena, ermac or classic sub zero.
That or do randper kombat...