If you want this permanent, save your weapon loadout. And don't even bother to change it, along with your character :p