I think other people can see it in-game but not you. I'm not exactly sure but, they can definitely see your new name in the lobby.