efi: x86: clean up previous struct mm switching