x86/speculation: Clean up various Spectre related details