arm64: fix vmemmap BUILD_BUG_ON() triggering on !vmemmap setups