drm/armada: no need to check parent of remote