drm/amd/display: clean up encoding checks