devlink: Set device as early as possible