media: rcar-vin: Unconditionally unregister notifier on remove