media: rcar-vin: Move hardware buffer tracking to own struct