perf/imx_ddr: Use irq_set_affinity()