amba: Retry adding deferred devices at late_initcall