net: qca_spi: Avoid reading signature three times in a row