net/smc: reduce smc_listen_decline() calls