RDMA/cm: Fix an attempt to use non-valid pointer when cleaning timewait