blk-throttle: Avoid tracking latency if low limit is invalid