interconnect: Restore sync state by ignoring ipa-virt in provider count