iavf: fix potential races for FDIR filters