block: clear ->slave_dir when dropping the main slave_dir reference