it works with persistent true :P

huggingface · Jan 29, 2025 · 08cec38 · 08cec38
1 parent 62bba40
commit 08cec38
Showing 1 changed file with 0 additions and 3 deletions.
diff --git a/vision/m4/training/dataset.py b/vision/m4/training/dataset.py
@@ -1355,9 +1355,6 @@ def reset_state(self):
         # possibly won't give you correct state rather the state it had when it was initialized. Are
         # we confident that it will work this way?
 
-        # Lucile: It will work with persistent_workers=False but not with persistent_workers=True. The main
-        # reason why it will work is because this method is only used outside of the iteration on
-        # the dataloader (so the workers processes doesn't exist already)
         self.dataset.reset_state()
 
     def update_state(self, dataset_idx, dataset_state):