You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
* ``--automatic-augmentation``: ``disabled`` | ``autoaugment`` | ``trivialaugment`` (the last one only for DALI),
94
94
* ``--dali-device``: ``cpu`` | ``gpu`` (only for DALI).
95
95
96
-
By default DALI GPU-variant with AutoAugment is used.
96
+
By default DALI GPU-variant with AutoAugment is used (``dali`` and ``dali_proxy`` backends).
97
+
98
+
Data Backends
99
+
-------------
100
+
101
+
- **dali**:
102
+
Leverages a DALI pipeline along with DALI's PyTorch iterator for data loading, preprocessing, and augmentation.
103
+
104
+
- **dali_proxy**:
105
+
Uses a DALI pipeline for preprocessing and augmentation while relying on PyTorch's data loader. DALI Proxy facilitates the transfer of data to DALI for processing.
106
+
107
+
- **pytorch**:
108
+
Employs the native PyTorch data loader for data preprocessing and augmentation.
109
+
110
+
- **synthetic**:
111
+
Creates synthetic data on the fly, which is useful for testing and benchmarking purposes. This backend eliminates the need for actual datasets, providing a convenient way to simulate data loading.
97
112
98
113
For example to run the EfficientNet with AMP on a batch size of 128 with DALI using TrivialAugment you need to invoke:
99
114
@@ -161,6 +176,20 @@ To run training benchmarks with different data loaders and automatic augmentatio
Copy file name to clipboardexpand all lines: docs/examples/use_cases/pytorch/resnet50/pytorch-resnet50.rst
+12
Original file line number
Diff line number
Diff line change
@@ -44,6 +44,18 @@ The default learning rate schedule starts at 0.1 and decays by a factor of 10 ev
44
44
45
45
python main.py -a alexnet --lr 0.01 [imagenet-folder with train and val folders]
46
46
47
+
Data loaders
48
+
------------
49
+
50
+
- **dali**:
51
+
Leverages a DALI pipeline along with DALI's PyTorch iterator for data loading, preprocessing, and augmentation.
52
+
53
+
- **dali_proxy**:
54
+
Uses a DALI pipeline for preprocessing and augmentation while relying on PyTorch's data loader. DALI Proxy facilitates the transfer of data to DALI for processing.
55
+
56
+
- **pytorch**:
57
+
Employs the native PyTorch data loader for data preprocessing and augmentation.
0 commit comments