[MXNET-1370] Support DataIter, or custom DataLoader (Nvidia DALI)

• Type: New Feature
• Status: To Do
• Priority: Major
• Resolution: Unresolved
• Component/s: Gluon
• Epic Link: Gluon Fit API
• Assignee: Unassigned
• Reporter: Lai Wei
• Created: 27/Mar/19 12:44
• Updated: 27/Mar/19 12:44

Description

1. In estimator, we should make the convention that data/label are provided in DataLoader format
2. provide util function in mx.io for users to convert DataIters into DataLoader format
3. Accept custom util functions to convert custom DataLoader into DataLoader format.
4. Note: common way of using DataLoader: data=batch[0], label=batch[1], using DataIter, data=batch.data[0], label=batch.label[0]