[MXNET-1050] As a user, I would like to speed up training job using multithreading

• Type: Story
• Status: To Do
• Priority: Major
• Resolution: Unresolved
• Component/s: Apache MXNet Backend
• Epic Link: Thread Safety
• Assignee: Unassigned
• Reporter: Lin Yuan
• Created: 08/Oct/18 21:00
• Updated: 08/Oct/18 21:32

Description

Currently, multithreading in training is achieved through OpenMP at operator level. There are issues filed on GitHub about OpenMP in MXNet. Besides, there is no clear benchmark on the performance impact on various platforms

Acceptance Criteria

• Fix/address all issues related to OpenMP
• Understand the performance impact of OpenMP with benchmarks
• Provide an optimal thread setting for users at different computing platforms

Issue Links

• requires: MXNET-1051 Fix the current issue in OpenMP
• requires: MXNET-1053 Performance benchmark with and without multithreaded training
• requires: MXNET-1056 Implement an algorithm to select the optimal number of threads in OpenMP for each platform