[MXNET-1036] As a MXNet user, I would like to understand if MXNet is thread safe and how to leverage multithreading in MXNet

• Type: Story
• Status: To Do
• Priority: Major
• Resolution: Unresolved
• Component/s: Apache MXNet Backend
• Epic Link: Thread Safety
• Assignee: Unassigned
• Reporter: Lin Yuan
• Created: 08/Oct/18 18:11
• Updated: 08/Oct/18 21:32

Description

Acceptance Criteria

• well understand the scenarios when thread safety is uphold or not
• provide a clear message to users about thread safety limitation
• identify the scope to make MXNet thread safe

Issue Links

• requires: MXNET-1044 Reproduce the bug in multithreaded inference inside MXNet engine
• requires: MXNET-1045 Understand the current workaround in Java/Scala API using multithreaded inference
• requires: MXNET-1046 Implement a thread pool mechanism in engine
• requires: MXNET-1047 Document the thread safety and its limitation
• requires: MXNET-1048 Understand the current workaround/difficulty in C++ API using multithreaded inference
• requires: MXNET-1049 Understand the multithreaded inference in Python API
• requires: MXNET-1052 Performance benchmark with and without multithreaded inference
• requires: MXNET-1057 Fix issues related to thread safety