Details
-
Bug
-
Status: To Do
-
Blocker
-
Resolution: Unresolved
-
None
-
None
Description
The reproducible repository is linked here.
Currently, airbnb is using the quantization extensions of mxnet to boost inference time on several convolutional neural network models. However, it has been difficult to achieve. The most complicated bugs lie in the intersection between the python and C++ interface, like the ones that crash jupyter kernels and are hard to run pdb on.
Airbnb currently extensively uses gluon models and are not planning to move to Module models any time soon for training, but it seems that creating a quantized Module model solely for inference is useful. Please refer to the repository for a minimum reproducible example.
Attachments
Issue Links
- links to
