Details
-
Story
-
Status: To Do
-
Major
-
Resolution: Unresolved
-
None
Description
It looks like SymbolBlock will initializing all the parameters using the initializer given in the block.initialize() function, including bias, which cannot be initialized by Xavier.
Alought that post suggests a solution, and in addition, I think we should try to initialize the parameters if it was given in the symbol/json file.
e.g.
bias = mx.sym.Variable(name='conv_bias', shape=(num_filter,), init=mx.init.Zero())
or
{{{ "op": "null", "name": "conv_bias", "attrs": { "_init": "[\"zero\", {}]", "shape_": "(64,)" }, "inputs": [] }}}
Attachments
Issue Links
- links to