Major Description
It can be construed as potentially dangerous to let user code change any of the settings of the builder, as other parts of the code could be using a reference to the same instance.
In Commons Math, where the fluent API pattern was applied, a new builder (immutable) instance would be created. For example, see this class.