Seems like unstored PointFields return Long types, ignoring the actual type.
SOLR-5944 Support updates of numeric DocValues