Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
Currently, due to the projection pushdown, in the ThriftRecordConverter, it will check if there is any protocol events missing for the required fields and fix them if there is. This happens for all the records.
The fixing of missing protocol can be done in a more precise condition to improve performance:
Only when the requested schema missing some required fields that are present in the full schema
So even if there a projection, as long as the projection is not getting rid of the required field, the protocol events amender will not be called.