[CARBONDATA-3917] The rows of data loading is not accurate, more rows has been loaded

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 2.0.0
• Fix Version/s: 2.1.1
• Component/s: data-load
• Assignee: Unassigned
• Reporter: Taoli
• Created: 21/Jul/20 02:09
• Updated: 17/Mar/21 02:52
• Resolved: 14/Dec/20 05:06

Description

2020-07-18 18:46:23,856 | INFO | [Executor task launch worker for task 28380] | Total rows processed in step Data Writer: 1277745 | org.apache.carbondata.processing.loading.AbstractDataLoadProcessorStep.close(AbstractDataLoadProcessorStep.java:138)
2020-07-18 18:46:23,857 | INFO | [Executor task launch worker for task 28380] | Total rows processed in step Sort Processor: 1189959 | org.apache.carbondata.processing.loading.AbstractDataLoadProcessorStep.close(AbstractDataLoadProcessorStep.java:138)
2020-07-18 18:46:23,856 | DEBUG | [LocalFolderDeletionPool:detail_cdr_s1mme_18461_1595087183856] | PrivilegedAction as:omm (auth:SIMPLE) from:org.apache.carbondata.core.util.CarbonUtil.deleteFoldersAndFiles(CarbonUtil.java:298) | org.apache.hadoop.security.UserGroupInformation.logPrivilegedAction(UserGroupInformation.java:1756)
2020-07-18 18:46:23,857 | INFO | [Executor task launch worker for task 28380] | Total rows processed in step Data Converter: 1189959 | org.apache.carbondata.processing.loading.AbstractDataLoadProcessorStep.close(AbstractDataLoadProcessorStep.java:138)
2020-07-18 18:46:23,857 | INFO | [Executor task launch worker for task 28380] | Total rows processed in step Input Processor: 1189959 | org.apache.carbondata.processing.loading.AbstractDataLoadProcessorStep.close(AbstractDataLoadProcessorStep.java:138)