Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
1.15.0
-
None
-
None
Description
Source table is a Hive table stored as parquet.
Issue is seen only when querying datacapturekey column, which is of VARCHAR type.
Hive 2.3
MapR Drill : 1.15.0.0-mapr
commit id : 951ef156fb1025677a2ca2dcf84e11002bf4b513
0: jdbc:drill:drillbit=test.a.node1> describe bt_br_cc_invalid_leads ;
+-------------------------------------+--------------------+--------------+
| COLUMN_NAME | DATA_TYPE | IS_NULLABLE |
+-------------------------------------+--------------------+--------------+
| wrapup | CHARACTER VARYING | YES |
| datacapturekey | CHARACTER VARYING | YES |
| leadgendate | CHARACTER VARYING | YES |
| crla1 | CHARACTER VARYING | YES |
| crla2 | CHARACTER VARYING | YES |
| invalid_lead | INTEGER | YES |
| destination_advertiser_vendor_name | CHARACTER VARYING | YES |
| source_program_key | CHARACTER VARYING | YES |
| publisher_publisher | CHARACTER VARYING | YES |
| areaname | CHARACTER VARYING | YES |
| data_abertura_ficha | CHARACTER VARYING | YES |
+-------------------------------------+--------------------+--------------+
11 rows selected (1.85 seconds)
0: jdbc:drill:drillbit=test.a.node1>
// from the view definition, note that column datacapturekey is of type VARVCHAR with precision 2000
{
"name" : "bt_br_cc_invalid_leads",
"sql" : "SELECT CAST(`wrapup` AS VARCHAR(2000)) AS `wrapup`, CAST(`datacapturekey` AS VARCHAR(2000)) AS `datacapturekey`, CAST(`leadgendate` AS VARCHAR(2000)) AS `leadgendate`, CAST(`crla1` AS VARCHAR(2000)) AS `crla1`, CAST(`crla2` AS VARCHAR(2000)) AS `crla2`, CAST(`invalid_lead` AS INTEGER) AS `invalid_lead`, CAST(`destination_advertiser_vendor_name` AS VARCHAR(2000)) AS `destination_advertiser_vendor_name`, CAST(`source_program_key` AS VARCHAR(2000)) AS `source_program_key`, CAST(`publisher_publisher` AS VARCHAR(2000)) AS `publisher_publisher`, CAST(`areaname` AS VARCHAR(2000)) AS `areaname`, CAST(`data_abertura_ficha` AS VARCHAR(2000)) AS `data_abertura_ficha`\nFROM `dfs`.`root`.`/user/bigtable/logs/hive/warehouse/bt_br_cc_invalid_leads`",
"fields" : [ {
"name" : "wrapup",
"type" : "VARCHAR",
"precision" : 2000,
"isNullable" : true
}, {
"name" : "datacapturekey",
"type" : "VARCHAR",
"precision" : 2000,
"isNullable" : true
...
...
// total number of rows in bt_br_cc_invalid_leads
0: jdbc:drill:drillbit=test.a.node1> select count(*) from bt_br_cc_invalid_leads ;
+---------+
| EXPR$0 |
+---------+
| 20599 |
+---------+
1 row selected (0.173 seconds)
Stack trace from drillbit.log
2019-03-18 12:19:01,610 [237010da-6eda-a913-0424-32f63fbe01be:foreman] INFO o.a.drill.exec.work.foreman.Foreman - Query text for query with id 237010da-6eda-a913-0424-32f63fbe01be issued by bigtable: SELECT `bt_br_cc_invalid_leads`.`datacapturekey` AS `datacapturekey`
FROM `dfs.drill_views`.`bt_br_cc_invalid_leads` `bt_br_cc_invalid_leads`
GROUP BY `bt_br_cc_invalid_leads`.`datacapturekey`
2019-03-18 12:19:02,495 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] INFO o.a.d.e.w.fragment.FragmentExecutor - 237010da-6eda-a913-0424-32f63fbe01be:0:0: State change requested AWAITING_ALLOCATION --> RUNNING
2019-03-18 12:19:02,495 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] INFO o.a.d.e.w.f.FragmentStatusReporter - 237010da-6eda-a913-0424-32f63fbe01be:0:0: State to report: RUNNING
2019-03-18 12:19:02,502 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] INFO o.a.d.exec.physical.impl.ScanBatch - User Error Occurred: Error in parquet record reader.
Message:
Hadoop path: /user/bigtable/logs/hive/warehouse/bt_br_cc_invalid_leads/000008_0
Total records read: 0
Row group index: 0
Records in row group: 1551
Parquet Metadata: ParquetMetaData{FileMetaData{schema: message hive_schema {
optional binary wrapup (UTF8);
optional binary datacapturekey (UTF8);
optional binary leadgendate (UTF8);
optional binary crla1 (UTF8);
optional binary crla2 (UTF8);
optional binary invalid_lead (UTF8);
optional binary destination_advertiser_vendor_name (UTF8);
optional binary source_program_key (UTF8);
optional binary publisher_publisher (UTF8);
optional binary areaname (UTF8);
optional binary data_abertura_ficha (UTF8);
}
, metadata: {}}, blocks: [BlockMetaData\{1551, 139906 [ColumnMetaData{UNCOMPRESSED [wrapup] optional binary wrapup (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 4}, ColumnMetaData\{UNCOMPRESSED [datacapturekey] optional binary datacapturekey (UTF8) [RLE, PLAIN, BIT_PACKED], 656}, ColumnMetaData\{UNCOMPRESSED [leadgendate] optional binary leadgendate (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 23978}, ColumnMetaData\{UNCOMPRESSED [crla1] optional binary crla1 (UTF8) [RLE, PLAIN, BIT_PACKED], 26448}, ColumnMetaData\{UNCOMPRESSED [crla2] optional binary crla2 (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 62196}, ColumnMetaData\{UNCOMPRESSED [invalid_lead] optional binary invalid_lead (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 92509}, ColumnMetaData\{UNCOMPRESSED [destination_advertiser_vendor_name] optional binary destination_advertiser_vendor_name (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 92565}, ColumnMetaData\{UNCOMPRESSED [source_program_key] optional binary source_program_key (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 93571}, ColumnMetaData\{UNCOMPRESSED [publisher_publisher] optional binary publisher_publisher (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 94587}, ColumnMetaData\{UNCOMPRESSED [areaname] optional binary areaname (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 96042}, ColumnMetaData\{UNCOMPRESSED [data_abertura_ficha] optional binary data_abertura_ficha (UTF8) [RLE, PLAIN, BIT_PACKED], 104162}]}]} (Error in parquet record reader.
Message:
Hadoop path: /user/bigtable/logs/hive/warehouse/bt_br_cc_invalid_leads/000008_0
Total records read: 0
Row group index: 0
Records in row group: 1551
Parquet Metadata: ParquetMetaData{FileMetaData{schema: message hive_schema {
optional binary wrapup (UTF8);
optional binary datacapturekey (UTF8);
optional binary leadgendate (UTF8);
optional binary crla1 (UTF8);
optional binary crla2 (UTF8);
optional binary invalid_lead (UTF8);
optional binary destination_advertiser_vendor_name (UTF8);
optional binary source_program_key (UTF8);
optional binary publisher_publisher (UTF8);
optional binary areaname (UTF8);
optional binary data_abertura_ficha (UTF8);
}
, metadata: {}}, blocks: [BlockMetaData\{1551, 139906 [ColumnMetaData{UNCOMPRESSED [wrapup] optional binary wrapup (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 4}, ColumnMetaData\{UNCOMPRESSED [datacapturekey] optional binary datacapturekey (UTF8) [RLE, PLAIN, BIT_PACKED], 656}, ColumnMetaData\{UNCOMPRESSED [leadgendate] optional binary leadgendate (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 23978}, ColumnMetaData\{UNCOMPRESSED [crla1] optional binary crla1 (UTF8) [RLE, PLAIN, BIT_PACKED], 26448}, ColumnMetaData\{UNCOMPRESSED [crla2] optional binary crla2 (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 62196}, ColumnMetaData\{UNCOMPRESSED [invalid_lead] optional binary invalid_lead (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 92509}, ColumnMetaData\{UNCOMPRESSED [destination_advertiser_vendor_name] optional binary destination_advertiser_vendor_name (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 92565}, ColumnMetaData\{UNCOMPRESSED [source_program_key] optional binary source_program_key (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 93571}, ColumnMetaData\{UNCOMPRESSED [publisher_publisher] optional binary publisher_publisher (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 94587}, ColumnMetaData\{UNCOMPRESSED [areaname] optional binary areaname (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 96042}, ColumnMetaData\{UNCOMPRESSED [data_abertura_ficha] optional binary data_abertura_ficha (UTF8) [RLE, PLAIN, BIT_PACKED], 104162}]}]})
org.apache.drill.common.exceptions.UserException: INTERNAL_ERROR ERROR: Error in parquet record reader.
Message:
Hadoop path: /user/bigtable/logs/hive/warehouse/bt_br_cc_invalid_leads/000008_0
Total records read: 0
Row group index: 0
Records in row group: 1551
Parquet Metadata: ParquetMetaData{FileMetaData{schema: message hive_schema {
optional binary wrapup (UTF8);
optional binary datacapturekey (UTF8);
optional binary leadgendate (UTF8);
optional binary crla1 (UTF8);
optional binary crla2 (UTF8);
optional binary invalid_lead (UTF8);
optional binary destination_advertiser_vendor_name (UTF8);
optional binary source_program_key (UTF8);
optional binary publisher_publisher (UTF8);
optional binary areaname (UTF8);
optional binary data_abertura_ficha (UTF8);
}
, metadata: {}}, blocks: [BlockMetaData\{1551, 139906 [ColumnMetaData{UNCOMPRESSED [wrapup] optional binary wrapup (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 4}, ColumnMetaData\{UNCOMPRESSED [datacapturekey] optional binary datacapturekey (UTF8) [RLE, PLAIN, BIT_PACKED], 656}, ColumnMetaData\{UNCOMPRESSED [leadgendate] optional binary leadgendate (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 23978}, ColumnMetaData\{UNCOMPRESSED [crla1] optional binary crla1 (UTF8) [RLE, PLAIN, BIT_PACKED], 26448}, ColumnMetaData\{UNCOMPRESSED [crla2] optional binary crla2 (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 62196}, ColumnMetaData\{UNCOMPRESSED [invalid_lead] optional binary invalid_lead (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 92509}, ColumnMetaData\{UNCOMPRESSED [destination_advertiser_vendor_name] optional binary destination_advertiser_vendor_name (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 92565}, ColumnMetaData\{UNCOMPRESSED [source_program_key] optional binary source_program_key (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 93571}, ColumnMetaData\{UNCOMPRESSED [publisher_publisher] optional binary publisher_publisher (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 94587}, ColumnMetaData\{UNCOMPRESSED [areaname] optional binary areaname (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 96042}, ColumnMetaData\{UNCOMPRESSED [data_abertura_ficha] optional binary data_abertura_ficha (UTF8) [RLE, PLAIN, BIT_PACKED], 104162}]}]}
Please, refer to logs for more information.
[Error Id: f951a96c-623e-4423-b4f9-806a29b398dd ]
at org.apache.drill.common.exceptions.UserException$Builder.build(UserException.java:633) ~[drill-common-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:293) [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:126) [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:116) [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext(AbstractUnaryRecordBatch.java:63) [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:143) [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:186) [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:126) [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:116) [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.physical.impl.aggregate.HashAggBatch.buildSchema(HashAggBatch.java:226) [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:161) [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:126) [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:116) [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext(AbstractUnaryRecordBatch.java:63) [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:143) [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:186) [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:104) [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:83) [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:94) [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.work.fragment.FragmentExecutor$1.run(FragmentExecutor.java:297) [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.work.fragment.FragmentExecutor$1.run(FragmentExecutor.java:284) [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at java.security.AccessController.doPrivileged(Native Method) [na:1.8.0_152]
at javax.security.auth.Subject.doAs(Subject.java:422) [na:1.8.0_152]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1669) [hadoop-common-2.7.0-mapr-1808.jar:na]
at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:284) [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38) [drill-common-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [na:1.8.0_152]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [na:1.8.0_152]
at java.lang.Thread.run(Thread.java:748) [na:1.8.0_152]
Caused by: org.apache.drill.common.exceptions.DrillRuntimeException: Error in parquet record reader.
Message:
Hadoop path: /user/bigtable/logs/hive/warehouse/bt_br_cc_invalid_leads/000008_0
Total records read: 0
Row group index: 0
Records in row group: 1551
Parquet Metadata: ParquetMetaData{FileMetaData{schema: message hive_schema {
optional binary wrapup (UTF8);
optional binary datacapturekey (UTF8);
optional binary leadgendate (UTF8);
optional binary crla1 (UTF8);
optional binary crla2 (UTF8);
optional binary invalid_lead (UTF8);
optional binary destination_advertiser_vendor_name (UTF8);
optional binary source_program_key (UTF8);
optional binary publisher_publisher (UTF8);
optional binary areaname (UTF8);
optional binary data_abertura_ficha (UTF8);
}
, metadata: {}}, blocks: [BlockMetaData\{1551, 139906 [ColumnMetaData{UNCOMPRESSED [wrapup] optional binary wrapup (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 4}, ColumnMetaData\{UNCOMPRESSED [datacapturekey] optional binary datacapturekey (UTF8) [RLE, PLAIN, BIT_PACKED], 656}, ColumnMetaData\{UNCOMPRESSED [leadgendate] optional binary leadgendate (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 23978}, ColumnMetaData\{UNCOMPRESSED [crla1] optional binary crla1 (UTF8) [RLE, PLAIN, BIT_PACKED], 26448}, ColumnMetaData\{UNCOMPRESSED [crla2] optional binary crla2 (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 62196}, ColumnMetaData\{UNCOMPRESSED [invalid_lead] optional binary invalid_lead (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 92509}, ColumnMetaData\{UNCOMPRESSED [destination_advertiser_vendor_name] optional binary destination_advertiser_vendor_name (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 92565}, ColumnMetaData\{UNCOMPRESSED [source_program_key] optional binary source_program_key (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 93571}, ColumnMetaData\{UNCOMPRESSED [publisher_publisher] optional binary publisher_publisher (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 94587}, ColumnMetaData\{UNCOMPRESSED [areaname] optional binary areaname (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 96042}, ColumnMetaData\{UNCOMPRESSED [data_abertura_ficha] optional binary data_abertura_ficha (UTF8) [RLE, PLAIN, BIT_PACKED], 104162}]}]}
at org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.handleException(ParquetRecordReader.java:271) ~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next(ParquetRecordReader.java:290) ~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.physical.impl.ScanBatch.internalNext(ScanBatch.java:223) [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:271) [drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
... 27 common frames omitted
Caused by: java.lang.IllegalStateException: Read batch count [0] should be greater than zero
at org.apache.drill.shaded.guava.com.google.common.base.Preconditions.checkState(Preconditions.java:509) ~[drill-shaded-guava-23.0.jar:23.0]
at org.apache.drill.exec.store.parquet.columnreaders.VarLenNullableFixedEntryReader.getEntry(VarLenNullableFixedEntryReader.java:49) ~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.store.parquet.columnreaders.VarLenBulkPageReader.getFixedEntry(VarLenBulkPageReader.java:167) ~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.store.parquet.columnreaders.VarLenBulkPageReader.getEntry(VarLenBulkPageReader.java:132) ~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.store.parquet.columnreaders.VarLenColumnBulkInput.next(VarLenColumnBulkInput.java:154) ~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.store.parquet.columnreaders.VarLenColumnBulkInput.next(VarLenColumnBulkInput.java:38) ~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.vector.VarCharVector$Mutator.setSafe(VarCharVector.java:624) ~[vector-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.vector.NullableVarCharVector$Mutator.setSafe(NullableVarCharVector.java:716) ~[vector-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.store.parquet.columnreaders.VarLengthColumnReaders$NullableVarCharColumn.setSafe(VarLengthColumnReaders.java:215) ~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.store.parquet.columnreaders.VarLengthValuesColumn.readRecordsInBulk(VarLengthValuesColumn.java:98) ~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.store.parquet.columnreaders.VarLenBinaryReader.readRecordsInBulk(VarLenBinaryReader.java:114) ~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.store.parquet.columnreaders.VarLenBinaryReader.readFields(VarLenBinaryReader.java:92) ~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.store.parquet.columnreaders.BatchReader$VariableWidthReader.readRecords(BatchReader.java:156) ~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.store.parquet.columnreaders.BatchReader.readBatch(BatchReader.java:43) ~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
at org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next(ParquetRecordReader.java:288) ~[drill-java-exec-1.15.0.0-mapr.jar:1.15.0.0-mapr]
... 29 common frames omitted
2019-03-18 12:19:02,502 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] INFO o.a.d.e.w.fragment.FragmentExecutor - 237010da-6eda-a913-0424-32f63fbe01be:0:0: State change requested RUNNING --> FAILED
2019-03-18 12:19:02,502 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] ERROR o.a.d.e.physical.impl.BaseRootExec - Batch dump started: dumping last 2 failed batches
2019-03-18 12:19:02,503 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] ERROR o.a.d.e.p.i.p.ProjectRecordBatch - ProjectRecordBatch[projector=null, hasRemainder=false, remainderIndex=0, recordCount=0, container=org.apache.drill.exec.record.VectorContainer@79a74963[recordCount = 0, schemaChanged = true, schema = null, wrappers = [], ...]]
2019-03-18 12:19:02,503 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] ERROR o.a.d.exec.physical.impl.ScanBatch - ScanBatch[container=org.apache.drill.exec.record.VectorContainer@321387c5[recordCount = 0, schemaChanged = true, schema = null, wrappers = [org.apache.drill.exec.vector.NullableVarCharVector@25c92bff[field = [`datacapturekey` (VARCHAR:OPTIONAL)], ...]], ...], currentReader=ParquetRecordReader[File=/user/bigtable/logs/hive/warehouse/bt_br_cc_invalid_leads/000008_0, Row group index=0, Records in row group=1551, Total records read=0, MetadataParquetMetaData{FileMetaData{schema: message hive_schema {
optional binary wrapup (UTF8);
optional binary datacapturekey (UTF8);
optional binary leadgendate (UTF8);
optional binary crla1 (UTF8);
optional binary crla2 (UTF8);
optional binary invalid_lead (UTF8);
optional binary destination_advertiser_vendor_name (UTF8);
optional binary source_program_key (UTF8);
optional binary publisher_publisher (UTF8);
optional binary areaname (UTF8);
optional binary data_abertura_ficha (UTF8);
}
, metadata: {}}, blocks: [BlockMetaData\{1551, 139906 [ColumnMetaData{UNCOMPRESSED [wrapup] optional binary wrapup (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 4}, ColumnMetaData\{UNCOMPRESSED [datacapturekey] optional binary datacapturekey (UTF8) [RLE, PLAIN, BIT_PACKED], 656}, ColumnMetaData\{UNCOMPRESSED [leadgendate] optional binary leadgendate (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 23978}, ColumnMetaData\{UNCOMPRESSED [crla1] optional binary crla1 (UTF8) [RLE, PLAIN, BIT_PACKED], 26448}, ColumnMetaData\{UNCOMPRESSED [crla2] optional binary crla2 (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 62196}, ColumnMetaData\{UNCOMPRESSED [invalid_lead] optional binary invalid_lead (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 92509}, ColumnMetaData\{UNCOMPRESSED [destination_advertiser_vendor_name] optional binary destination_advertiser_vendor_name (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 92565}, ColumnMetaData\{UNCOMPRESSED [source_program_key] optional binary source_program_key (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 93571}, ColumnMetaData\{UNCOMPRESSED [publisher_publisher] optional binary publisher_publisher (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 94587}, ColumnMetaData\{UNCOMPRESSED [areaname] optional binary areaname (UTF8) [PLAIN_DICTIONARY, RLE, BIT_PACKED], 96042}, ColumnMetaData\{UNCOMPRESSED [data_abertura_ficha] optional binary data_abertura_ficha (UTF8) [RLE, PLAIN, BIT_PACKED], 104162}]}]}], schema=null]
2019-03-18 12:19:02,503 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] ERROR o.a.d.e.physical.impl.BaseRootExec - Batch dump completed.
2019-03-18 12:19:02,504 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] INFO o.a.d.e.w.fragment.FragmentExecutor - 237010da-6eda-a913-0424-32f63fbe01be:0:0: State change requested FAILED --> FINISHED
2019-03-18 12:19:02,508 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] WARN o.a.d.exec.rpc.control.WorkEventBus - Fragment 237010da-6eda-a913-0424-32f63fbe01be:0:0 manager is not found in the work bus.
2019-03-18 12:19:02,520 [237010da-6eda-a913-0424-32f63fbe01be:frag:0:0] WARN o.a.d.e.w.f.QueryStateProcessor - Dropping request to move to COMPLETED state as query is already at FAILED state (which is terminal).
[test@test1917 logs]$