[TRAFODION-2352] UPDATE STATS may fail with error 8446 on Hive tables

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.1-incubating
• Fix Version/s: 2.1-incubating
• Component/s: sql-cmp
• Environment: All
• Assignee: Dave Birdsall
• Reporter: Dave Birdsall
• Created: 10/Nov/16 21:54
• Updated: 15/Sep/18 07:30
• Resolved: 14/Nov/16 20:04

Description

UPDATE STATISTICS may fail on a Hive table with very long varchar columns. The symptom is an error 8446 "An error occurred during hdfs buffer fetch. Error Detail: No record delimiter found in buffer from hdfsRead." This happens when reading data from the table, and the query plan for the read happens to be a parallel plan.

The problem relates to CQD HIVE_MAX_STRING_LENGTH_IN_BYTES. This defaults to 32000. When a Hive table has a column with a value having a length longer than this, we might get this error even though the user may have issued a CQD for this with a larger value.

Issue Links

• links to: GitHub Pull Request #830