[PIG-4705] Error Schema for data cannot be determined using HCatalog

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 0.15.0
• Fix Version/s: 0.16.0
• Component/s: tez

Environment

HDP 2.3.2

• Assignee: Unassigned
• Reporter: Krzysztof Indyk
• Created: 17/Oct/15 15:37
• Updated: 08/Jun/16 23:48
• Resolved: 26/Oct/15 10:36

Description

When we use HCatalog as source and destination of data for Pig on Tez we get ERROR 1115: Schema for data cannot be determined.
Pig works fine when we use map reduce or use HCatalog only as one of endpoints i.e. load data directly from file and store using HCatalog.

The error appears after upgrading from Pig 0.14 on Tez 0.5.2 to Pig 0.15 on Tez 0.7.0 ( HDP 2.2.6 to HDP 2.3.2).

To reproduce:

• create hive tables from hive_tables.hql
• load data to table_input from sample.csv
• run following Pig script on Tez

data = LOAD 'table_input' USING org.apache.hive.hcatalog.pig.HCatLoader();
items_unique = DISTINCT data;

counted = FOREACH (GROUP items_unique BY col2)
	    GENERATE
	      group AS name,
	      COUNT(items_unique) AS value;
  
STORE counted INTO 'table_output' USING org.apache.hive.hcatalog.pig.HCatStorer();

Issue Links

• duplicates: PIG-4703 TezOperator.stores shall not ship to backend