[HIVE-8484] HCatalog throws an exception if Pig job is of type 'fetch'

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.14.0
• Fix Version/s: 0.14.0
• Component/s: HCatalog
• Hadoop Flags: Reviewed
• Assignee: Unassigned
• Reporter: Lorand Bendig
• Created: 16/Oct/14 11:24
• Updated: 13/Nov/14 19:42
• Resolved: 07/Nov/14 23:25

Description

When Pig tries to retrieve result in fetch mode through HCatalog then HCatLoader#setLocation(String location, Job job) can't set the outputschema because HCatUtil#checkJobContextIfRunningFromBackend(job) always returns false :

public static boolean checkJobContextIfRunningFromBackend(JobContext j) {
    if (j.getConfiguration().get("mapred.task.id", "").equals("") &&
        !("true".equals(j.getConfiguration().get("pig.illustrating")))) {
      return false;
    }
    return true;
  }

This is because in fetch mode we don't have a mapred.task.id. A null outputschema will raise an exception when HCatBaseLoader#getNext() is called: (ERROR 6018: Error converting read value to tuple).

Issue Links

• requires: PIG-4238 Property 'pig.job.converted.fetch' should be unset when fetch finishes