Description
When Pig tries to retrieve result in fetch mode through HCatalog then HCatLoader#setLocation(String location, Job job) can't set the outputschema because HCatUtil#checkJobContextIfRunningFromBackend(job) always returns false :
public static boolean checkJobContextIfRunningFromBackend(JobContext j) { if (j.getConfiguration().get("mapred.task.id", "").equals("") && !("true".equals(j.getConfiguration().get("pig.illustrating")))) { return false; } return true; }
This is because in fetch mode we don't have a mapred.task.id. A null outputschema will raise an exception when HCatBaseLoader#getNext() is called: (ERROR 6018: Error converting read value to tuple).
Attachments
Attachments
Issue Links
- requires
-
PIG-4238 Property 'pig.job.converted.fetch' should be unset when fetch finishes
- Closed