Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Fixed
-
0.5
-
None
-
None
Description
HCOF methods use Job everywhere when really all they need is Configuration/Credentials. In Giraph we have a few places where we don't have a Job object but we do have the Configuration/Credentials. When the job starts we have the Job object, but later when the workers are deep in their computation all they have is the context they need, namely the Configuration (not the whole Job). We need to call some HCatalog methods from them because we we want to write data multiple times, so it seems cleaner to allow HCatalog methods to just take the Configuration object when that is all that is needed.