[GOBBLIN-259] Support writing Kafka messages to db/table file path

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.12.0
• Labels: Writer:HDFS
• Sprint: Apache Gobblin 170807, Apache Gobblin 170821, Apache Gobblin 170905
• Assignee: Zhixiong Chen
• Reporter: Zhixiong Chen
• Created: 19/Sep/17 20:23
• Updated: 03/Jan/18 06:42
• Resolved: 20/Sep/17 20:51

Description

• Add a new write file path type `DB_TABLE`, which writes records from an `Extract` to folder <namespace>/<table>.
• A gobblin job which uses the `KafkSource` and `AvroHdfsDataWriter` will write records to 'dbName/tableName' with the following configurations:

  extract.namespace=dbName
  extract.table.name=tableName
  writer.file.path.type=db_table
  

Issue Links

• is a clone of: GOBBLIN-87 Gobblin runOnce not working correctly