[FALCON-1498] Add more parameters for HCatalogue input feed

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 0.6
• Component/s: feed

Environment

HDP-2.2.0

• Assignee: Unassigned
• Reporter: Rishav Rohit
• Created: 29/Sep/15 14:44
• Updated: 29/Sep/15 14:48

Description

Add more parameters like falcon_<input_name>_partitions for HCatalogue input feed.

A use case which I can think of now is described below -
Suppose there are two date partitioned input table and you want to join these tables on date partition column -

INSERT OVERWRITE TABLE ${falcon_output_database}.${falcon_output_table} PARTITION (${falcon_output_partitions_hive})
SELECT "join_count", count(*)
FROM ${falcon_input1_database}.${falcon_input1_table} a,
${falcon_input2_database}.${falcon_input2_table} b
-- these parameters are not available
WHERE a.${falcon_input1_partitions}
AND b.${falcon_input2_partitions};

--- workaround, use output feed parameters
WHERE a.${falcon_output_partitions}
AND b.${falcon_output_partitions}

Some other workaround is also possible, but presence of more parameters would help.