[SQOOP-3369] Investigate sqoop import + --incremental + lastmodified + --as-avrodatafile use case

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.4.7
• Assignee: Unassigned
• Reporter: Boglarka Egyed
• Created: 23/Aug/18 09:57
• Updated: 23/Aug/18 10:03

Description

Currently the sqoop import + --incremental + lastmodified + --as-avrodatafile command fails fast with the following message:

WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.

--incremental lastmodified cannot be used in conjunction with --as-avrodatafile.

However the merge-tool supports AvroData file format too, see https://sqoop.apache.org/docs/1.4.7/SqoopUserGuide.html#_literal_sqoop_merge_literal.

It should be checked whether the fail fast is still valid or --incremental lastmodified work with AvroData file format too.