[KYLIN-3500] kylin 2.4 use jdbc datasource :Unknown column 'A.A.CRT_DATE' in 'where clause'

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: v2.3.0, v2.4.0
• Fix Version/s: v2.4.1, v2.5.0
• Component/s: RDBMS Source
• Environment: Hadoop2.7.6+Hive-1.2.2+HBase1.2.6+Sqoop1.4.7
• Assignee: jimmyz
• Reporter: cqli
• Created: 15/Aug/18 08:42
• Updated: 09/Sep/18 05:53
• Resolved: 20/Aug/18 08:02

Description

Kylin2.4 使用JDBC数据源，构建时通过Sqoop从mysql抽取数据到hive报错,split-by字段出现名重复：tablename.tablename.field

sqoop-1.4.6/bin/sqoop import -Dorg.apache.sqoop.splitter.allow_text_splitter=true -Dmapreduce.job.queuename=default --connect "jdbc:mysql://192.168.31.108:3306/kylin_jdbcresource_test" --driver com.mysql.jdbc.Driver --username root --password root1324 --query "SELECT A.NAME as A_NAME ,A.CRT_DATE FROM KYLIN_JDBCRESOURCE_TEST.A as A  WHERE 1=1 AND (A.CRT_DATE >= '2018-08-01 00:00:00' AND A.CRT_DATE < '2018-08-16 00:00:00')  AND \$CONDITIONS" --target-dir hdfs://localhost:9000/kylin/kylin_metadata/kylin-6bbe475b-ad11-4501-b3db-a56ee0222c90/kylin_intermediate_jdbc_resource_cube_7a4bd639_38ac_41be_9fba_6c64e040b175 --split-by A.A.CRT_DATE --boundary-query "SELECT min(A.CRT_DATE), max(A.CRT_DATE) FROM "KYLIN_JDBCRESOURCE_TEST".A as A WHERE A.CRT_DATE >= '2018-08-01 00:00:00' AND A.CRT_DATE < '2018-08-16 00:00:00'" --null-string '' --fields-terminated-by '|' --num-mappers 1

Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Unknown column 'A.A.CRT_DATE' in 'where clause'

Issue Links

• links to: GitHub Pull Request #203