[SPARK-4131] Support "Writing data into the filesystem from queries"

• Type: New Feature
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.1.0
• Fix Version/s: 2.3.0
• Component/s: SQL
• Labels: releasenotes
• Target Version/s: 2.3.0
• Assignee: jane
• Reporter: XiaoJing wang
• Shepherd: Michael Armbrust
• Due: 29/Oct/14
• Created: 29/Oct/14 08:33
• Updated: 21/Aug/19 02:17
• Resolved: 09/Sep/17 18:52

Description

Writing data into the filesystem from queries,SparkSql is not support .
eg:

insert overwrite LOCAL DIRECTORY '/data1/wangxj/sql_spark' select * from page_views;

Issue Links

• blocks: LENS-662 Persist query results in spark driver
• is duplicated by: SPARK-16255 Spark2.0 doesn't support the following SQL statement:"insert into directory "/u_qa_user/hive_testdata/test1/t1" select * from d_test_tpc_2g_txt.auction" while Hive supports
• links to: [Github] Pull Request #2997 (wangxiaojing)
• links to: [Github] Pull Request #4380 (scwf)
• links to: [Github] Pull Request #13067 (Parth-Brahmbhatt)
• links to: [Github] Pull Request #18975 (janewangfb)
• links to: [Github] Pull Request #19221 (janewangfb)
• links to: [Github] Pull Request #19225 (gatorsmile)
• links to: GitHub Pull Request #18975