[SPARK-4574] Adding support for defining schema in foreign DDL commands.

• Type: Sub-task
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.1.0
• Fix Version/s: 1.3.0
• Component/s: SQL
• Target Version/s: 1.3.0
• Sprint: Spark 1.5 release
• Assignee: Fei Wang
• Reporter: Fei Wang
• Created: 24/Nov/14 15:12
• Updated: 28/Jan/15 08:07
• Resolved: 10/Jan/15 21:54

Description

Adding support for defining schema in foreign DDL commands. Now foreign DDL support commands like:

   CREATE TEMPORARY TABLE avroTable
   USING org.apache.spark.sql.avro
   OPTIONS (path "../hive/src/test/resources/data/files/episodes.avro")

Let user can define schema instead of infer from file, so we can support ddl command as follows:

   CREATE TEMPORARY TABLE avroTable(a int, b string)
   USING org.apache.spark.sql.avro
   OPTIONS (path "../hive/src/test/resources/data/files/episodes.avro")

Issue Links

• links to: [Github] Pull Request #3431 (scwf)