[SPARK-25521] Job id showing null when insert into command Job is finished.

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.3.1
• Fix Version/s: 2.4.0
• Component/s: Spark Core, SQL
• Assignee: Sujith Chacko
• Reporter: Babulal
• Created: 25/Sep/18 06:27
• Updated: 05/Oct/18 08:54
• Resolved: 05/Oct/18 08:54

Description

scala> spark.sql("create table x1(name string,age int) stored as parquet")
scala> spark.sql("insert into x1 select 'a',29")
check logs
2018-08-19 12:45:36 INFO TaskSetManager:54 - Finished task 0.0 in stage 0.0 (TID 0) in 874 ms on localhost (executor
driver) (1/1)
2018-08-19 12:45:36 INFO TaskSchedulerImpl:54 - Removed TaskSet 0.0, whose tasks have all completed, from pool
2018-08-19 12:45:36 INFO DAGScheduler:54 - ResultStage 0 (sql at <console>:24) finished in 1.131 s
2018-08-19 12:45:36 INFO DAGScheduler:54 - Job 0 finished: sql at <console>:24, took 1.233329 s
2018-08-19 12:45:36 INFO FileFormatWriter:54 - Job null committed.
2018-08-19 12:45:36 INFO FileFormatWriter:54 - Finished processing stats for job null.
res4: org.apache.spark.sql.DataFrame = []

 

 

 

 

Issue Links

• links to: [Github] Pull Request #22572 (sujith71955)