[SPARK-21313] ConsoleSink's string representation

• Type: Improvement
• Status: Resolved
• Priority: Trivial
• Resolution: Fixed
• Affects Version/s: 2.1.1
• Fix Version/s: 2.3.0
• Component/s: Structured Streaming
• Assignee: Jacek Laskowski
• Reporter: Jacek Laskowski
• Created: 05/Jul/17 08:12
• Updated: 26/Jul/18 12:17
• Resolved: 07/Jul/17 07:31

Description

Add toString with options for ConsoleSink so it shows nicely in query progress.

BEFORE

  "sink" : {
    "description" : "org.apache.spark.sql.execution.streaming.ConsoleSink@4b340441"
  }

AFTER

  "sink" : {
    "description" : "ConsoleSink[numRows=10, truncate=false]"
  }

Issue Links

• relates to: SPARK-24647 Sink Should Return Writen Offsets For ProgressReporting
• relates to: SPARK-24933 SinkProgress should report written rows
• links to: [Github] Pull Request #18539 (jaceklaskowski)