Step 1 of 4: Choose Issues

Cancel

T Patch Info Key Summary Assignee Reporter P Status Resolution Created Updated Due Development
Sub-task HIVE-20809

HIVE-17718 Parse Spark error blacklist errors

Unassigned Sahil Takiar Major Open Unresolved  
Sub-task HIVE-20790

HIVE-17718 SparkSession should be able to close a session while it is being opened

Antal Sinkovits Sahil Takiar Major Open Unresolved  
Sub-task HIVE-20519

HIVE-17718 Remove 30m min value for hive.spark.session.timeout

Unassigned Sahil Takiar Major Patch Available Unresolved  
Sub-task HIVE-20512

HIVE-17718 Improve record and memory usage logging in SparkRecordHandler

Bharath Krishna Sahil Takiar Major Closed Fixed  
Sub-task HIVE-20488

HIVE-17718 SparkSubmitSparkClient#launchDriver should parse exceptions, not just errors

Bharath Krishna Sahil Takiar Major Closed Fixed  
Sub-task HIVE-20280

HIVE-17718 JobResultSerializer uses wrong registration id in KyroMessageCodec

Sahil Takiar Sahil Takiar Major Open Unresolved  
Sub-task HIVE-20134

HIVE-17718 Improve logging when HoS Driver is killed due to exceeding memory limits

Unassigned Sahil Takiar Major Open Unresolved  
Sub-task HIVE-20125

HIVE-17718 Typo in MetricsCollection for OutputMetrics

Adesh Kumar Rao Sahil Takiar Major Patch Available Unresolved  
Sub-task HIVE-20124

HIVE-17718 Re-add HIVE-19787: Log message when spark-submit has completed

Sahil Takiar Sahil Takiar Major Open Unresolved  
Sub-task HIVE-20054

HIVE-17718 Propagate ExecutionExceptions from the driver thread to the client

Unassigned Sahil Takiar Major Open Unresolved  
Sub-task HIVE-20037

HIVE-17718 Print root cause exception's toString() rather than getMessage()

Aihua Xu Aihua Xu Trivial Closed Fixed  
Sub-task HIVE-19925

HIVE-17718 NPE in SparkTask#printConsoleMetrics

Unassigned Bharath Krishna Major Open Unresolved  
Sub-task HIVE-19910

HIVE-17718 hive.spark.log.dir isn't honored for TestSparkCliDriver

Unassigned Sahil Takiar Major Open Unresolved  
Sub-task HIVE-19787

HIVE-17718 Log message when spark-submit has completed

Bharath Krishna Sahil Takiar Major Closed Fixed  
Sub-task HIVE-19786

HIVE-17718 RpcServer cancelTask log message is incorrect

Bharath Krishna Sahil Takiar Major Closed Fixed  
Sub-task HIVE-19785

HIVE-17718 Race condition when timeout task is invoked during SASL negotation

Aihua Xu Sahil Takiar Major In Progress Unresolved  
Sub-task HIVE-19766

HIVE-17718 Show the number of rows inserted when execution engine is Spark

Bharath Krishna Bharath Krishna Major Closed Fixed  
Sub-task HIVE-19733

HIVE-17718 RemoteSparkJobStatus#getSparkStageProgress inefficient implementation

Bharath Krishna Sahil Takiar Major Closed Fixed  
Sub-task HIVE-19559

HIVE-17718 SparkClientImpl shouldn't name redirector thread "RemoteDriver"

Bharath Krishna Sahil Takiar Major Closed Fixed  
Sub-task HIVE-19525

HIVE-17718 Spark task logs print PLAN PATH excessive number of times

Bharath Krishna Sahil Takiar Major Closed Fixed  
Sub-task HIVE-19508

HIVE-17718 SparkJobMonitor getReport doesn't print stage progress in order

Bharath Krishna Sahil Takiar Major Closed Fixed  
Sub-task HIVE-19422

HIVE-17718 Create Docker env for running HoS locally

Aihua Xu Sahil Takiar Major Open Unresolved  
Sub-task HIVE-19179

HIVE-17718 Organize Spark metrics into multiple groups

Unassigned Sahil Takiar Major Open Unresolved  
Sub-task HIVE-19176

HIVE-17718 Add HoS support to progress bar on Beeline client

Bharath Krishna Sahil Takiar Major Closed Fixed  
Sub-task HIVE-19079

HIVE-17718 Add extended query string to Spark job description

Sahil Takiar Sahil Takiar Major Closed Fixed  
Sub-task HIVE-19053

HIVE-17718 RemoteSparkJobStatus#getSparkJobInfo treats all exceptions as timeout errors

Aihua Xu Sahil Takiar Major Closed Fixed  
Sub-task HIVE-19051

HIVE-17718 Add units to displayed Spark metrics

Unassigned Sahil Takiar Major Open Unresolved  
Sub-task HIVE-19008

HIVE-17718 Improve Spark session id logging

Sahil Takiar Sahil Takiar Major Closed Fixed  
Sub-task HIVE-18958

HIVE-17718 Fix Spark config warnings

Bharath Krishna Sahil Takiar Major Closed Fixed  
Sub-task HIVE-18932

HIVE-17718 Better console logging for lifecycle of a Spark job

Sahil Takiar Sahil Takiar Major Open Unresolved  
Sub-task HIVE-18921

HIVE-17718 SparkClientImpl should react to errors sent from the RemoteDriver

Unassigned Sahil Takiar Major Open Unresolved  
Sub-task HIVE-18916

HIVE-17718 SparkClientImpl doesn't error out if spark-submit fails

Sahil Takiar Sahil Takiar Major Closed Fixed  
Sub-task HIVE-18915

HIVE-17718 Better client logging when a HoS session can't be opened

Aihua Xu Sahil Takiar Major Closed Fixed  
Sub-task HIVE-18869

HIVE-17718 Improve SparkTask OOM Error Parsing Logic

Unassigned Sahil Takiar Major Open Unresolved  
Sub-task HIVE-18831

HIVE-17718 Differentiate errors that are thrown by Spark tasks

Sahil Takiar Sahil Takiar Major Closed Fixed  
Sub-task HIVE-18830

HIVE-17718 RemoteSparkJobMonitor failures are logged twice

Bharath Krishna Sahil Takiar Major Closed Fixed  
Sub-task HIVE-18766

HIVE-17718 Race condition during shutdown of RemoteDriver, error messages aren't always sent

Aihua Xu Sahil Takiar Major Closed Fixed  
Sub-task HIVE-18765

HIVE-17718 SparkClientImpl swallows exception messages from the RemoteDriver

Sahil Takiar Sahil Takiar Major Closed Fixed  
Sub-task HIVE-18690

HIVE-17718 Integrate with Spark OutputMetrics

Sahil Takiar Sahil Takiar Major Closed Fixed  
Sub-task HIVE-18684

HIVE-17718 Race condition in RemoteSparkJobMonitor

Sahil Takiar Sahil Takiar Major Open Unresolved  
Sub-task HIVE-18677

HIVE-17718 SparkClientImpl usage of SessionState.LogHelper doesn't respect isSilent value

Sahil Takiar Sahil Takiar Major Closed Fixed  
Sub-task HIVE-18673

HIVE-17718 ErrorMsg.SPARK_JOB_MONITOR_TIMEOUT isn't formatted correctly

Sahil Takiar Sahil Takiar Major Closed Fixed  
Sub-task HIVE-18672

HIVE-17718 Printed state in RemoteSparkJobMonitor is ambiguous

Sahil Takiar Sahil Takiar Major Closed Fixed  
Sub-task HIVE-18663

HIVE-17718 Logged Spark Job Id contains a UUID instead of the actual id

Sahil Takiar Sahil Takiar Major Closed Fixed  
Sub-task HIVE-18652

HIVE-17718 Print Spark metrics on console

Sahil Takiar Sahil Takiar Major Closed Fixed  
Sub-task HIVE-18651

HIVE-17718 Expose additional Spark metrics

Sahil Takiar Sahil Takiar Major Closed Fixed  
Sub-task HIVE-18525

HIVE-17718 Add explain plan to Hive on Spark Web UI

Sahil Takiar Sahil Takiar Major Closed Fixed  
Sub-task HIVE-18515

HIVE-17718 Custom Hive on Spark Tab in Spark Web UI

Unassigned Sahil Takiar Major Open Unresolved  
Sub-task HIVE-18389

HIVE-17718 Print out Spark Web UI URL to the console log

Sahil Takiar Sahil Takiar Major Closed Fixed  
Sub-task HIVE-18378

HIVE-17718 Explain plan should show if a Map/Reduce Work is being cached

liyunzhang Sahil Takiar Major Open Unresolved  
Sub-task HIVE-18368

HIVE-17718 Improve Spark Debug RDD Graph

Sahil Takiar Sahil Takiar Major Closed Fixed  
Sub-task HIVE-18093

HIVE-17718 Improve logging when HoS application is killed

Sahil Takiar Sahil Takiar Major Closed Fixed  
Sub-task HIVE-18034

HIVE-17718 Improving logging with HoS executors spend lots of time in GC

Sahil Takiar Sahil Takiar Major Closed Fixed  
Sub-task HIVE-17929

HIVE-17718 Use sessionId for HoS Remote Driver Client id

Sahil Takiar Sahil Takiar Major Closed Fixed  
Sub-task HIVE-17838

HIVE-17718 Make org.apache.hive.spark.client.rpc logging HoS specific and other logging cleanup

Sahil Takiar Sahil Takiar Major Closed Fixed  
Sub-task HIVE-17837

HIVE-17718 Explicitly check if the HoS Remote Driver has been lost in the RemoteSparkJobMonitor

Sahil Takiar Sahil Takiar Major Closed Fixed  
Sub-task HIVE-17835

HIVE-17718 HS2 Logs print unnecessary stack trace when HoS query is cancelled

Sahil Takiar Sahil Takiar Major Closed Fixed  
Sub-task HIVE-17112

HIVE-17718 Reduce logging in HiveSparkClientFactory and RemoteHiveSparkClient

Sahil Takiar Sahil Takiar Major Closed Fixed  
Sub-task HIVE-16601

HIVE-17718 Display Session Id and Query Name / Id in Spark UI

Sahil Takiar Sahil Takiar Major Closed Fixed  
Sub-task HIVE-14162

HIVE-17718 Allow disabling of long running job on Hive On Spark On YARN

Sahil Takiar Thomas Scott Major Closed Fixed  
Sub-task HIVE-13517

HIVE-17718 Hive logs in Spark Executor and Driver should show thread-id.

Unassigned Szehon Ho Major Open Unresolved  

Cancel