|
|
|
HIVE-20809
|
HIVE-17718
Parse Spark error blacklist errors
|
Unassigned
|
Sahil Takiar
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
HIVE-20790
|
HIVE-17718
SparkSession should be able to close a session while it is being opened
|
Antal Sinkovits
|
Sahil Takiar
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
HIVE-20519
|
HIVE-17718
Remove 30m min value for hive.spark.session.timeout
|
Unassigned
|
Sahil Takiar
|
|
Patch Available |
Unresolved
|
|
|
|
|
|
|
|
HIVE-20512
|
HIVE-17718
Improve record and memory usage logging in SparkRecordHandler
|
Bharath Krishna
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-20488
|
HIVE-17718
SparkSubmitSparkClient#launchDriver should parse exceptions, not just errors
|
Bharath Krishna
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-20280
|
HIVE-17718
JobResultSerializer uses wrong registration id in KyroMessageCodec
|
Sahil Takiar
|
Sahil Takiar
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
HIVE-20134
|
HIVE-17718
Improve logging when HoS Driver is killed due to exceeding memory limits
|
Unassigned
|
Sahil Takiar
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
HIVE-20125
|
HIVE-17718
Typo in MetricsCollection for OutputMetrics
|
Adesh Kumar Rao
|
Sahil Takiar
|
|
Patch Available |
Unresolved
|
|
|
|
|
|
|
|
HIVE-20124
|
HIVE-17718
Re-add HIVE-19787: Log message when spark-submit has completed
|
Sahil Takiar
|
Sahil Takiar
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
HIVE-20054
|
HIVE-17718
Propagate ExecutionExceptions from the driver thread to the client
|
Unassigned
|
Sahil Takiar
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
HIVE-20037
|
HIVE-17718
Print root cause exception's toString() rather than getMessage()
|
Aihua Xu
|
Aihua Xu
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-19925
|
HIVE-17718
NPE in SparkTask#printConsoleMetrics
|
Unassigned
|
Bharath Krishna
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
HIVE-19910
|
HIVE-17718
hive.spark.log.dir isn't honored for TestSparkCliDriver
|
Unassigned
|
Sahil Takiar
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
HIVE-19787
|
HIVE-17718
Log message when spark-submit has completed
|
Bharath Krishna
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-19786
|
HIVE-17718
RpcServer cancelTask log message is incorrect
|
Bharath Krishna
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-19785
|
HIVE-17718
Race condition when timeout task is invoked during SASL negotation
|
Aihua Xu
|
Sahil Takiar
|
|
In Progress |
Unresolved
|
|
|
|
|
|
|
|
HIVE-19766
|
HIVE-17718
Show the number of rows inserted when execution engine is Spark
|
Bharath Krishna
|
Bharath Krishna
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-19733
|
HIVE-17718
RemoteSparkJobStatus#getSparkStageProgress inefficient implementation
|
Bharath Krishna
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-19559
|
HIVE-17718
SparkClientImpl shouldn't name redirector thread "RemoteDriver"
|
Bharath Krishna
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-19525
|
HIVE-17718
Spark task logs print PLAN PATH excessive number of times
|
Bharath Krishna
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-19508
|
HIVE-17718
SparkJobMonitor getReport doesn't print stage progress in order
|
Bharath Krishna
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-19422
|
HIVE-17718
Create Docker env for running HoS locally
|
Aihua Xu
|
Sahil Takiar
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
HIVE-19179
|
HIVE-17718
Organize Spark metrics into multiple groups
|
Unassigned
|
Sahil Takiar
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
HIVE-19176
|
HIVE-17718
Add HoS support to progress bar on Beeline client
|
Bharath Krishna
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-19079
|
HIVE-17718
Add extended query string to Spark job description
|
Sahil Takiar
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-19053
|
HIVE-17718
RemoteSparkJobStatus#getSparkJobInfo treats all exceptions as timeout errors
|
Aihua Xu
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-19051
|
HIVE-17718
Add units to displayed Spark metrics
|
Unassigned
|
Sahil Takiar
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
HIVE-19008
|
HIVE-17718
Improve Spark session id logging
|
Sahil Takiar
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-18958
|
HIVE-17718
Fix Spark config warnings
|
Bharath Krishna
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-18932
|
HIVE-17718
Better console logging for lifecycle of a Spark job
|
Sahil Takiar
|
Sahil Takiar
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
HIVE-18921
|
HIVE-17718
SparkClientImpl should react to errors sent from the RemoteDriver
|
Unassigned
|
Sahil Takiar
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
HIVE-18916
|
HIVE-17718
SparkClientImpl doesn't error out if spark-submit fails
|
Sahil Takiar
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-18915
|
HIVE-17718
Better client logging when a HoS session can't be opened
|
Aihua Xu
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-18869
|
HIVE-17718
Improve SparkTask OOM Error Parsing Logic
|
Unassigned
|
Sahil Takiar
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
HIVE-18831
|
HIVE-17718
Differentiate errors that are thrown by Spark tasks
|
Sahil Takiar
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-18830
|
HIVE-17718
RemoteSparkJobMonitor failures are logged twice
|
Bharath Krishna
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-18766
|
HIVE-17718
Race condition during shutdown of RemoteDriver, error messages aren't always sent
|
Aihua Xu
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-18765
|
HIVE-17718
SparkClientImpl swallows exception messages from the RemoteDriver
|
Sahil Takiar
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-18690
|
HIVE-17718
Integrate with Spark OutputMetrics
|
Sahil Takiar
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-18684
|
HIVE-17718
Race condition in RemoteSparkJobMonitor
|
Sahil Takiar
|
Sahil Takiar
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
HIVE-18677
|
HIVE-17718
SparkClientImpl usage of SessionState.LogHelper doesn't respect isSilent value
|
Sahil Takiar
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-18673
|
HIVE-17718
ErrorMsg.SPARK_JOB_MONITOR_TIMEOUT isn't formatted correctly
|
Sahil Takiar
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-18672
|
HIVE-17718
Printed state in RemoteSparkJobMonitor is ambiguous
|
Sahil Takiar
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-18663
|
HIVE-17718
Logged Spark Job Id contains a UUID instead of the actual id
|
Sahil Takiar
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-18652
|
HIVE-17718
Print Spark metrics on console
|
Sahil Takiar
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-18651
|
HIVE-17718
Expose additional Spark metrics
|
Sahil Takiar
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-18525
|
HIVE-17718
Add explain plan to Hive on Spark Web UI
|
Sahil Takiar
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-18515
|
HIVE-17718
Custom Hive on Spark Tab in Spark Web UI
|
Unassigned
|
Sahil Takiar
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
HIVE-18389
|
HIVE-17718
Print out Spark Web UI URL to the console log
|
Sahil Takiar
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-18378
|
HIVE-17718
Explain plan should show if a Map/Reduce Work is being cached
|
liyunzhang
|
Sahil Takiar
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
HIVE-18368
|
HIVE-17718
Improve Spark Debug RDD Graph
|
Sahil Takiar
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-18093
|
HIVE-17718
Improve logging when HoS application is killed
|
Sahil Takiar
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-18034
|
HIVE-17718
Improving logging with HoS executors spend lots of time in GC
|
Sahil Takiar
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-17929
|
HIVE-17718
Use sessionId for HoS Remote Driver Client id
|
Sahil Takiar
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-17838
|
HIVE-17718
Make org.apache.hive.spark.client.rpc logging HoS specific and other logging cleanup
|
Sahil Takiar
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-17837
|
HIVE-17718
Explicitly check if the HoS Remote Driver has been lost in the RemoteSparkJobMonitor
|
Sahil Takiar
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-17835
|
HIVE-17718
HS2 Logs print unnecessary stack trace when HoS query is cancelled
|
Sahil Takiar
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-17112
|
HIVE-17718
Reduce logging in HiveSparkClientFactory and RemoteHiveSparkClient
|
Sahil Takiar
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-16601
|
HIVE-17718
Display Session Id and Query Name / Id in Spark UI
|
Sahil Takiar
|
Sahil Takiar
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-14162
|
HIVE-17718
Allow disabling of long running job on Hive On Spark On YARN
|
Sahil Takiar
|
Thomas Scott
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HIVE-13517
|
HIVE-17718
Hive logs in Spark Executor and Driver should show thread-id.
|
Unassigned
|
Szehon Ho
|
|
Open |
Unresolved
|
|
|
|
|