Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17718 Hive on Spark Debugging Improvements
  3. HIVE-19787

Log message when spark-submit has completed

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 4.0.0-alpha-1
    • Spark
    • None

    Description

      If spark-submit runs successfully the "Driver" thread should log a message. Otherwise there is no way to know if spark-submit exited successfully. We should also rename the thread to some more informative than "Driver".

      Without this, debugging timeout exceptions of the RemoteDriver -> HS2 connection is difficult, because there is no way to know if spark-submit finished or not.

      Attachments

        1. HIVE-19787.1.patch
          1 kB
          Bharath Krishna

        Activity

          People

            bharos92 Bharath Krishna
            stakiar Sahil Takiar
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: