Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-16459

Forward channelInactive to RpcDispatcher

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.3.0, 3.0.0, 2.4.0
    • Component/s: Spark
    • Labels:
      None

      Description

      In SparkTask, we try to get job infos after the query finishes. Assume the job finishes due to remote side crashes and thus closes the RPC. There's a race condition: if we try to get job info before we notice the RPC is closed, the SparkTask waits for hive.spark.client.future.timeout (default 60s) before it returns, even though we already know the job has failed.

        Attachments

        1. HIVE-16459.1.patch
          1 kB
          Rui Li
        2. HIVE-16459.2.patch
          0.8 kB
          Rui Li
        3. HIVE-16459.2.patch
          0.8 kB
          Rui Li

          Activity

            People

            • Assignee:
              lirui Rui Li
              Reporter:
              lirui Rui Li
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: