Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Spark
    • Labels:
      None
    • Target Version/s:

      Description

      It looks like SparkDynamicPartitionPruner is being called by every Spark task because it gets created whenever getRecordReader is called on the associated InputFormat.

        Attachments

        1. HIVE-20056.1.patch
          7 kB
          Sahil Takiar
        2. HIVE-20056.2.patch
          7 kB
          Sahil Takiar

          Activity

            People

            • Assignee:
              stakiar Sahil Takiar
              Reporter:
              stakiar Sahil Takiar
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: