Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-12812

Enable mapred.input.dir.recursive by default to support union with aggregate function

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.2.1, 2.1.0
    • 4.0.0-alpha-1
    • Hive
    • None

    Description

      When union remove optimization is enabled, union query with aggregate function writes its subquery intermediate results to subdirs which needs mapred.input.dir.recursive to be enabled in order to be fetched. This property is not defined by default in Hive and often ignored by user, which causes the query failure and is hard to be debugged.
      So we need set mapred.input.dir.recursive to true whenever union remove optimization is enabled.

      Attachments

        1. HIVE-12812.1.patch
          19 kB
          Alice Fan
        2. HIVE-12812.2.patch
          19 kB
          Alice Fan
        3. HIVE-12812.patch
          31 kB
          Chaoyu Tang
        4. HIVE-12812.patch
          31 kB
          Chaoyu Tang
        5. HIVE-12812.patch
          31 kB
          Chaoyu Tang

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. HIVE-20319 group by and union all always generate empty query result

          • Blocker - Blocks development and/or testing work, production could not run
          • Open

          Activity

            People

              afan Alice Fan
              ctang Chaoyu Tang
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: