Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-490

set mapred.reduce.tasks to -1 in hive-default.xml

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.4.0
    • Clients
    • None
    • Reviewed
    • HIVE-490. Add missing configuration variables to hive-default.xml. (Yongqiang He via zshao)

    Description

      this is profoundly irritating. we can estimate reducers. but since hadoop-default.xml sets this to '1' - by default we don't. if we expect most users to set this to -1 - then we might as well set it to -1 ourselves.

      to not shoot ourselves in the foot - we might want to cap number of reducers based on cluster size (like 2*Nodes).

      Attachments

        1. hive-490-2009-05-23.patch
          0.7 kB
          He Yongqiang
        2. hive-490-2009-05-23-2.patch
          0.8 kB
          He Yongqiang
        3. hive-490-2009-05-23-3.patch
          1 kB
          He Yongqiang
        4. hive-490-2009-05-26.patch
          1 kB
          He Yongqiang

        Activity

          People

            Unassigned Unassigned
            jsensarma Joydeep Sen Sarma
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: