Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-1836

Provide better error messages when tez.runtime.io.sort.mb is wrongly configured

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.5.4
    • Component/s: None
    • Labels:
      None
    • Target Version/s:

      Description

      For tez.runtime.io.sort.mb=3000, following error message is thrown
      >>>
      info=[Error: Failure while running task:java.lang.RuntimeException: java.io.IOException: Invalid "tez.runtime.io.sort.mb": 3000
      >>>

      This should mention the range of valid configuration for "tez.runtime.io.sort.mb" (1 to 2047)

      For tez.runtime.io.sort.mb=0, following error message is thrown
      >>>>
      info=[Error: Failure while running task:java.lang.IllegalArgumentException: io.sort.mb should be larger than 0
      at com.google.common.base.Preconditions.checkArgument(Preconditions.java:88)
      at org.apache.tez.runtime.library.common.sort.impl.ExternalSorter.getInitialMemoryRequirement(ExternalSorter.java:289)
      >>>>

      This should mention "tez.runtime.io.sort.mb" and not "io.sort.mb".

        Attachments

        1. TEZ-1836.1.patch
          5 kB
          Vasanth kumar RJ
        2. TEZ-1836.2.patch
          8 kB
          Vasanth kumar RJ
        3. TEZ-1836.3.patch
          8 kB
          Vasanth kumar RJ
        4. TEZ-1836.3.2.txt
          8 kB
          Siddharth Seth

          Issue Links

            Activity

              People

              • Assignee:
                vasanthkumar Vasanth kumar RJ
                Reporter:
                rajesh.balamohan Rajesh Balamohan
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: