Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9563

Resource report REST API could return NaN or Inf

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 2.10.0, 3.0.4, 3.3.0, 2.8.6, 3.2.1, 2.9.3, 3.1.3
    • None
    • None

    Description

      The Resource Manager's Cluster Applications and Cluster Application REST APIs are sometimes returning invalid JSON. This was addressed in YARN-6082.

      However, the fix only fixes the calculation in one site and does not guarantee to avoid the problem.Likewise, generating NaN/Inf can break the web GUI if the columns cannot render non-numeric values.

      The suggested fix is to check for NaN/Inf in the protob. The protob replaces NaN/Inf by 0.0f.

      Attachments

        1. YARN-9563.001.patch
          8 kB
          Ahmed Hussein
        2. YARN-9563.002.patch
          4 kB
          Ahmed Hussein
        3. YARN-9563.003.patch
          4 kB
          Ahmed Hussein
        4. YARN-9563.004.patch
          4 kB
          Ahmed Hussein
        5. YARN-9563.005.patch
          4 kB
          Ahmed Hussein
        6. YARN-9563.006.patch
          4 kB
          Ahmed Hussein
        7. YARN-9563-branch-2.8.001.patch
          6 kB
          Ahmed Hussein
        8. YARN-9563-branch-2.9.001.patch
          4 kB
          Ahmed Hussein
        9. YARN-9563-branch-3.0.001.patch
          4 kB
          Ahmed Hussein

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-18954 Filter NaN values from JMX json interface

          • Major - Major loss of function.
          • Resolved
          supercedes

          Bug - A problem which impairs or prevents the functions of the product. YARN-6082 Invalid REST api response for getApps since queueUsagePercentage is coming as INF

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Activity

            People

              ahussein Ahmed Hussein
              ahussein Ahmed Hussein
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: