Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4793 [Umbrella] Simplified API layer for services and beyond
  3. YARN-7100

YARN service api can not reuse json file serialized in hdfs

    XMLWordPrintableJSON

    Details

      Description

      org.apache.hadoop.yarn.service.api.records.Resource has a new method introduced in YARN-6903 for casting memory from string to long value. However, the method name getMemoryMB introduces new output in json that looks like this:

          "resource" : {
            "uri" : null,
            "profile" : null,
            "cpus" : 1,
            "memory" : "2048",
            "memory_mb" : 2048
          },
      

      This prevents the file to be resubmitted to services api because memory_mb property is unknown to the REST API. It may be better to rename getMemoryMB method to calcMemoryMB to avoid the method to be serialized unintentionally.

        Attachments

        1. YARN-7100.001.patch
          2 kB
          Eric Yang
        2. YARN-7100.002.yarn-native-services.patch
          2 kB
          Eric Yang
        3. YARN-7100.003.yarn-native-services.patch
          1 kB
          Eric Yang
        4. YARN-7100.004.yarn-native-services.patch
          1 kB
          Eric Yang

          Activity

            People

            • Assignee:
              eyang Eric Yang
              Reporter:
              eyang Eric Yang
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: