Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4793 [Umbrella] Simplified API layer for services and beyond
  3. YARN-7100

YARN service api can not reuse json file serialized in hdfs

    XMLWordPrintableJSON

Details

    Description

      org.apache.hadoop.yarn.service.api.records.Resource has a new method introduced in YARN-6903 for casting memory from string to long value. However, the method name getMemoryMB introduces new output in json that looks like this:

          "resource" : {
            "uri" : null,
            "profile" : null,
            "cpus" : 1,
            "memory" : "2048",
            "memory_mb" : 2048
          },
      

      This prevents the file to be resubmitted to services api because memory_mb property is unknown to the REST API. It may be better to rename getMemoryMB method to calcMemoryMB to avoid the method to be serialized unintentionally.

      Attachments

        1. YARN-7100.001.patch
          2 kB
          Eric Yang
        2. YARN-7100.002.yarn-native-services.patch
          2 kB
          Eric Yang
        3. YARN-7100.003.yarn-native-services.patch
          1 kB
          Eric Yang
        4. YARN-7100.004.yarn-native-services.patch
          1 kB
          Eric Yang

        Activity

          People

            eyang Eric Yang
            eyang Eric Yang
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: