Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5577

[Atsv2] Document object passing in infofilters with an example

    Details

    • Hadoop Flags:
      Reviewed

      Description

      In HierarchicalTimelineEntity, setparent/addChild allows to set parent/child entities at INFO level. The key is an string and value as an object.
      Like below, for YARN_CONTAINER entity parent entity set for application.

      "SYSTEM_INFO_PARENT_ENTITY": {
             "type": "YARN_APPLICATION",
             "id": "application_1471931266232_0024"
           }
      

      But to use infofilter on entity type YARN_CONTAINER for an specific applicationId, IIUC there is no way to pass object as value in infofilter.

      To make easier retrieval either

      1. publish parent/child entity id and type as string rather that object like below
        "SYSTEM_INFO_PARENT_ENTITY_TYPE": "YARN_APPLICATION"
        "SYSTEM_INFO_PARENT_ENTITY_ID":"application_1471931266232_0024"
        

        OR

      2. Add ability to provide object as filter with below format like infofilters=SYSTEM_INFO_PARENT_ENTITY eq ((type eq YARN_APPLICATION) AND (id eq application_1471931266232_0024))

      I believe 2nd approach will be well applicable for any entities. But I am not sure does HBase supports such a custom filters while scanning a table.

      1st approaches will be much easier to change.

        Attachments

        1. YARN-5577.patch
          4 kB
          Rohith Sharma K S

          Activity

            People

            • Assignee:
              rohithsharma Rohith Sharma K S
              Reporter:
              rohithsharma Rohith Sharma K S
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: