Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5577

[Atsv2] Document object passing in infofilters with an example

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      In HierarchicalTimelineEntity, setparent/addChild allows to set parent/child entities at INFO level. The key is an string and value as an object.
      Like below, for YARN_CONTAINER entity parent entity set for application.

      "SYSTEM_INFO_PARENT_ENTITY": {
             "type": "YARN_APPLICATION",
             "id": "application_1471931266232_0024"
           }
      

      But to use infofilter on entity type YARN_CONTAINER for an specific applicationId, IIUC there is no way to pass object as value in infofilter.

      To make easier retrieval either

      1. publish parent/child entity id and type as string rather that object like below
        "SYSTEM_INFO_PARENT_ENTITY_TYPE": "YARN_APPLICATION"
        "SYSTEM_INFO_PARENT_ENTITY_ID":"application_1471931266232_0024"
        

        OR

      2. Add ability to provide object as filter with below format like infofilters=SYSTEM_INFO_PARENT_ENTITY eq ((type eq YARN_APPLICATION) AND (id eq application_1471931266232_0024))

      I believe 2nd approach will be well applicable for any entities. But I am not sure does HBase supports such a custom filters while scanning a table.

      1st approaches will be much easier to change.

      Attachments

        1. YARN-5577.patch
          4 kB
          Rohith Sharma K S

        Activity

          People

            rohithsharma Rohith Sharma K S
            rohithsharma Rohith Sharma K S
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: