Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-321 [Umbrella] Generic application history service
  3. YARN-947

Defining the history data classes for the implementation of the reading/writing interface

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersConvert to IssueMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.4.0
    • None
    • None
    • Reviewed

    Description

      We need to define the history data classes have the exact fields to be stored. Therefore, all the implementations don't need to have the duplicate logic to exact the required information from RMApp, RMAppAttempt and RMContainer.

      We use protobuf to define these classes, such that they can be ser/des to/from bytes, which are easier for persistence.

      Attachments

        1. YARN-947.9.patch
          43 kB
          Zhijie Shen
        2. YARN-947.8.patch
          130 kB
          Zhijie Shen
        3. YARN-947.6.patch
          117 kB
          Zhijie Shen
        4. YARN-947.5.patch
          90 kB
          Zhijie Shen
        5. YARN-947.4.patch
          89 kB
          Zhijie Shen
        6. YARN-947.3.patch
          89 kB
          Zhijie Shen
        7. YARN-947.2.patch
          43 kB
          Zhijie Shen
        8. YARN-947.1.patch
          38 kB
          Zhijie Shen

        Issue Links

        blocks

        Sub-task - The sub-task of the issue YARN-925 HistoryStorage Reader Interface for Application History Server

        • Major - Major loss of function.
        • Closed

        Sub-task - The sub-task of the issue YARN-934 HistoryStorage writer interface for Application History Server

        • Major - Major loss of function.
        • Closed
        is duplicated by

        Sub-task - The sub-task of the issue YARN-1066 Improve toString implementation for PBImpls for AHS

        • Major - Major loss of function.
        • Resolved
        is related to

        Sub-task - The sub-task of the issue YARN-1344 Separate ApplicationAttemptStartDataProto and ApplicationAttemptRegisteredDataProto

        • Major - Major loss of function.
        • Resolved

        Sub-task - The sub-task of the issue YARN-1346 Revisit the output type of the reader interface

        • Major - Major loss of function.
        • Resolved

        Sub-task - The sub-task of the issue YARN-962 Update application_history_service.proto

        • Major - Major loss of function.
        • Closed

        Sub-task - The sub-task of the issue YARN-1345 Removing FINAL_SAVING from YarnApplicationAttemptState

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            zjshen Zhijie Shen Assign to me
            zjshen Zhijie Shen
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment