Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-750

Run YARN RM Recovery test to uncover any potential issues with SamzaAppMaster

    XMLWordPrintableJSON

Details

    • Test
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.10.0
    • 0.12.0
    • yarn
    • None

    Description

      Currently, there is no tests toward YARN RM Recovery support in Samza.

      As pointed out by llamahunter, there is likely some issue in containerID versioning in SamzaAppMaster to handle RM Recovery case. There might be more issues.

      This JIRA is to track the effort to uncover the issues related to YARN RM Recovery feature. The outcome expected is:

      1) Some test suite that runs Samza jobs in YARN with RM Recovery
      2) A list of issues discovered. Each issue may result in a separate JIRA to be fixed.

      Attachments

        Issue Links

          relates to

          Task - A task that needs to be done. SAMZA-1008 Create documentation for YARN work preserving recovery

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Activity

            People

              spvenkat Shanthoosh Venkataraman
              nickpan47 Yi Pan
              Votes:
              2 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: