Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.6.0
    • Fix Version/s: 0.8.0
    • Component/s: build, yarn
    • Labels:
      None

      Description

      We should upgrade Samza to use YARN 2.4.0, since it's been released. Should be a matter of swapping out dependency versions.

      We will also need to update hello-samza to use YARN 2.4.0.

      1. SAMZA-186.1.patch
        3 kB
        Zhijie Shen
      2. SAMZA-186.2.patch
        3 kB
        Zhijie Shen

        Activity

        Hide
        zjshen Zhijie Shen added a comment -

        Do we consider skipping 2.3 and upgrading to 2.4 directly, which has just been announced. With 2.4, we may have more stabilized HA feature, support work-preserving AM restarting (SAMZA-133), and probably make use of the application monitoring service provided by YARN.

        Show
        zjshen Zhijie Shen added a comment - Do we consider skipping 2.3 and upgrading to 2.4 directly, which has just been announced. With 2.4, we may have more stabilized HA feature, support work-preserving AM restarting ( SAMZA-133 ), and probably make use of the application monitoring service provided by YARN.
        Hide
        criccomini Chris Riccomini added a comment -

        Yea, I think we should just skip 2.3, and go straight to 2.4. I'll update the title.

        Show
        criccomini Chris Riccomini added a comment - Yea, I think we should just skip 2.3, and go straight to 2.4. I'll update the title.
        Hide
        zjshen Zhijie Shen added a comment -

        Create a patch to rebase Samza on YARN-2.4

        Show
        zjshen Zhijie Shen added a comment - Create a patch to rebase Samza on YARN-2 .4
        Show
        zjshen Zhijie Shen added a comment - https://reviews.apache.org/r/21921/
        Hide
        zjshen Zhijie Shen added a comment -

        Discussed with Chris, and concluded that we should remove the exclude jetty-* lines.

        Show
        zjshen Zhijie Shen added a comment - Discussed with Chris, and concluded that we should remove the exclude jetty-* lines.
        Hide
        criccomini Chris Riccomini added a comment -

        +1 Feel free to commit.

        Built and tested against hello-samza. Verified that classpath of Samza containers shows yarn 2.4.0. Also verified that this patch works with YARN 2.2 in hello-samza.

        Show
        criccomini Chris Riccomini added a comment - +1 Feel free to commit. Built and tested against hello-samza. Verified that classpath of Samza containers shows yarn 2.4.0. Also verified that this patch works with YARN 2.2 in hello-samza.
        Hide
        zjshen Zhijie Shen added a comment -

        Thanks for review, Chris! Committed the last patch.

        Show
        zjshen Zhijie Shen added a comment - Thanks for review, Chris! Committed the last patch.

          People

          • Assignee:
            zjshen Zhijie Shen
            Reporter:
            criccomini Chris Riccomini
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development