Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-8822

Upgrade Hadoop dependencies to version 2.8

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.18.0
    • Component/s: build-system
    • Labels:
      None

      Description

      Ismaël Mejía says:

      probably a quicker way forward is to unblock the bigtable issue is to move our Hadoop dependency to Hadoop 2.8 given that Hadoop 2.7 is now EOL we have a good reason to do so https://cwiki.apache.org/confluence/display/HADOOP/EOL+%28End-of-life%29+Release+Branches

      The URL says

      Following branches are EOL:

      [2.0.x - 2.7.x]

      https://issues.apache.org/jira/browse/BEAM-8569?focusedCommentId=16980532&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16980532

      About compatibility with other library:

      Hadoop client 2.7 is not compatible with Guava > 21 because of Objects.toStringHelper. Fortunately Hadoop client 2.8 removed the use of the method (detail).

      2.8.5 is the latest in 2.8.X.

        Attachments

        1. OGuVu0A18jJ.png
          120 kB
          Tomo Suzuki

          Issue Links

            Activity

              People

              • Assignee:
                suztomo Tomo Suzuki
                Reporter:
                suztomo Tomo Suzuki
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 5h 50m
                  5h 50m