Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-8569

Support Hadoop 3 on Beam

    XMLWordPrintableJSON

    Details

      Description

      It seems that Hadoop 3 in production is finally happening. CDH supports it in their latest version and Spark 3 will include support for Hadoop 3 too.

      This is an uber ticket to cover the required changes to the codebase to ensure compliance with Hadoop 3.x

      Hadoop dependencies in Beam are mostly provided and APIs are until some point compatible, but we may require changes in the CI to test that new changes work both in Hadoop 2 and Hadoop 3 until we decide to remove support for Hadoop 3.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                iemejia Ismaël Mejía
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 2h
                  2h