Uploaded image for project: 'Apache Nemo'
  1. Apache Nemo
  2. NEMO-425 Nemo on Google Dataproc
  3. NEMO-426

Bump up the Hadoop dependency to 2.9.1

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      The following are the "Standard Cloud Dataproc Images" that users can choose in the Google Cloud web console. To make Nemo compatible with all of these images, we first have to bump up the Hadoop dependency in our parent pom.xml to 2.9.1 from the current 2.7.2.

       

      1.4 (Debian 9, Hadoop 2.9, Spark 2.4)

      First released on 3/22/2019.

      1.3 (Debian 9, Hadoop 2.9, Spark 2.3)

      First released on 8/16/2018.

      1.2 (Debian 9, Hadoop 2.8, Spark 2.2)

      First released on 8/16/2018.

      1.1 (Debian 9, Hadoop 2.7, Spark 2.0)

      First released on 8/16/2018.

      1.0 (Debian 9, Hadoop 2.7, Spark 1.6)

      First released on 8/16/2018.

      1.4 (Ubuntu 18.04 LTS, Hadoop 2.9, Spark 2.4)

      First released on 3/22/2019.

      1.3 (Ubuntu 18.04 LTS, Hadoop 2.9, Spark 2.3)

      First released on 3/22/2019.

      Attachments

        Activity

          People

            Unassigned Unassigned
            johnyangk John Yang
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: