Details

    • Type: Sub-task Sub-task
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: fs
    • Labels:
      None

      Description

      Hadoop is using commons-net 1.4.1 that contains critical bugs fixed many years ago. We definitely need to upgrade to at least 2.0

        Activity

        Hide
        Steve Loughran added a comment -

        3.0.1 is in the repo; 3.1 is the latest version.

        1. what version do you think should be used?
        2. what tests can we do above and beyond the built in unit tests to make sure the changes don't break anything?
        Show
        Steve Loughran added a comment - 3.0.1 is in the repo; 3.1 is the latest version. what version do you think should be used? what tests can we do above and beyond the built in unit tests to make sure the changes don't break anything?
        Hide
        Maxime Brugidou added a comment -

        1. I haven't tested running hadoop with 3.*, we are currently running 2.0 successfully and didn't dare to upgrade our production cluster to version

        2. I am not familiar with the unit tests built-in but it should cover the "usual" FTP file system operations, and maybe add a test where a file is created on 02/29.

        Show
        Maxime Brugidou added a comment - 1. I haven't tested running hadoop with 3.*, we are currently running 2.0 successfully and didn't dare to upgrade our production cluster to version 2. I am not familiar with the unit tests built-in but it should cover the "usual" FTP file system operations, and maybe add a test where a file is created on 02/29.

          People

          • Assignee:
            Unassigned
            Reporter:
            Maxime Brugidou
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:

              Development