Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-16816

Please remove or minimize need for native libraries "winutils" to run Spark locally on Windows.

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 3.2.1, 3.1.3
    • Fix Version/s: HADOOP-13223
    • Component/s: auth, bin, common, native
    • Labels:
      None
    • Environment:

      Windows

      Description

      Please remove the need for building and using custom native libraries "winutils" to run Spark on Windows systems just to run Spark & similar.

      Reference: https://github.com/steveloughran/winutils

      If native libraries are needed for performance benefits then please try to load the native libraries and then if not found then provide and use a functional equivalent Java implementation such that Spark will build and run applications using only Java. 

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                p2pxd mark pettovello
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: