Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-9884 Hadoop calling du -sk is expensive
  3. HADOOP-12973

make DU pluggable

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.8.0, 3.0.0-alpha1
    • None
    • None

    Description

      If people are concerned about replacing the call to DU. Then an easy first step is to make it pluggable. Then it's possible to replace it with something while leaving the default alone.

      Attachments

        1. HADOOP-12973v13.patch
          41 kB
          Elliott Neil Clark
        2. HADOOP-12973v12.patch
          40 kB
          Elliott Neil Clark
        3. HADOOP-12973v11.patch
          38 kB
          Elliott Neil Clark
        4. HADOOP-12973v10.patch
          29 kB
          Elliott Neil Clark
        5. HADOOP-12973v9.patch
          30 kB
          Elliott Neil Clark
        6. HADOOP-12973v8.patch
          17 kB
          Elliott Neil Clark
        7. HADOOP-12973v7.patch
          16 kB
          Elliott Neil Clark
        8. HADOOP-12973v6.patch
          16 kB
          Elliott Neil Clark
        9. HADOOP-12973v5.patch
          16 kB
          Elliott Neil Clark
        10. HADOOP-12973v3.patch
          13 kB
          Elliott Neil Clark
        11. HADOOP-12973v2.patch
          11 kB
          Elliott Neil Clark
        12. HADOOP-12973v1.patch
          10 kB
          Elliott Neil Clark
        13. HADOOP-12973v0.patch
          10 kB
          Elliott Neil Clark

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-10777 DataNode should report&remove volume failures if DU cannot access files

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-14313 Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue HADOOP-16045 Don't run TestDU on Windows

          • Trivial - Cosmetic problem like misspelt words or misaligned text.
          • Resolved

          Activity

            People

              eclark Elliott Neil Clark
              eclark Elliott Neil Clark
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: