Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13947

Review of DirectoryScanner Class

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.2.0
    • 3.3.0
    • datanode
    • None
    • Reviewed
    • Patch

    Description

      Review of Directory Scanner. Replaced a lot of code with Guava MultiMap. Some general house cleaning and improved logging. For performance, using ArrayList instead of LinkedList where possible, especially since these lists can be quite large a LinkedList will consume a lot of memory and be slow to sort/iterate over.

      https://stackoverflow.com/questions/322715/when-to-use-linkedlist-over-arraylist-in-java

      Attachments

        1. HDFS-13947.1.patch
          45 kB
          David Mollitor
        2. HDFS-13947.2.patch
          46 kB
          David Mollitor
        3. HDFS-13947.3.patch
          76 kB
          David Mollitor
        4. HDFS-13947.4.patch
          77 kB
          David Mollitor
        5. HDFS-13947.5.patch
          78 kB
          Íñigo Goiri

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-13958 Miscellaneous Improvements for FsVolumeSpi

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              belugabehr David Mollitor
              belugabehr David Mollitor
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: