Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha1
    • Fix Version/s: 2.3.0
    • Component/s: namenode
    • Labels:
      None
    • Target Version/s:

      Description

      There are a few things about our HDFS-4949 recaching strategy that could be improved.

      • We should monitor the DN's maximum and current mlock'ed memory consumption levels, so that we don't ask the DN to do stuff it can't.
      • We should not try to initiate caching on stale or decomissioning DataNodes (although we should not recache things stored on such nodes until they're declared dead).
      • We might want to resend the DNA_CACHE or DNA_UNCACHE command a few times before giving up. Currently, we only send it once.

        Attachments

        1. HDFS-5366.007.patch
          31 kB
          Colin McCabe
        2. HDFS-5366.005.patch
          35 kB
          Colin McCabe
        3. HDFS-5366.002.patch
          15 kB
          Colin McCabe
        4. HDFS-5366-caching.001.patch
          10 kB
          Colin McCabe

          Issue Links

            Activity

              People

              • Assignee:
                cmccabe Colin McCabe
                Reporter:
                cmccabe Colin McCabe
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: