Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.0.0-alpha1
    • 2.3.0
    • namenode
    • None

    Description

      There are a few things about our HDFS-4949 recaching strategy that could be improved.

      • We should monitor the DN's maximum and current mlock'ed memory consumption levels, so that we don't ask the DN to do stuff it can't.
      • We should not try to initiate caching on stale or decomissioning DataNodes (although we should not recache things stored on such nodes until they're declared dead).
      • We might want to resend the DNA_CACHE or DNA_UNCACHE command a few times before giving up. Currently, we only send it once.

      Attachments

        1. HDFS-5366.002.patch
          15 kB
          Colin McCabe
        2. HDFS-5366.005.patch
          35 kB
          Colin McCabe
        3. HDFS-5366.007.patch
          31 kB
          Colin McCabe
        4. HDFS-5366-caching.001.patch
          10 kB
          Colin McCabe

        Issue Links

          Activity

            People

              cmccabe Colin McCabe
              cmccabe Colin McCabe
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: