Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-15409

Optimization Strategy for choosing ShortCircuitCache

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      When clientShortCircuitNum is 10, the probability of falling into each ShortCircuitCache is the same, while the probability of other clientShortCircuitNum is different.

      For example if clientShortCircuitNum is 3, when a lot of blockids of SSR are ***1, ***4, ***7， this situation will fall into a ShortCircuitCache.

      Since the real environment blockid is completely unpredictable, i think it is need to design a strategy which is allocated to a specific ShortCircuitCache. This should improve performance even more.

      Attachments

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-15202 HDFS-client: boost ShortCircuit Cache

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              leosun08 Lisheng Sun
              leosun08 Lisheng Sun
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: