Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-5461

fallback to non-ssr(local short circuit reads) while oom detected

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 2.2.0, 3.0.0-alpha1
    • None
    • None

    Description

      Currently, the DirectBufferPool used by ssr feature seems doesn't have a upper-bound limit except DirectMemory VM option. So there's a risk to encounter direct memory oom. see HBASE-8143 for example.
      IMHO, maybe we could improve it a bit:
      1) detect OOM or reach a setting up-limit from caller, then fallback to non-ssr
      2) add a new metric about current raw consumed direct memory size.

      Attachments

        1. HDFS-5461.txt
          9 kB
          Liang Xie

        Activity

          People

            xieliang007 Liang Xie
            xieliang007 Liang Xie
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated: