HBase
  1. HBase
  2. HBASE-7515

Store.loadStoreFiles should close opened files if there's an exception

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.94.3
    • Fix Version/s: 0.94.5, 0.95.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Related to HBASE-7513. If a RS is able to open a few store files in Store.loadStoreFiles but one of them fails like in 7513, the opened files won't be closed and file descriptors will remain in a CLOSED_WAIT state.

      The situation we encountered is that over the weekend one region was bounced between >100 region servers and eventually they all started dying on "Too many open files".

      1. 7515.txt
        2 kB
        Ted Yu
      2. 7515-v2.txt
        2 kB
        Ted Yu
      3. 7515-v3.txt
        3 kB
        Ted Yu
      4. 7515-v4.txt
        4 kB
        Ted Yu
      5. 7515-v5.txt
        4 kB
        chunhui shen
      6. 7515-v6.txt
        4 kB
        Ted Yu
      7. 7515-0.94.txt
        4 kB
        Ted Yu

        Activity

        Lars Hofhansl made changes -
        Fix Version/s 0.94.5 [ 12323874 ]
        stack made changes -
        Fix Version/s 0.95.0 [ 12324094 ]
        Fix Version/s 0.96.0 [ 12320040 ]
        Fix Version/s 0.94.5 [ 12323874 ]
        Lars Hofhansl made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Lars Hofhansl made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Resolution Fixed [ 1 ]
        Ted Yu made changes -
        Attachment 7515-0.94.txt [ 12563985 ]
        Ted Yu made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Ted Yu made changes -
        Attachment 7515-v6.txt [ 12563976 ]
        chunhui shen made changes -
        Attachment 7515-v5.patch [ 12563908 ]
        chunhui shen made changes -
        Attachment 7515-v5.txt [ 12563910 ]
        chunhui shen made changes -
        Attachment 7515-v5.patch [ 12563908 ]
        chunhui shen made changes -
        Assignee chunhui shen [ zjushch ] Ted Yu [ yuzhihong@gmail.com ]
        chunhui shen made changes -
        Assignee Ted Yu [ yuzhihong@gmail.com ] chunhui shen [ zjushch ]
        Ted Yu made changes -
        Attachment 7515-v4.txt [ 12563855 ]
        Ted Yu made changes -
        Attachment 7515-v3.txt [ 12563842 ]
        Ted Yu made changes -
        Fix Version/s 0.94.5 [ 12323874 ]
        Affects Version/s 0.94.3 [ 12323144 ]
        Ted Yu made changes -
        Attachment 7515-v2.txt [ 12563674 ]
        Ted Yu made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Ted Yu made changes -
        Assignee Ted Yu [ yuzhihong@gmail.com ]
        Ted Yu made changes -
        Field Original Value New Value
        Attachment 7515.txt [ 12563664 ]
        Jean-Daniel Cryans created issue -

          People

          • Assignee:
            Ted Yu
            Reporter:
            Jean-Daniel Cryans
          • Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development