Uploaded image for project: 'Tajo (Retired)'
  1. Tajo (Retired)
  2. TAJO-467

Too many open FD when master failed.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.8.0
    • None
    • None

    Description

      When Tajo Master failed and Worker still alive, too many open FD in worker's host.
      I checked with losf command. Showed the following list.

      lsof -l | grep <pid> | grep wc -l
      2568
      
      lsof -l | grep <pid>
      java      92845      501  110     PIPE 0xd63c81fc1ed6001b       16384          ->0xd63c81fc0aac406b
      java      92845      501  111     PIPE 0xd63c81fc0aac406b       16384          ->0xd63c81fc1ed6001b
      java      92845      501  112u  KQUEUE                                         count=0, state=0x2
      java      92845      501  113     PIPE 0xd63c81fc0d1441cb       16384          ->0xd63c81fc1ed6059b
      java      92845      501  114     PIPE 0xd63c81fc1ed6059b       16384          ->0xd63c81fc0d1441cb
      java      92845      501  115u  KQUEUE                                         count=0, state=0x2
      java      92845      501  116     PIPE 0xd63c81fc1edb140b       16384          ->0xd63c81fc1ed61cfb
      java      92845      501  117     PIPE 0xd63c81fc1ed61cfb       16384          ->0xd63c81fc1edb140b
      java      92845      501  118u  KQUEUE                                         count=0, state=0x2
      java      92845      501  119     PIPE 0xd63c81fc1eba61fb       16384          ->0xd63c81fc1eba727b
      java      92845      501  120     PIPE 0xd63c81fc1eba727b       16384          ->0xd63c81fc1eba61fb
      java      92845      501  121u  KQUEUE                                         count=0, state=0x2
      java      92845      501  122     PIPE 0xd63c81fc163b474b       16384          ->0xd63c81fc1ed61a3b
      java      92845      501  123     PIPE 0xd63c81fc1ed61a3b       16384          ->0xd63c81fc163b474b
      java      92845      501  124u  KQUEUE                                         count=0, state=0x2
      java      92845      501  125     PIPE 0xd63c81fc1ed68e3b       16384          ->0xd63c81fc1d530bfb
      java      92845      501  126     PIPE 0xd63c81fc1d530bfb       16384          ->0xd63c81fc1ed68e3b
      java      92845      501  127u  KQUEUE                                         count=0, state=0x2
      java      92845      501  128     PIPE 0xd63c81fc1d4848ab       16384          ->0xd63c81fc0aac1b4b
      java      92845      501  129     PIPE 0xd63c81fc0aac1b4b       16384          ->0xd63c81fc1d4848ab
      java      92845      501  130u  KQUEUE                                         count=0, state=0x2
      java      92845      501  131     PIPE 0xd63c81fc1fe3d74b       16384          ->0xd63c81fc0aac125b
      java      92845      501  132     PIPE 0xd63c81fc0aac125b       16384          ->0xd63c81fc1fe3d74b
      java      92845      501  133u  KQUEUE                                         count=0, state=0x2
      ...
      

      Attachments

        1. TAJO-467.patch
          4 kB
          Hyoungjun Kim

        Activity

          People

            hjkim Hyoungjun Kim
            hjkim Hyoungjun Kim
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: