Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-4816

transitionToActive blocks if the SBN is doing checkpoint image transfer

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0, 2.0.4-alpha
    • Fix Version/s: 2.3.0
    • Component/s: namenode
    • Labels:
      None

      Description

      The NN and SBN do this dance during checkpoint image transfer with nested HTTP GETs via HttpURLConnection. When an admin does a -transitionToActive during this transfer, part of that is interrupting an ongoing checkpoint so we can transition immediately.

      However, the thread.interrupt() in StandbyCheckpointer#stop gets swallowed by connection.getResponseCode() in TransferFsImage#doGetUrl. None of the methods in HttpURLConnection throw InterruptedException, so we need to do something else (perhaps HttpClient [1]):

      [1]: http://hc.apache.org/httpclient-3.x/

      1. hdfs-4816-1.patch
        2 kB
        Andrew Wang
      2. hdfs-4816-2.patch
        4 kB
        Andrew Wang
      3. hdfs-4816-slow-shutdown.txt
        103 kB
        Andrew Wang
      4. hdfs-4816-3.patch
        5 kB
        Andrew Wang
      5. stacks.out
        770 kB
        Andrew Wang
      6. hdfs-4816-4.patch
        5 kB
        Andrew Wang

        Issue Links

          Activity

          Andrew Wang created issue -
          Andrew Wang made changes -
          Field Original Value New Value
          Attachment hdfs-4816-1.patch [ 12583064 ]
          Andrew Wang made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Assignee Andrew Wang [ andrew.wang ]
          Andrew Wang made changes -
          Attachment hdfs-4816-2.patch [ 12583234 ]
          Andrew Wang made changes -
          Attachment hdfs-4816-slow-shutdown.txt [ 12583570 ]
          Andrew Wang made changes -
          Attachment hdfs-4816-3.patch [ 12583572 ]
          Andrew Wang made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Andrew Wang made changes -
          Attachment stacks.out [ 12584360 ]
          Andrew Wang made changes -
          Attachment hdfs-4816-4.patch [ 12589793 ]
          Andrew Wang made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Andrew Wang made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 2.3.0 [ 12324588 ]
          Resolution Fixed [ 1 ]
          Arun C Murthy made changes -
          Fix Version/s 2.3.0 [ 12325255 ]
          Fix Version/s 2.4.0 [ 12324588 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Chris Nauroth made changes -
          Link This issue is related to HDFS-6243 [ HDFS-6243 ]

            People

            • Assignee:
              Andrew Wang
              Reporter:
              Andrew Wang
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development