Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-3348

TestUrlStreamHandler hangs on LINUX

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.18.0
    • 0.18.0
    • fs
    • None
    • LINUX 2.6.9

    • Reviewed

    Description

      TestUrlStreamHandler sets setURLStreamHandlerFactory as

      FsUrlStreamHandlerFactory factory =
              new org.apache.hadoop.fs.FsUrlStreamHandlerFactory();
          java.net.URL.setURLStreamHandlerFactory(factory);
      

      After this, MiniDFSCluster seems to hang while Datanodes tries to register in setNewStorageID, specifically at

      rand = SecureRandom.getInstance("SHA1PRNG").nextInt(Integer.MAX_VALUE);
      

      jstack output shows that the main thread is stuck in RawLocalFileSystem$LocalFSFileInputStream.read

      (Attaching the jstack)

      Attachments

        1. 3348-2nd-option.patch
          0.6 kB
          Raghu Angadi
        2. Datanode_jstack.txt
          23 kB
          Lohit Vijaya Renu
        3. HADOOP-3348.patch
          1 kB
          Lohit Vijaya Renu

        Activity

          People

            lohit Lohit Vijaya Renu
            lohit Lohit Vijaya Renu
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: