Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-15543

RBF: Write Should allow, when a subcluster is unavailable for RANDOM mount points with fault Tolerance enabled.

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.1.1
    • 3.4.0
    • rbf
    • None

    Description

      A RANDOM mount point should allow to creating new files if one subcluster is down also with Fault Tolerance was enabled. but here it's failed.

      MultiDestination_client]# hdfs dfsrouteradmin -ls /test_ec
      Mount Table Entries:
      Source Destinations Owner Group Mode Quota/Usage
      /test_ec hacluster->/tes_ec,hacluster1->/tes_ec test ficommon rwxr-xr-x [NsQuota: -/-, SsQuota: -/-]

      File Write throne the Exception:-

      2020-08-26 19:13:21,839 WARN hdfs.DataStreamer: Abandoning blk_1073743375_2551
      2020-08-26 19:13:21,877 WARN hdfs.DataStreamer: Excluding datanode DatanodeInfoWithStorage[DISK]
      2020-08-26 19:13:21,878 WARN hdfs.DataStreamer: DataStreamer Exception
      java.io.IOException: Unable to create new block.
      at org.apache.hadoop.hdfs.DataStreamer.nextBlockOutputStream(DataStreamer.java:1758)
      at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:718)
      2020-08-26 19:13:21,879 WARN hdfs.DataStreamer: Could not get block locations. Source file "/test_ec/f1.COPYING" - Aborting...block==null
      put: Could not get block locations. Source file "/test_ec/f1.COPYING" - Aborting...block==null

      Attachments

        1. HDFS-15543_testrepro.patch
          3 kB
          Hemanth Boyina
        2. HDFS-15543.001.patch
          7 kB
          Hemanth Boyina
        3. HDFS-15543.002.patch
          8 kB
          Hemanth Boyina
        4. HDFS-15543.003.patch
          8 kB
          Hemanth Boyina
        5. HDFS-15543.004.patch
          8 kB
          Hemanth Boyina
        6. HDFS-15543.005.patch
          8 kB
          Hemanth Boyina
        7. HDFS-15543.006.patch
          8 kB
          Hemanth Boyina
        8. HDFS-15543.007.patch
          8 kB
          Hemanth Boyina

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            hemanthboyina Hemanth Boyina
            Harsha1206 Harshakiran Reddy
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment