Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-12853

Change WASB documentation regarding page blob support

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: fs/azure
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      WASB page blob support documentation in Features list at the top:

      Supports both page blobs (suitable for most use cases, such as MapReduce) and block blobs (suitable for continuous write use cases, such as an HBase write-ahead log).
      Which is actually the opposite. Block blobs are better for typical big data use cases, and page blobs were implemented to support the HBase WAL.

      It is also mentioned that
      "Page blobs can be used for other purposes beyond just HBase log files though."
      This is not strong enough because page blob has been tested only in context of HBase write ahead logs. They have not been broadly certified for use across the Hadoop ecosystem, hence is not recommended for use as a general purpose file-system via Hadoop cluster

      1. HADOOP-12853.001.patch
        2 kB
        madhumita chakraborty

        Activity

        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-trunk-Commit #9405 (See https://builds.apache.org/job/Hadoop-trunk-Commit/9405/)
        HADOOP-12853. Change WASB documentation regarding page blob support. (cnauroth: rev f98dff329b1f94c9f53022baf0209fc1a7aaf7c2)

        • hadoop-common-project/hadoop-common/CHANGES.txt
        • hadoop-tools/hadoop-azure/src/site/markdown/index.md
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #9405 (See https://builds.apache.org/job/Hadoop-trunk-Commit/9405/ ) HADOOP-12853 . Change WASB documentation regarding page blob support. (cnauroth: rev f98dff329b1f94c9f53022baf0209fc1a7aaf7c2) hadoop-common-project/hadoop-common/CHANGES.txt hadoop-tools/hadoop-azure/src/site/markdown/index.md
        Hide
        cnauroth Chris Nauroth added a comment -

        +1 for the patch. I have committed this to trunk, branch-2 and branch-2.8. madhumita chakraborty, thank you for improving the documentation.

        Show
        cnauroth Chris Nauroth added a comment - +1 for the patch. I have committed this to trunk, branch-2 and branch-2.8. madhumita chakraborty , thank you for improving the documentation.
        Hide
        hadoopqa Hadoop QA added a comment -
        +1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 9s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 mvnsite 0m 19s trunk passed
        +1 mvnsite 0m 19s the patch passed
        +1 whitespace 0m 0s Patch has no whitespace issues.
        +1 asflicense 0m 17s Patch does not generate ASF License warnings.
        1m 17s



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:0ca8df7
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12790433/HADOOP-12853.001.patch
        JIRA Issue HADOOP-12853
        Optional Tests asflicense mvnsite
        uname Linux 9c2cfcaf9f39 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / e3ac231
        modules C: hadoop-tools/hadoop-azure U: hadoop-tools/hadoop-azure
        Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/8742/console
        Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - +1 overall Vote Subsystem Runtime Comment 0 reexec 0m 9s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 mvnsite 0m 19s trunk passed +1 mvnsite 0m 19s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 asflicense 0m 17s Patch does not generate ASF License warnings. 1m 17s Subsystem Report/Notes Docker Image:yetus/hadoop:0ca8df7 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12790433/HADOOP-12853.001.patch JIRA Issue HADOOP-12853 Optional Tests asflicense mvnsite uname Linux 9c2cfcaf9f39 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / e3ac231 modules C: hadoop-tools/hadoop-azure U: hadoop-tools/hadoop-azure Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/8742/console Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.

          People

          • Assignee:
            madhuch-ms madhumita chakraborty
            Reporter:
            madhuch-ms madhumita chakraborty
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development