HBase
  1. HBase
  2. HBASE-2926

Document about the characteristic of HBase use HDFS

    Details

    • Type: Task Task
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Not A Problem
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      As our know, HDFS is design for mapreduce (streaming read/write) , and for HBase something can not fit for currently requirement. As Lipcon says, random read, sync and client fault tolerant is the most important things we should take care of. The document will make some discusses from these three points.

        Activity

        jinglong.liujl created issue -
        Hide
        Todd Lipcon added a comment -

        Is this meant to be an umbrella issue where we link to the HDFS jiras that would help us out? What's the goal of this document?

        Show
        Todd Lipcon added a comment - Is this meant to be an umbrella issue where we link to the HDFS jiras that would help us out? What's the goal of this document?
        Hide
        jinglong.liujl added a comment -

        yes.
        As we know, currently HDFS trunk can not fit for requirement of HBase.
        Our goal is to get detail items where can make some improvements, such as function, stability, performance. This issue will be useful for hdfs improvement for HBase. And any helpful thing can release to this issue.
        Could you upload your ppt ?

        Show
        jinglong.liujl added a comment - yes. As we know, currently HDFS trunk can not fit for requirement of HBase. Our goal is to get detail items where can make some improvements, such as function, stability, performance. This issue will be useful for hdfs improvement for HBase. And any helpful thing can release to this issue. Could you upload your ppt ?
        Hide
        Jeff Hammerbacher added a comment -

        Seems like a reasonable thing to do. I hear a lot of concernts about HDFS from HBase folks, and it would be great to gather up the concerns in a single place so we can start tackling them one by one!

        Show
        Jeff Hammerbacher added a comment - Seems like a reasonable thing to do. I hear a lot of concernts about HDFS from HBase folks, and it would be great to gather up the concerns in a single place so we can start tackling them one by one!
        Hide
        Jeff Hammerbacher added a comment -

        Ryan Rawson has pointed to the follow JIRAs that might help improve the HDFS client:

        Show
        Jeff Hammerbacher added a comment - Ryan Rawson has pointed to the follow JIRAs that might help improve the HDFS client: https://issues.apache.org/jira/browse/HDFS-918 https://issues.apache.org/jira/browse/HDFS-1323
        Hide
        Jeff Hammerbacher added a comment -

        Fast local reads would probably help performance:

        Show
        Jeff Hammerbacher added a comment - Fast local reads would probably help performance: https://issues.apache.org/jira/browse/HDFS-347
        Hide
        Jeff Hammerbacher added a comment -

        Of course NN HA would be nice:

        Show
        Jeff Hammerbacher added a comment - Of course NN HA would be nice: https://issues.apache.org/jira/browse/HDFS-1064
        Hide
        jinglong.liujl added a comment -

        Sorry for so late reply. Currently, Chinese document is available, hope it can helpful for HBase user.

        Show
        jinglong.liujl added a comment - Sorry for so late reply. Currently, Chinese document is available, hope it can helpful for HBase user.
        jinglong.liujl made changes -
        Field Original Value New Value
        Attachment HBase使用hadoop分析.doc [ 12454370 ]
        Hide
        stack added a comment -

        Jinglong:

        Thanks for doing this. You doc looks excellent (smile). Is an english translation coming? Would you like us to put this up on our site somewhere (Would probably be better if you saved it as a pdf or html). Does it have a date and author? I can't tell. If not, it should. Thanks.

        Show
        stack added a comment - Jinglong: Thanks for doing this. You doc looks excellent (smile). Is an english translation coming? Would you like us to put this up on our site somewhere (Would probably be better if you saved it as a pdf or html). Does it have a date and author? I can't tell. If not, it should. Thanks.
        Hide
        jinglong.liujl added a comment -


        I'll translate it to English sooner.And date and author will be added into the coming document.
        This document is a result of our investigation in last week. I'm very happy to share it with anyone interest it. You can put it anywhere.

        Show
        jinglong.liujl added a comment - I'll translate it to English sooner.And date and author will be added into the coming document. This document is a result of our investigation in last week. I'm very happy to share it with anyone interest it. You can put it anywhere.
        Hide
        Andrew Purtell added a comment -

        Stale information

        Show
        Andrew Purtell added a comment - Stale information
        Andrew Purtell made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Not a Problem [ 8 ]
        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Resolved Resolved
        1428d 5h 23m 1 Andrew Purtell 16/Jul/14 23:27

          People

          • Assignee:
            Unassigned
            Reporter:
            jinglong.liujl
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - 120h
              120h
              Remaining:
              Remaining Estimate - 120h
              120h
              Logged:
              Time Spent - Not Specified
              Not Specified

                Development