Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      The latest HBase code which contains fixes and updates for:

      • Eliminate multiple conversions to/from byte[] <-> BytesWritable
      • Scanners have a problem find all the elements in a column family if they were saved at different times
      • Master continuously allocates META region
      • Scanners do not properly handle deleted values
      • HMemcache and HStore scanners return oldest results first. They should return the most recent values first
      • New test cases for:
        o get
        o HBaseMiniCluster
        o HMemcache
        o Scanners
        o object toString methods
      1. patch.txt
        287 kB
        Jim Kellerman

        Activity

        Hide
        Edward J. Yoon added a comment -

        I've tested it in my test mapreduce class for storing 10000 by 10000 dense matrix data of row i of Table and column j of ColumnFamily.
        It works good. I will do make linear algebra library for Hadoop & Hbase.

                public void reduce(WritableComparable key, Iterator values, 
                                OutputCollector output, Reporter reporter) throws IOException {
                   
                        Configuration conf = new Configuration();
                        HClient client = new HClient(conf);
                        client.openTable(new Text("matrices"));
                        long lockId = client.startUpdate(new Text(key.toString()));
                   
                        while(values.hasNext()){
                           HbaseTestDatum m = (HbaseTestDatum)values.next();
                                
                           client.put(lockId, new Text("dense:"+m.getColumnkey()), m.getEntry().getBytes());
                        }
        
                        client.commit(lockId);
                }
        
        Show
        Edward J. Yoon added a comment - I've tested it in my test mapreduce class for storing 10000 by 10000 dense matrix data of row i of Table and column j of ColumnFamily. It works good. I will do make linear algebra library for Hadoop & Hbase. public void reduce(WritableComparable key, Iterator values, OutputCollector output, Reporter reporter) throws IOException { Configuration conf = new Configuration(); HClient client = new HClient(conf); client.openTable( new Text( "matrices" )); long lockId = client.startUpdate( new Text(key.toString())); while (values.hasNext()){ HbaseTestDatum m = (HbaseTestDatum)values.next(); client.put(lockId, new Text( "dense:" +m.getColumnkey()), m.getEntry().getBytes()); } client.commit(lockId); }
        Hide
        Hadoop QA added a comment -
        Show
        Hadoop QA added a comment - Integrated in Hadoop-Nightly #82 (See http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/82/ )
        Hide
        Doug Cutting added a comment -

        I just committed this. Thanks, Jim!

        Show
        Doug Cutting added a comment - I just committed this. Thanks, Jim!
        Hide
        Jim Kellerman added a comment -

        This is the first release of HBase that is really ready for evaluation.

        The client, master, and region server all basically work.

        Do it cover edge cases or failover? NO.

        However, for preliminary evaluation, this release is at least functional from the client -> master -> regionserver.

        If you use/evaluate HBase and find problems, please enter a Jira issue with the component contrib/hbase.

        Thanks, and enjoy!

        Show
        Jim Kellerman added a comment - This is the first release of HBase that is really ready for evaluation. The client, master, and region server all basically work. Do it cover edge cases or failover? NO. However, for preliminary evaluation, this release is at least functional from the client -> master -> regionserver. If you use/evaluate HBase and find problems, please enter a Jira issue with the component contrib/hbase. Thanks, and enjoy!
        Show
        Hadoop QA added a comment - +1 http://issues.apache.org/jira/secure/attachment/12356740/patch.txt applied and successfully tested against trunk revision r534975. Test results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/115/testReport/ Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/115/console
        Hide
        Jim Kellerman added a comment -

        patch file for this release

        Show
        Jim Kellerman added a comment - patch file for this release

          People

          • Assignee:
            Unassigned
            Reporter:
            Jim Kellerman
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development