Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      The latest HBase code which contains fixes and updates for:

      • Eliminate multiple conversions to/from byte[] <-> BytesWritable
      • Scanners have a problem find all the elements in a column family if they were saved at different times
      • Master continuously allocates META region
      • Scanners do not properly handle deleted values
      • HMemcache and HStore scanners return oldest results first. They should return the most recent values first
      • New test cases for:
        o get
        o HBaseMiniCluster
        o HMemcache
        o Scanners
        o object toString methods
      1. patch.txt
        287 kB
        Jim Kellerman

        Activity

        Jim Kellerman created issue -
        Jim Kellerman made changes -
        Field Original Value New Value
        Status Open [ 1 ] In Progress [ 3 ]
        Hide
        Jim Kellerman added a comment -

        patch file for this release

        Show
        Jim Kellerman added a comment - patch file for this release
        Jim Kellerman made changes -
        Attachment patch.txt [ 12356740 ]
        Jim Kellerman made changes -
        Status In Progress [ 3 ] Patch Available [ 10002 ]
        Show
        Hadoop QA added a comment - +1 http://issues.apache.org/jira/secure/attachment/12356740/patch.txt applied and successfully tested against trunk revision r534975. Test results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/115/testReport/ Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/115/console
        Hide
        Jim Kellerman added a comment -

        This is the first release of HBase that is really ready for evaluation.

        The client, master, and region server all basically work.

        Do it cover edge cases or failover? NO.

        However, for preliminary evaluation, this release is at least functional from the client -> master -> regionserver.

        If you use/evaluate HBase and find problems, please enter a Jira issue with the component contrib/hbase.

        Thanks, and enjoy!

        Show
        Jim Kellerman added a comment - This is the first release of HBase that is really ready for evaluation. The client, master, and region server all basically work. Do it cover edge cases or failover? NO. However, for preliminary evaluation, this release is at least functional from the client -> master -> regionserver. If you use/evaluate HBase and find problems, please enter a Jira issue with the component contrib/hbase. Thanks, and enjoy!
        Hide
        Doug Cutting added a comment -

        I just committed this. Thanks, Jim!

        Show
        Doug Cutting added a comment - I just committed this. Thanks, Jim!
        Doug Cutting made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Fix Version/s 0.13.0 [ 12312348 ]
        Hide
        Hadoop QA added a comment -
        Show
        Hadoop QA added a comment - Integrated in Hadoop-Nightly #82 (See http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/82/ )
        Hide
        Edward J. Yoon added a comment -

        I've tested it in my test mapreduce class for storing 10000 by 10000 dense matrix data of row i of Table and column j of ColumnFamily.
        It works good. I will do make linear algebra library for Hadoop & Hbase.

                public void reduce(WritableComparable key, Iterator values, 
                                OutputCollector output, Reporter reporter) throws IOException {
                   
                        Configuration conf = new Configuration();
                        HClient client = new HClient(conf);
                        client.openTable(new Text("matrices"));
                        long lockId = client.startUpdate(new Text(key.toString()));
                   
                        while(values.hasNext()){
                           HbaseTestDatum m = (HbaseTestDatum)values.next();
                                
                           client.put(lockId, new Text("dense:"+m.getColumnkey()), m.getEntry().getBytes());
                        }
        
                        client.commit(lockId);
                }
        
        Show
        Edward J. Yoon added a comment - I've tested it in my test mapreduce class for storing 10000 by 10000 dense matrix data of row i of Table and column j of ColumnFamily. It works good. I will do make linear algebra library for Hadoop & Hbase. public void reduce(WritableComparable key, Iterator values, OutputCollector output, Reporter reporter) throws IOException { Configuration conf = new Configuration(); HClient client = new HClient(conf); client.openTable( new Text( "matrices" )); long lockId = client.startUpdate( new Text(key.toString())); while (values.hasNext()){ HbaseTestDatum m = (HbaseTestDatum)values.next(); client.put(lockId, new Text( "dense:" +m.getColumnkey()), m.getEntry().getBytes()); } client.commit(lockId); }
        Doug Cutting made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Owen O'Malley made changes -
        Component/s contrib/hbase [ 12311752 ]
        Owen O'Malley made changes -
        Assignee Jim Kellerman [ jimk ]
        Issue Type Improvement [ 4 ] Bug [ 1 ]
        Fix Version/s 0.13.0 [ 12312348 ]
        Project Hadoop Core [ 12310240 ] Hadoop HBase [ 12310753 ]
        Key HADOOP-1325 HBASE-352
        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open In Progress In Progress
        4s 1 Jim Kellerman 03/May/07 23:21
        In Progress In Progress Patch Available Patch Available
        49s 1 Jim Kellerman 03/May/07 23:22
        Patch Available Patch Available Resolved Resolved
        3d 20h 36m 1 Doug Cutting 07/May/07 19:59
        Resolved Resolved Closed Closed
        32d 41m 1 Doug Cutting 08/Jun/07 20:40

          People

          • Assignee:
            Unassigned
            Reporter:
            Jim Kellerman
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development