Apache Gora
  1. Apache Gora
  2. GORA-65

Implement Accumulo datastore for Gora

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.2
    • Component/s: gora-accumulo
    • Labels:
      None

      Description

      Accumulo is a BigTable implementation similar to HBase. Accumulo would be a great fit for another Gora datastore.

      1. GORA-65-1.patch
        77 kB
        Keith Turner

        Activity

        Hide
        Hudson added a comment -

        Integrated in goraOracle #6 (See https://builds.apache.org/job/goraOracle/6/)
        GORA-65 initial checkin of gora accumulo store (Revision f5f1547d77d299f55a13a73c80c51cf6d9d68020)
        GORA-65 updated CHNAGES.txt (Revision c978e8016d658d6935b67d44ec6b0bdbb80a178f)
        GORA-65 GORA-66 disabled testDeleteByQueryFields for accumulo (Revision 126259baaab72a8465737dd7ed632588389455f8)

        Result = FAILURE
        kturner :
        Files :

        • gora-accumulo/src/main/java/org/apache/gora/accumulo/encoders/BinaryEncoder.java
        • gora-accumulo/src/test/resources/gora-accumulo-mapping.xml
        • gora-accumulo/src/main/java/org/apache/gora/accumulo/encoders/HexEncoder.java
        • gora-accumulo/src/test/java/org/apache/gora/accumulo/store/AccumuloStoreTest.java
        • gora-accumulo/src/main/java/org/apache/gora/accumulo/query/AccumuloQuery.java
        • gora-accumulo/src/main/java/org/apache/gora/accumulo/store/AccumuloStore.java
        • gora-accumulo/src/test/resources/gora.properties
        • gora-accumulo/src/main/java/org/apache/gora/accumulo/encoders/Encoder.java
        • gora-accumulo/src/main/java/org/apache/gora/accumulo/query/AccumuloResult.java
        • gora-accumulo/src/test/java/org/apache/gora/accumulo/util/SignedBinaryEncoderTest.java
        • gora-accumulo/pom.xml
        • gora-accumulo/src/test/java/org/apache/gora/accumulo/store/PartitionTest.java
        • gora-accumulo/src/main/java/org/apache/gora/accumulo/encoders/SignedBinaryEncoder.java
        • gora-accumulo/src/main/java/org/apache/gora/accumulo/encoders/Utils.java
        • pom.xml
        • gora-accumulo/src/main/java/org/apache/gora/accumulo/util/FixedByteArrayOutputStream.java
        • gora-accumulo/src/main/java/org/apache/gora/accumulo/store/AccumuloMapping.java
        • gora-accumulo/src/test/java/org/apache/gora/accumulo/util/HexEncoderTest.java

        kturner :
        Files :

        • CHANGES.txt

        kturner :
        Files :

        • gora-accumulo/src/test/java/org/apache/gora/accumulo/store/AccumuloStoreTest.java
        Show
        Hudson added a comment - Integrated in goraOracle #6 (See https://builds.apache.org/job/goraOracle/6/ ) GORA-65 initial checkin of gora accumulo store (Revision f5f1547d77d299f55a13a73c80c51cf6d9d68020) GORA-65 updated CHNAGES.txt (Revision c978e8016d658d6935b67d44ec6b0bdbb80a178f) GORA-65 GORA-66 disabled testDeleteByQueryFields for accumulo (Revision 126259baaab72a8465737dd7ed632588389455f8) Result = FAILURE kturner : Files : gora-accumulo/src/main/java/org/apache/gora/accumulo/encoders/BinaryEncoder.java gora-accumulo/src/test/resources/gora-accumulo-mapping.xml gora-accumulo/src/main/java/org/apache/gora/accumulo/encoders/HexEncoder.java gora-accumulo/src/test/java/org/apache/gora/accumulo/store/AccumuloStoreTest.java gora-accumulo/src/main/java/org/apache/gora/accumulo/query/AccumuloQuery.java gora-accumulo/src/main/java/org/apache/gora/accumulo/store/AccumuloStore.java gora-accumulo/src/test/resources/gora.properties gora-accumulo/src/main/java/org/apache/gora/accumulo/encoders/Encoder.java gora-accumulo/src/main/java/org/apache/gora/accumulo/query/AccumuloResult.java gora-accumulo/src/test/java/org/apache/gora/accumulo/util/SignedBinaryEncoderTest.java gora-accumulo/pom.xml gora-accumulo/src/test/java/org/apache/gora/accumulo/store/PartitionTest.java gora-accumulo/src/main/java/org/apache/gora/accumulo/encoders/SignedBinaryEncoder.java gora-accumulo/src/main/java/org/apache/gora/accumulo/encoders/Utils.java pom.xml gora-accumulo/src/main/java/org/apache/gora/accumulo/util/FixedByteArrayOutputStream.java gora-accumulo/src/main/java/org/apache/gora/accumulo/store/AccumuloMapping.java gora-accumulo/src/test/java/org/apache/gora/accumulo/util/HexEncoderTest.java kturner : Files : CHANGES.txt kturner : Files : gora-accumulo/src/test/java/org/apache/gora/accumulo/store/AccumuloStoreTest.java
        Hide
        Lewis John McGibbney added a comment -

        Bulk close of issues. Preparation for Gora 0.2 release candidate.

        Show
        Lewis John McGibbney added a comment - Bulk close of issues. Preparation for Gora 0.2 release candidate.
        Hide
        Lewis John McGibbney added a comment -

        Hey Keith are you OK to resolve this issue?

        Show
        Lewis John McGibbney added a comment - Hey Keith are you OK to resolve this issue?
        Hide
        Hudson added a comment -

        Integrated in gora-trunk #207 (See https://builds.apache.org/job/gora-trunk/207/)
        GORA-65 GORA-66 disabled testDeleteByQueryFields for accumulo (Revision 1308915)

        Result = SUCCESS
        kturner :
        Files :

        • /gora/trunk/gora-accumulo/src/test/java/org/apache/gora/accumulo/store/AccumuloStoreTest.java
        Show
        Hudson added a comment - Integrated in gora-trunk #207 (See https://builds.apache.org/job/gora-trunk/207/ ) GORA-65 GORA-66 disabled testDeleteByQueryFields for accumulo (Revision 1308915) Result = SUCCESS kturner : Files : /gora/trunk/gora-accumulo/src/test/java/org/apache/gora/accumulo/store/AccumuloStoreTest.java
        Hide
        Hudson added a comment -

        Integrated in gora-trunk #205 (See https://builds.apache.org/job/gora-trunk/205/)
        GORA-65 updated CHNAGES.txt (Revision 1308480)
        GORA-65 initial checkin of gora accumulo store (Revision 1308477)

        Result = UNSTABLE
        kturner :
        Files :

        • /gora/trunk/CHANGES.txt

        kturner :
        Files :

        • /gora/trunk/gora-accumulo
        • /gora/trunk/gora-accumulo/pom.xml
        • /gora/trunk/gora-accumulo/src
        • /gora/trunk/gora-accumulo/src/main
        • /gora/trunk/gora-accumulo/src/main/java
        • /gora/trunk/gora-accumulo/src/main/java/org
        • /gora/trunk/gora-accumulo/src/main/java/org/apache
        • /gora/trunk/gora-accumulo/src/main/java/org/apache/gora
        • /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo
        • /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo/encoders
        • /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo/encoders/BinaryEncoder.java
        • /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo/encoders/Encoder.java
        • /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo/encoders/HexEncoder.java
        • /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo/encoders/SignedBinaryEncoder.java
        • /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo/encoders/Utils.java
        • /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo/query
        • /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo/query/AccumuloQuery.java
        • /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo/query/AccumuloResult.java
        • /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo/store
        • /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo/store/AccumuloMapping.java
        • /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo/store/AccumuloStore.java
        • /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo/util
        • /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo/util/FixedByteArrayOutputStream.java
        • /gora/trunk/gora-accumulo/src/test
        • /gora/trunk/gora-accumulo/src/test/java
        • /gora/trunk/gora-accumulo/src/test/java/org
        • /gora/trunk/gora-accumulo/src/test/java/org/apache
        • /gora/trunk/gora-accumulo/src/test/java/org/apache/gora
        • /gora/trunk/gora-accumulo/src/test/java/org/apache/gora/accumulo
        • /gora/trunk/gora-accumulo/src/test/java/org/apache/gora/accumulo/store
        • /gora/trunk/gora-accumulo/src/test/java/org/apache/gora/accumulo/store/AccumuloStoreTest.java
        • /gora/trunk/gora-accumulo/src/test/java/org/apache/gora/accumulo/store/PartitionTest.java
        • /gora/trunk/gora-accumulo/src/test/java/org/apache/gora/accumulo/util
        • /gora/trunk/gora-accumulo/src/test/java/org/apache/gora/accumulo/util/HexEncoderTest.java
        • /gora/trunk/gora-accumulo/src/test/java/org/apache/gora/accumulo/util/SignedBinaryEncoderTest.java
        • /gora/trunk/gora-accumulo/src/test/resources
        • /gora/trunk/gora-accumulo/src/test/resources/gora-accumulo-mapping.xml
        • /gora/trunk/gora-accumulo/src/test/resources/gora.properties
        • /gora/trunk/pom.xml
        Show
        Hudson added a comment - Integrated in gora-trunk #205 (See https://builds.apache.org/job/gora-trunk/205/ ) GORA-65 updated CHNAGES.txt (Revision 1308480) GORA-65 initial checkin of gora accumulo store (Revision 1308477) Result = UNSTABLE kturner : Files : /gora/trunk/CHANGES.txt kturner : Files : /gora/trunk/gora-accumulo /gora/trunk/gora-accumulo/pom.xml /gora/trunk/gora-accumulo/src /gora/trunk/gora-accumulo/src/main /gora/trunk/gora-accumulo/src/main/java /gora/trunk/gora-accumulo/src/main/java/org /gora/trunk/gora-accumulo/src/main/java/org/apache /gora/trunk/gora-accumulo/src/main/java/org/apache/gora /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo/encoders /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo/encoders/BinaryEncoder.java /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo/encoders/Encoder.java /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo/encoders/HexEncoder.java /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo/encoders/SignedBinaryEncoder.java /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo/encoders/Utils.java /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo/query /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo/query/AccumuloQuery.java /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo/query/AccumuloResult.java /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo/store /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo/store/AccumuloMapping.java /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo/store/AccumuloStore.java /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo/util /gora/trunk/gora-accumulo/src/main/java/org/apache/gora/accumulo/util/FixedByteArrayOutputStream.java /gora/trunk/gora-accumulo/src/test /gora/trunk/gora-accumulo/src/test/java /gora/trunk/gora-accumulo/src/test/java/org /gora/trunk/gora-accumulo/src/test/java/org/apache /gora/trunk/gora-accumulo/src/test/java/org/apache/gora /gora/trunk/gora-accumulo/src/test/java/org/apache/gora/accumulo /gora/trunk/gora-accumulo/src/test/java/org/apache/gora/accumulo/store /gora/trunk/gora-accumulo/src/test/java/org/apache/gora/accumulo/store/AccumuloStoreTest.java /gora/trunk/gora-accumulo/src/test/java/org/apache/gora/accumulo/store/PartitionTest.java /gora/trunk/gora-accumulo/src/test/java/org/apache/gora/accumulo/util /gora/trunk/gora-accumulo/src/test/java/org/apache/gora/accumulo/util/HexEncoderTest.java /gora/trunk/gora-accumulo/src/test/java/org/apache/gora/accumulo/util/SignedBinaryEncoderTest.java /gora/trunk/gora-accumulo/src/test/resources /gora/trunk/gora-accumulo/src/test/resources/gora-accumulo-mapping.xml /gora/trunk/gora-accumulo/src/test/resources/gora.properties /gora/trunk/pom.xml
        Hide
        Lewis John McGibbney added a comment -

        Nice work Keith. Have you thought about running your module against the Tests in DataStoreTestBase? This would require a GoraAccumuloTestDriver implementation similar to HBase and Sql modules. If however this wouldn't provide more coverage than you already think is required then there is no point! I suppose its up to you?

        Show
        Lewis John McGibbney added a comment - Nice work Keith. Have you thought about running your module against the Tests in DataStoreTestBase? This would require a GoraAccumuloTestDriver implementation similar to HBase and Sql modules. If however this wouldn't provide more coverage than you already think is required then there is no point! I suppose its up to you?
        Hide
        Lewis John McGibbney added a comment -

        Hi Keith. Please feel free to check the code into trunk and open a ticket for the documentation. Great news.

        Show
        Lewis John McGibbney added a comment - Hi Keith. Please feel free to check the code into trunk and open a ticket for the documentation. Great news.
        Hide
        Keith Turner added a comment -

        Accumulo 1.4.0 was released. Well the vote went through and its in maven repos, but was a glitch getting the tar balls out to apache dist that we are waiting for infra team to resolve. I have a few minor chnages to make this work w/ 1.4.0 Should I submit another patch or check it in to trunk?

        Show
        Keith Turner added a comment - Accumulo 1.4.0 was released. Well the vote went through and its in maven repos, but was a glitch getting the tar balls out to apache dist that we are waiting for infra team to resolve. I have a few minor chnages to make this work w/ 1.4.0 Should I submit another patch or check it in to trunk?
        Hide
        Keith Turner added a comment -

        Documentation is something I need to do for gora-accumulo

        Show
        Keith Turner added a comment - Documentation is something I need to do for gora-accumulo
        Hide
        Lewis John McGibbney added a comment -

        I think we will be ready to release 0.2 when the majority of the issues [1] are addressed. I would like to think this would be achievable within 1st qtr 2012. Strictly speaking, none are bugs, however the website documentation and sqlbuilder issues are blockers in my opinion.

        [1] https://issues.apache.org/jira/secure/IssueNavigator.jspa?reset=true&jqlQuery=project+%3D+GORA+AND+resolution+%3D+Unresolved+AND+fixVersion+%3D+%220.2%22+ORDER+BY+priority+DESC&mode=hide

        Show
        Lewis John McGibbney added a comment - I think we will be ready to release 0.2 when the majority of the issues [1] are addressed. I would like to think this would be achievable within 1st qtr 2012. Strictly speaking, none are bugs, however the website documentation and sqlbuilder issues are blockers in my opinion. [1] https://issues.apache.org/jira/secure/IssueNavigator.jspa?reset=true&jqlQuery=project+%3D+GORA+AND+resolution+%3D+Unresolved+AND+fixVersion+%3D+%220.2%22+ORDER+BY+priority+DESC&mode=hide
        Hide
        Keith Turner added a comment -

        The problems were with Mock Accumulo. This is a simple implementation of Accumulo that allows unit test to run in process very quickly. It was first introduced in 1.3 and is more mature in 1.4. I ran into some problems getting the test to work against 1.3 mock Accumulo. The test work fine against 1.4. Whats the timeline for 0.2? I do not want to hold it up. I am still very busy w/ testing 1.4 and fixing bugs inorder to get it ready for release.

        Show
        Keith Turner added a comment - The problems were with Mock Accumulo. This is a simple implementation of Accumulo that allows unit test to run in process very quickly. It was first introduced in 1.3 and is more mature in 1.4. I ran into some problems getting the test to work against 1.3 mock Accumulo. The test work fine against 1.4. Whats the timeline for 0.2? I do not want to hold it up. I am still very busy w/ testing 1.4 and fixing bugs inorder to get it ready for release.
        Hide
        Lewis John McGibbney added a comment -

        Hi Keith, what problems were you having with implementing the GoraAccumuloTestDriver to run the existing tests from gora-core/../../../DataStoreTestUtil against? Also to pick you up on something

        {bq}
        We just released 1.3.5 yesterday, we have not yet put jars in a public maven repo. We are still working on that. I can make the patch use 1.3.5. Then the patch would build out of the box once we get the jars in a public repo. {bq}

        I think we should support 1.3.5 when we make our 0.2 release then simply shift to support 1.4.0-incubating-SNAPSHOT in gora trunk.

        I would be happy to see this going in to Gora ASAP, based upon the TestDriver situation. I really like what you have done with the encoding, thanks for being verbose about it above.

        Show
        Lewis John McGibbney added a comment - Hi Keith, what problems were you having with implementing the GoraAccumuloTestDriver to run the existing tests from gora-core/../../../DataStoreTestUtil against? Also to pick you up on something {bq} We just released 1.3.5 yesterday, we have not yet put jars in a public maven repo. We are still working on that. I can make the patch use 1.3.5. Then the patch would build out of the box once we get the jars in a public repo. {bq} I think we should support 1.3.5 when we make our 0.2 release then simply shift to support 1.4.0-incubating-SNAPSHOT in gora trunk. I would be happy to see this going in to Gora ASAP, based upon the TestDriver situation. I really like what you have done with the encoding, thanks for being verbose about it above.
        Hide
        Keith Turner added a comment -

        Oh one other major difference is paritioning a query. I will explain this by example. Suppose I have an gora-accumulo table where the key is a long. Suppose this table has the following splits. There are two reasons these split points are not 8 bytes. Users can insert split points. Also, when Accumulo chooses a split point, it will choose the shortest possible string. So split point do not always come from rows in the table.

        0x20
        0x60
        

        When partitioning a query over the entire table, I have to take the 2 splits above and generate three partition queries that cover the entire table but do not overlap. Also the queries need to align exactly with accumulo tablets (like HBase regions) to maintain locality. The fact that the split points are not 8 byte also makes it tricky, they will not decode as a long. So I generate three gora queries with the following start and end keys. These queries cover all possible longs in the table. The queries map to accumulo tablets which have exclusive start and inclusive end keys.

        query 1  start key=null               end key=0x1fffffffffffffff
        query 2  start key=0x2000000000000000 end key=0x5fffffffffffffff
        query 3  start key=0x6000000000000000 end key=null  
        

        When the key is not fixed width (like a long or int) and its a String, then its much easier to create the partition queries.

        Show
        Keith Turner added a comment - Oh one other major difference is paritioning a query. I will explain this by example. Suppose I have an gora-accumulo table where the key is a long. Suppose this table has the following splits. There are two reasons these split points are not 8 bytes. Users can insert split points. Also, when Accumulo chooses a split point, it will choose the shortest possible string. So split point do not always come from rows in the table. 0x20 0x60 When partitioning a query over the entire table, I have to take the 2 splits above and generate three partition queries that cover the entire table but do not overlap. Also the queries need to align exactly with accumulo tablets (like HBase regions) to maintain locality. The fact that the split points are not 8 byte also makes it tricky, they will not decode as a long. So I generate three gora queries with the following start and end keys. These queries cover all possible longs in the table. The queries map to accumulo tablets which have exclusive start and inclusive end keys. query 1 start key=null end key=0x1fffffffffffffff query 2 start key=0x2000000000000000 end key=0x5fffffffffffffff query 3 start key=0x6000000000000000 end key=null When the key is not fixed width (like a long or int) and its a String, then its much easier to create the partition queries.
        Hide
        Keith Turner added a comment -

        We just released 1.3.5 yesterday, we have not yet put jars in a public maven repo. We are still working on that. I can make the patch use 1.3.5. Then the patch would build out of the box once we get the jars in a public repo.

        We plan to start working on releasing 1.4 now. The patch leverages some newer features. Depending on when we release 1.4 and when the next Gora release, I would probably like to base it against 1.4 if possible. We have just started working on 1.5, so that release will not be soon. Upon entering incubation, 1.3 was our stable branch and we were just about to release 1.4.

        The code should be pretty similar to the HBase data store. One place were I differed is that I made it possible for the user to choose different ways of encoding the data in Accumulo. The BinaryEncode is similar to what HBase does. The SignedBinaryEncoder encodes the data such that negative numbers sort first lexographically. This is useful if the Gora key is long and you want a query from -5 to 5 to work. If you want to use long as the key, but do not want to treat it as an unsigned long then you would not want to use this encoding. The HexEncoder uses ascii hex to encode long, int, float, double, I like this for debugging.

        The mapping file is similar to hbase except for table setup. The table part of a mapping supports setting per table config key value pairs. This is how all tables are configured in Accumulo. Using this mechanism cache, localitly groups, bloom filters, iterators, compression, etc can all be configured for a table by setting key value pairs. The class part of the mapping is the same, except I added the encoder config.

        Is this the type of high level info you were looking for?

        Show
        Keith Turner added a comment - We just released 1.3.5 yesterday, we have not yet put jars in a public maven repo. We are still working on that. I can make the patch use 1.3.5. Then the patch would build out of the box once we get the jars in a public repo. We plan to start working on releasing 1.4 now. The patch leverages some newer features. Depending on when we release 1.4 and when the next Gora release, I would probably like to base it against 1.4 if possible. We have just started working on 1.5, so that release will not be soon. Upon entering incubation, 1.3 was our stable branch and we were just about to release 1.4. The code should be pretty similar to the HBase data store. One place were I differed is that I made it possible for the user to choose different ways of encoding the data in Accumulo. The BinaryEncode is similar to what HBase does. The SignedBinaryEncoder encodes the data such that negative numbers sort first lexographically. This is useful if the Gora key is long and you want a query from -5 to 5 to work. If you want to use long as the key, but do not want to treat it as an unsigned long then you would not want to use this encoding. The HexEncoder uses ascii hex to encode long, int, float, double, I like this for debugging. The mapping file is similar to hbase except for table setup. The table part of a mapping supports setting per table config key value pairs. This is how all tables are configured in Accumulo. Using this mechanism cache, localitly groups, bloom filters, iterators, compression, etc can all be configured for a table by setting key value pairs. The class part of the mapping is the same, except I added the encoder config. Is this the type of high level info you were looking for?
        Hide
        Lewis John McGibbney added a comment -

        Another thing, it would be great to get the MR tests implemented but as Gora doesn't rely upon Hadoop this is not essential. In addition, unfortunately to date we've not managed to implement gora-cassandra tests yet so this is another reason to further support your patch and its backing for integration into the codebase. Thanks

        Show
        Lewis John McGibbney added a comment - Another thing, it would be great to get the MR tests implemented but as Gora doesn't rely upon Hadoop this is not essential. In addition, unfortunately to date we've not managed to implement gora-cassandra tests yet so this is another reason to further support your patch and its backing for integration into the codebase. Thanks
        Hide
        Lewis John McGibbney added a comment -

        Hi Keith. As this is obviously a meaty patch, I'm just trying to take it bit by bit the now. I'm assuming that you's guys @ Accumulo are about to release Accumulo 1.4.X or are you's about to release 1.5.X? I had a look @ 1.3.5 but haven't gone any higher/newer. It suppose on the face of it, it doesn't really make much of a difference (unless there are major API changes), but I would like to get my hands on a similar version of Accumulo that you wrote the gora-module against to try it out. It looks great.

        I wonder if you could provide a bit of detail on the structure of the module and the tests for us guys who might not have immediate gora-accumulo use cases but that would really like to test drive the code before commenting. If we can get this integrated into Gora, then there is scope for further implement it within the Nutchgora branch (under development)... which again would be excellent. Thanks for any info.

        Show
        Lewis John McGibbney added a comment - Hi Keith. As this is obviously a meaty patch, I'm just trying to take it bit by bit the now. I'm assuming that you's guys @ Accumulo are about to release Accumulo 1.4.X or are you's about to release 1.5.X? I had a look @ 1.3.5 but haven't gone any higher/newer. It suppose on the face of it, it doesn't really make much of a difference (unless there are major API changes), but I would like to get my hands on a similar version of Accumulo that you wrote the gora-module against to try it out. It looks great. I wonder if you could provide a bit of detail on the structure of the module and the tests for us guys who might not have immediate gora-accumulo use cases but that would really like to test drive the code before commenting. If we can get this integrated into Gora, then there is scope for further implement it within the Nutchgora branch (under development)... which again would be excellent. Thanks for any info.
        Hide
        Keith Turner added a comment - - edited

        GORA-65-1.patch is a work in progress, posting what I have done so far for review. The issues that I know of with this patch are :

        • depends on unreleased version of accumulo
        • does not run map reduce unit test
        Show
        Keith Turner added a comment - - edited GORA-65 -1.patch is a work in progress, posting what I have done so far for review. The issues that I know of with this patch are : depends on unreleased version of accumulo does not run map reduce unit test
        Hide
        Keith Turner added a comment -

        I am currently working on implementing this and plan to post a patch when I have some basic functionality that passes the basic test suite.

        Show
        Keith Turner added a comment - I am currently working on implementing this and plan to post a patch when I have some basic functionality that passes the basic test suite.

          People

          • Assignee:
            Unassigned
            Reporter:
            Keith Turner
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development