Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.4.4
    • Fix Version/s: 1.4.5
    • Component/s: None
    • Labels:

      Description

      As mentioned in ACCUMULO-141, add support to SQOOP to output data into Accumulo tables in much the same way as data is currently able to be exported into HBase.

      1. SQOOP-767.patch
        79 kB
        Philip A Grim II

        Issue Links

          Activity

          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop100 #827 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/827/)
          SQOOP-767: Add support for Accumulo (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=5f7013eae1d353cbc144239a4d6a4b4bc42e5c34)

          • src/java/org/apache/sqoop/mapreduce/AccumuloImportMapper.java
          • src/java/org/apache/sqoop/manager/SqlManager.java
          • src/java/org/apache/sqoop/accumulo/AccumuloUtil.java
          • bin/configure-sqoop
          • src/docs/user/validation.txt
          • src/test/org/apache/sqoop/accumulo/AccumuloTestCase.java
          • src/java/org/apache/sqoop/tool/ImportTool.java
          • src/java/org/apache/sqoop/SqoopOptions.java
          • src/java/org/apache/sqoop/accumulo/MutationTransformer.java
          • src/test/org/apache/sqoop/accumulo/TestAccumuloQueryImport.java
          • src/java/org/apache/sqoop/accumulo/ToStringMutationTransformer.java
          • bin/configure-sqoop.cmd
          • src/docs/user/import.txt
          • src/test/org/apache/sqoop/accumulo/TestAccumuloImport.java
          • src/docs/user/accumulo-args.txt
          • src/java/org/apache/sqoop/tool/BaseSqoopTool.java
          • src/java/org/apache/sqoop/accumulo/AccumuloConstants.java
          • src/java/org/apache/sqoop/accumulo/AccumuloMutationProcessor.java
          • src/docs/user/accumulo.txt
          • src/test/org/apache/sqoop/accumulo/TestAccumuloUtil.java
          • src/java/org/apache/sqoop/mapreduce/AccumuloImportJob.java
          • ivy.xml
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop100 #827 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/827/ ) SQOOP-767 : Add support for Accumulo (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=5f7013eae1d353cbc144239a4d6a4b4bc42e5c34 ) src/java/org/apache/sqoop/mapreduce/AccumuloImportMapper.java src/java/org/apache/sqoop/manager/SqlManager.java src/java/org/apache/sqoop/accumulo/AccumuloUtil.java bin/configure-sqoop src/docs/user/validation.txt src/test/org/apache/sqoop/accumulo/AccumuloTestCase.java src/java/org/apache/sqoop/tool/ImportTool.java src/java/org/apache/sqoop/SqoopOptions.java src/java/org/apache/sqoop/accumulo/MutationTransformer.java src/test/org/apache/sqoop/accumulo/TestAccumuloQueryImport.java src/java/org/apache/sqoop/accumulo/ToStringMutationTransformer.java bin/configure-sqoop.cmd src/docs/user/import.txt src/test/org/apache/sqoop/accumulo/TestAccumuloImport.java src/docs/user/accumulo-args.txt src/java/org/apache/sqoop/tool/BaseSqoopTool.java src/java/org/apache/sqoop/accumulo/AccumuloConstants.java src/java/org/apache/sqoop/accumulo/AccumuloMutationProcessor.java src/docs/user/accumulo.txt src/test/org/apache/sqoop/accumulo/TestAccumuloUtil.java src/java/org/apache/sqoop/mapreduce/AccumuloImportJob.java ivy.xml
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop23 #1064 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/1064/)
          SQOOP-767: Add support for Accumulo (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=5f7013eae1d353cbc144239a4d6a4b4bc42e5c34)

          • src/java/org/apache/sqoop/mapreduce/AccumuloImportJob.java
          • src/docs/user/accumulo-args.txt
          • src/java/org/apache/sqoop/accumulo/AccumuloUtil.java
          • src/java/org/apache/sqoop/accumulo/MutationTransformer.java
          • src/test/org/apache/sqoop/accumulo/TestAccumuloUtil.java
          • src/java/org/apache/sqoop/SqoopOptions.java
          • src/java/org/apache/sqoop/accumulo/AccumuloConstants.java
          • src/java/org/apache/sqoop/accumulo/AccumuloMutationProcessor.java
          • src/test/org/apache/sqoop/accumulo/TestAccumuloQueryImport.java
          • src/java/org/apache/sqoop/tool/BaseSqoopTool.java
          • bin/configure-sqoop.cmd
          • src/java/org/apache/sqoop/mapreduce/AccumuloImportMapper.java
          • src/test/org/apache/sqoop/accumulo/TestAccumuloImport.java
          • src/java/org/apache/sqoop/accumulo/ToStringMutationTransformer.java
          • ivy.xml
          • src/docs/user/accumulo.txt
          • src/test/org/apache/sqoop/accumulo/AccumuloTestCase.java
          • bin/configure-sqoop
          • src/java/org/apache/sqoop/manager/SqlManager.java
          • src/docs/user/import.txt
          • src/java/org/apache/sqoop/tool/ImportTool.java
          • src/docs/user/validation.txt
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop23 #1064 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/1064/ ) SQOOP-767 : Add support for Accumulo (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=5f7013eae1d353cbc144239a4d6a4b4bc42e5c34 ) src/java/org/apache/sqoop/mapreduce/AccumuloImportJob.java src/docs/user/accumulo-args.txt src/java/org/apache/sqoop/accumulo/AccumuloUtil.java src/java/org/apache/sqoop/accumulo/MutationTransformer.java src/test/org/apache/sqoop/accumulo/TestAccumuloUtil.java src/java/org/apache/sqoop/SqoopOptions.java src/java/org/apache/sqoop/accumulo/AccumuloConstants.java src/java/org/apache/sqoop/accumulo/AccumuloMutationProcessor.java src/test/org/apache/sqoop/accumulo/TestAccumuloQueryImport.java src/java/org/apache/sqoop/tool/BaseSqoopTool.java bin/configure-sqoop.cmd src/java/org/apache/sqoop/mapreduce/AccumuloImportMapper.java src/test/org/apache/sqoop/accumulo/TestAccumuloImport.java src/java/org/apache/sqoop/accumulo/ToStringMutationTransformer.java ivy.xml src/docs/user/accumulo.txt src/test/org/apache/sqoop/accumulo/AccumuloTestCase.java bin/configure-sqoop src/java/org/apache/sqoop/manager/SqlManager.java src/docs/user/import.txt src/java/org/apache/sqoop/tool/ImportTool.java src/docs/user/validation.txt
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop20 #862 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/862/)
          SQOOP-767: Add support for Accumulo (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=5f7013eae1d353cbc144239a4d6a4b4bc42e5c34)

          • src/docs/user/accumulo-args.txt
          • src/test/org/apache/sqoop/accumulo/TestAccumuloImport.java
          • src/java/org/apache/sqoop/mapreduce/AccumuloImportJob.java
          • src/docs/user/import.txt
          • src/test/org/apache/sqoop/accumulo/TestAccumuloUtil.java
          • src/java/org/apache/sqoop/accumulo/AccumuloConstants.java
          • src/java/org/apache/sqoop/tool/BaseSqoopTool.java
          • src/java/org/apache/sqoop/manager/SqlManager.java
          • src/java/org/apache/sqoop/accumulo/AccumuloMutationProcessor.java
          • src/java/org/apache/sqoop/tool/ImportTool.java
          • bin/configure-sqoop.cmd
          • src/java/org/apache/sqoop/mapreduce/AccumuloImportMapper.java
          • src/java/org/apache/sqoop/accumulo/AccumuloUtil.java
          • src/java/org/apache/sqoop/accumulo/MutationTransformer.java
          • src/docs/user/validation.txt
          • ivy.xml
          • bin/configure-sqoop
          • src/java/org/apache/sqoop/SqoopOptions.java
          • src/test/org/apache/sqoop/accumulo/AccumuloTestCase.java
          • src/java/org/apache/sqoop/accumulo/ToStringMutationTransformer.java
          • src/test/org/apache/sqoop/accumulo/TestAccumuloQueryImport.java
          • src/docs/user/accumulo.txt
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop20 #862 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/862/ ) SQOOP-767 : Add support for Accumulo (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=5f7013eae1d353cbc144239a4d6a4b4bc42e5c34 ) src/docs/user/accumulo-args.txt src/test/org/apache/sqoop/accumulo/TestAccumuloImport.java src/java/org/apache/sqoop/mapreduce/AccumuloImportJob.java src/docs/user/import.txt src/test/org/apache/sqoop/accumulo/TestAccumuloUtil.java src/java/org/apache/sqoop/accumulo/AccumuloConstants.java src/java/org/apache/sqoop/tool/BaseSqoopTool.java src/java/org/apache/sqoop/manager/SqlManager.java src/java/org/apache/sqoop/accumulo/AccumuloMutationProcessor.java src/java/org/apache/sqoop/tool/ImportTool.java bin/configure-sqoop.cmd src/java/org/apache/sqoop/mapreduce/AccumuloImportMapper.java src/java/org/apache/sqoop/accumulo/AccumuloUtil.java src/java/org/apache/sqoop/accumulo/MutationTransformer.java src/docs/user/validation.txt ivy.xml bin/configure-sqoop src/java/org/apache/sqoop/SqoopOptions.java src/test/org/apache/sqoop/accumulo/AccumuloTestCase.java src/java/org/apache/sqoop/accumulo/ToStringMutationTransformer.java src/test/org/apache/sqoop/accumulo/TestAccumuloQueryImport.java src/docs/user/accumulo.txt
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop200 #868 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/868/)
          SQOOP-767: Add support for Accumulo (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=5f7013eae1d353cbc144239a4d6a4b4bc42e5c34)

          • src/docs/user/validation.txt
          • src/java/org/apache/sqoop/accumulo/MutationTransformer.java
          • ivy.xml
          • src/docs/user/import.txt
          • src/java/org/apache/sqoop/SqoopOptions.java
          • src/java/org/apache/sqoop/accumulo/ToStringMutationTransformer.java
          • src/java/org/apache/sqoop/tool/ImportTool.java
          • src/java/org/apache/sqoop/accumulo/AccumuloConstants.java
          • src/java/org/apache/sqoop/manager/SqlManager.java
          • bin/configure-sqoop
          • src/test/org/apache/sqoop/accumulo/TestAccumuloImport.java
          • src/docs/user/accumulo-args.txt
          • src/test/org/apache/sqoop/accumulo/AccumuloTestCase.java
          • src/java/org/apache/sqoop/accumulo/AccumuloUtil.java
          • src/test/org/apache/sqoop/accumulo/TestAccumuloUtil.java
          • src/java/org/apache/sqoop/mapreduce/AccumuloImportJob.java
          • src/docs/user/accumulo.txt
          • src/test/org/apache/sqoop/accumulo/TestAccumuloQueryImport.java
          • src/java/org/apache/sqoop/tool/BaseSqoopTool.java
          • bin/configure-sqoop.cmd
          • src/java/org/apache/sqoop/mapreduce/AccumuloImportMapper.java
          • src/java/org/apache/sqoop/accumulo/AccumuloMutationProcessor.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop200 #868 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/868/ ) SQOOP-767 : Add support for Accumulo (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=5f7013eae1d353cbc144239a4d6a4b4bc42e5c34 ) src/docs/user/validation.txt src/java/org/apache/sqoop/accumulo/MutationTransformer.java ivy.xml src/docs/user/import.txt src/java/org/apache/sqoop/SqoopOptions.java src/java/org/apache/sqoop/accumulo/ToStringMutationTransformer.java src/java/org/apache/sqoop/tool/ImportTool.java src/java/org/apache/sqoop/accumulo/AccumuloConstants.java src/java/org/apache/sqoop/manager/SqlManager.java bin/configure-sqoop src/test/org/apache/sqoop/accumulo/TestAccumuloImport.java src/docs/user/accumulo-args.txt src/test/org/apache/sqoop/accumulo/AccumuloTestCase.java src/java/org/apache/sqoop/accumulo/AccumuloUtil.java src/test/org/apache/sqoop/accumulo/TestAccumuloUtil.java src/java/org/apache/sqoop/mapreduce/AccumuloImportJob.java src/docs/user/accumulo.txt src/test/org/apache/sqoop/accumulo/TestAccumuloQueryImport.java src/java/org/apache/sqoop/tool/BaseSqoopTool.java bin/configure-sqoop.cmd src/java/org/apache/sqoop/mapreduce/AccumuloImportMapper.java src/java/org/apache/sqoop/accumulo/AccumuloMutationProcessor.java
          Hide
          pgrim Philip A Grim II added a comment -

          Thank you, sir!

          Show
          pgrim Philip A Grim II added a comment - Thank you, sir!
          Hide
          jarcec Jarek Jarcec Cecho added a comment -

          I've just committed the patch, thank you Philip A Grim II for your contribution!

          Show
          jarcec Jarek Jarcec Cecho added a comment - I've just committed the patch, thank you Philip A Grim II for your contribution!
          Hide
          jira-bot ASF subversion and git services added a comment -

          Commit 5f7013eae1d353cbc144239a4d6a4b4bc42e5c34 in branch refs/heads/trunk from Jarek Jarcec Cecho
          [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=5f7013e ]

          SQOOP-767: Add support for Accumulo

          (Philip A Grim II via Jarek Jarcec Cecho)

          Show
          jira-bot ASF subversion and git services added a comment - Commit 5f7013eae1d353cbc144239a4d6a4b4bc42e5c34 in branch refs/heads/trunk from Jarek Jarcec Cecho [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=5f7013e ] SQOOP-767 : Add support for Accumulo (Philip A Grim II via Jarek Jarcec Cecho)
          Hide
          pgrim Philip A Grim II added a comment -

          Final version.

          Show
          pgrim Philip A Grim II added a comment - Final version.
          Hide
          pgrim Philip A Grim II added a comment -

          New update per review board.

          Show
          pgrim Philip A Grim II added a comment - New update per review board.
          Hide
          pgrim Philip A Grim II added a comment -

          Updated with latest review board changes.

          Show
          pgrim Philip A Grim II added a comment - Updated with latest review board changes.
          Hide
          pgrim Philip A Grim II added a comment -

          Latest updates from review board.

          Show
          pgrim Philip A Grim II added a comment - Latest updates from review board.
          Hide
          pgrim Philip A Grim II added a comment -

          Excellent - thank you.

          Show
          pgrim Philip A Grim II added a comment - Excellent - thank you.
          Hide
          jarcec Jarek Jarcec Cecho added a comment -

          Philip A Grim II I've noticed that Sean has +1 the patch on review board, so I'll jump to the review tomorrow and eventually commit your patch.

          Show
          jarcec Jarek Jarcec Cecho added a comment - Philip A Grim II I've noticed that Sean has +1 the patch on review board, so I'll jump to the review tomorrow and eventually commit your patch.
          Hide
          pgrim Philip A Grim II added a comment -

          So...this being my first time, what's the next step?

          Show
          pgrim Philip A Grim II added a comment - So...this being my first time, what's the next step?
          Hide
          pgrim Philip A Grim II added a comment -

          Updated to apply cleanly after trunk update.

          Show
          pgrim Philip A Grim II added a comment - Updated to apply cleanly after trunk update.
          Hide
          pgrim Philip A Grim II added a comment -

          Newest review changes.

          Show
          pgrim Philip A Grim II added a comment - Newest review changes.
          Hide
          pgrim Philip A Grim II added a comment -

          Updated with review board changes.

          Show
          pgrim Philip A Grim II added a comment - Updated with review board changes.
          Hide
          pgrim Philip A Grim II added a comment -

          Updated with review board fixes.

          Show
          pgrim Philip A Grim II added a comment - Updated with review board fixes.
          Hide
          pgrim Philip A Grim II added a comment -

          Trying patch submission again.

          Show
          pgrim Philip A Grim II added a comment - Trying patch submission again.
          Hide
          pgrim Philip A Grim II added a comment -

          Patch upload didn't take. Redoing it.

          Show
          pgrim Philip A Grim II added a comment - Patch upload didn't take. Redoing it.
          Hide
          pgrim Philip A Grim II added a comment -

          Updated patch to latest.

          Show
          pgrim Philip A Grim II added a comment - Updated patch to latest.
          Hide
          jarcec Jarek Jarcec Cecho added a comment -

          Thank you Philip A Grim II!

          Show
          jarcec Jarek Jarcec Cecho added a comment - Thank you Philip A Grim II !
          Hide
          pgrim Philip A Grim II added a comment -

          Working on it - apparently there's interest in this again.

          Show
          pgrim Philip A Grim II added a comment - Working on it - apparently there's interest in this again.
          Hide
          jarcec Jarek Jarcec Cecho added a comment -

          Cancelling patch as it do no longer applies cleanly. Please don't hesitate Philip A Grim II and set back the "Patch available" state when new patch will be available!

          Show
          jarcec Jarek Jarcec Cecho added a comment - Cancelling patch as it do no longer applies cleanly. Please don't hesitate Philip A Grim II and set back the "Patch available" state when new patch will be available!
          Hide
          vasanthkumar Vasanth kumar RJ added a comment -

          Hi Philip, seems this patch is too old so please update patch and get reviewed if you really want to include in 1.4.4 release

          Show
          vasanthkumar Vasanth kumar RJ added a comment - Hi Philip, seems this patch is too old so please update patch and get reviewed if you really want to include in 1.4.4 release
          Hide
          pgrim Philip A Grim II added a comment -

          Updated version to fix style nits.
          Added JUnit testing using Accumulo MockInstance.

          Show
          pgrim Philip A Grim II added a comment - Updated version to fix style nits. Added JUnit testing using Accumulo MockInstance.
          Hide
          pgrim Philip A Grim II added a comment -

          Updated patch to address latest review comments.
          Still need to add more testing.

          Show
          pgrim Philip A Grim II added a comment - Updated patch to address latest review comments. Still need to add more testing.
          Hide
          pgrim Philip A Grim II added a comment -

          Updated patch to address review comments.

          Show
          pgrim Philip A Grim II added a comment - Updated patch to address review comments.
          Hide
          jarcec Jarek Jarcec Cecho added a comment -

          Thank you Philip,
          I'll take a look in upcoming days.

          Show
          jarcec Jarek Jarcec Cecho added a comment - Thank you Philip, I'll take a look in upcoming days.
          Hide
          pgrim Philip A Grim II added a comment -

          Uploaded to review board.

          Show
          pgrim Philip A Grim II added a comment - Uploaded to review board.
          Hide
          jarcec Jarek Jarcec Cecho added a comment -

          Hi Philip,
          Thank you very much for your time and effort. 39k is quite big patch, would you mind uploading to Apache review board for easier review process? (https://reviews.apache.org)

          Jarcec

          Show
          jarcec Jarek Jarcec Cecho added a comment - Hi Philip, Thank you very much for your time and effort. 39k is quite big patch, would you mind uploading to Apache review board for easier review process? ( https://reviews.apache.org ) Jarcec
          Hide
          pgrim Philip A Grim II added a comment -

          Adds the ability to import to Accumulo in much the same manner as the existing HBase import capability.

          Show
          pgrim Philip A Grim II added a comment - Adds the ability to import to Accumulo in much the same manner as the existing HBase import capability.

            People

            • Assignee:
              pgrim Philip A Grim II
              Reporter:
              pgrim Philip A Grim II
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 48h
                48h
                Remaining:
                Remaining Estimate - 48h
                48h
                Logged:
                Time Spent - Not Specified
                Not Specified

                  Development