Sqoop
  1. Sqoop
  2. SQOOP-421

User guide should state that when using --direct, hbase params get ignored

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 1.3.0, 1.4.0-incubating, 1.4.1-incubating
    • Fix Version/s: 1.4.1-incubating
    • Component/s: docs
    • Labels:
      None

      Description

      When using --direct (at least with mysql) the resulting files will always be written into hdfs, even if the hbase* params are in use. The User Guide should state in the HBase section that it is incompatible with --direct. I haven't tested postgres but I suspect it has the same problem.

      1. SQOOP-421.patch
        0.9 kB
        Jarek Jarcec Cecho
      2. SQOOP-421.patch
        0.6 kB
        Jarek Jarcec Cecho

        Activity

        Hide
        jiraposter@reviews.apache.org added a comment -

        -----------------------------------------------------------
        This is an automatically generated e-mail. To reply, visit:
        https://reviews.apache.org/r/3430/
        -----------------------------------------------------------

        Review request for Sqoop, Arvind Prabhakar and Alex Newman.

        Summary
        -------

        I've just added note that --direct parameter is incompatible with HBase import.

        This addresses bug SQOOP-421.
        https://issues.apache.org/jira/browse/SQOOP-421

        Diffs


        /src/docs/user/hbase.txt 1228879

        Diff: https://reviews.apache.org/r/3430/diff

        Testing
        -------

        Thanks,

        Jarek

        Show
        jiraposter@reviews.apache.org added a comment - ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/3430/ ----------------------------------------------------------- Review request for Sqoop, Arvind Prabhakar and Alex Newman. Summary ------- I've just added note that --direct parameter is incompatible with HBase import. This addresses bug SQOOP-421 . https://issues.apache.org/jira/browse/SQOOP-421 Diffs /src/docs/user/hbase.txt 1228879 Diff: https://reviews.apache.org/r/3430/diff Testing ------- Thanks, Jarek
        Hide
        jiraposter@reviews.apache.org added a comment -

        -----------------------------------------------------------
        This is an automatically generated e-mail. To reply, visit:
        https://reviews.apache.org/r/3430/#review4268
        -----------------------------------------------------------

        Ship it!

        I'm going to assume you compiled and looked at the doc. If so lgtm!

        /src/docs/user/hbase.txt
        <https://reviews.apache.org/r/3430/#comment9637>

        Not exactly sure if this line matters

        • Alex

        On 2012-01-08 16:43:49, Jarek Cecho wrote:

        -----------------------------------------------------------

        This is an automatically generated e-mail. To reply, visit:

        https://reviews.apache.org/r/3430/

        -----------------------------------------------------------

        (Updated 2012-01-08 16:43:49)

        Review request for Sqoop, Arvind Prabhakar and Alex Newman.

        Summary

        -------

        I've just added note that --direct parameter is incompatible with HBase import.

        This addresses bug SQOOP-421.

        https://issues.apache.org/jira/browse/SQOOP-421

        Diffs

        -----

        /src/docs/user/hbase.txt 1228879

        Diff: https://reviews.apache.org/r/3430/diff

        Testing

        -------

        Thanks,

        Jarek

        Show
        jiraposter@reviews.apache.org added a comment - ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/3430/#review4268 ----------------------------------------------------------- Ship it! I'm going to assume you compiled and looked at the doc. If so lgtm! /src/docs/user/hbase.txt < https://reviews.apache.org/r/3430/#comment9637 > Not exactly sure if this line matters Alex On 2012-01-08 16:43:49, Jarek Cecho wrote: ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/3430/ ----------------------------------------------------------- (Updated 2012-01-08 16:43:49) Review request for Sqoop, Arvind Prabhakar and Alex Newman. Summary ------- I've just added note that --direct parameter is incompatible with HBase import. This addresses bug SQOOP-421 . https://issues.apache.org/jira/browse/SQOOP-421 Diffs ----- /src/docs/user/hbase.txt 1228879 Diff: https://reviews.apache.org/r/3430/diff Testing ------- Thanks, Jarek
        Hide
        jiraposter@reviews.apache.org added a comment -

        On 2012-01-09 17:51:17, Alex Newman wrote:

        > I'm going to assume you compiled and looked at the doc. If so lgtm!

        Yup, your assumption is correct, I built the documentation and it seems fine. I've uploaded to JIRA updated version without the extra line, so feel free to commit it.

        On 2012-01-09 17:51:17, Alex Newman wrote:

        > /src/docs/user/hbase.txt, line 27

        > <https://reviews.apache.org/r/3430/diff/1/?file=67157#file67157line27>

        >

        > Not exactly sure if this line matters

        Thank you for pointing this empty line out. It's ugly artifact that I left there accidentally when I was moving NOTE block around the text for best position.

        • Jarek

        -----------------------------------------------------------
        This is an automatically generated e-mail. To reply, visit:
        https://reviews.apache.org/r/3430/#review4268
        -----------------------------------------------------------

        On 2012-01-08 16:43:49, Jarek Cecho wrote:

        -----------------------------------------------------------

        This is an automatically generated e-mail. To reply, visit:

        https://reviews.apache.org/r/3430/

        -----------------------------------------------------------

        (Updated 2012-01-08 16:43:49)

        Review request for Sqoop, Arvind Prabhakar and Alex Newman.

        Summary

        -------

        I've just added note that --direct parameter is incompatible with HBase import.

        This addresses bug SQOOP-421.

        https://issues.apache.org/jira/browse/SQOOP-421

        Diffs

        -----

        /src/docs/user/hbase.txt 1228879

        Diff: https://reviews.apache.org/r/3430/diff

        Testing

        -------

        Thanks,

        Jarek

        Show
        jiraposter@reviews.apache.org added a comment - On 2012-01-09 17:51:17, Alex Newman wrote: > I'm going to assume you compiled and looked at the doc. If so lgtm! Yup, your assumption is correct, I built the documentation and it seems fine. I've uploaded to JIRA updated version without the extra line, so feel free to commit it. On 2012-01-09 17:51:17, Alex Newman wrote: > /src/docs/user/hbase.txt, line 27 > < https://reviews.apache.org/r/3430/diff/1/?file=67157#file67157line27 > > > Not exactly sure if this line matters Thank you for pointing this empty line out. It's ugly artifact that I left there accidentally when I was moving NOTE block around the text for best position. Jarek ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/3430/#review4268 ----------------------------------------------------------- On 2012-01-08 16:43:49, Jarek Cecho wrote: ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/3430/ ----------------------------------------------------------- (Updated 2012-01-08 16:43:49) Review request for Sqoop, Arvind Prabhakar and Alex Newman. Summary ------- I've just added note that --direct parameter is incompatible with HBase import. This addresses bug SQOOP-421 . https://issues.apache.org/jira/browse/SQOOP-421 Diffs ----- /src/docs/user/hbase.txt 1228879 Diff: https://reviews.apache.org/r/3430/diff Testing ------- Thanks, Jarek
        Hide
        Hudson added a comment -

        Integrated in Sqoop-ant-jdk-1.6 #74 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6/74/)
        SQOOP-421. User guide should state that when using --direct, hbase params get ignored
        (Jarek Jarcec Cecho via Alex Newman)

        posix4e : http://svn.apache.org/viewvc/?view=rev&rev=1229399
        Files :

        • /incubator/sqoop/trunk/src/docs/user/hbase.txt
        Show
        Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6 #74 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6/74/ ) SQOOP-421 . User guide should state that when using --direct, hbase params get ignored (Jarek Jarcec Cecho via Alex Newman) posix4e : http://svn.apache.org/viewvc/?view=rev&rev=1229399 Files : /incubator/sqoop/trunk/src/docs/user/hbase.txt

          People

          • Assignee:
            Jarek Jarcec Cecho
            Reporter:
            Oliver Meyn
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development