Sqoop
  1. Sqoop
  2. SQOOP-316

Sqoop user guide should have a troubleshooting section.

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.4.0-incubating
    • Component/s: docs
    • Labels:
      None
    1. SQOOP-316-2.patch
      7 kB
      Arvind Prabhakar
    2. SQOOP-316-1.patch
      7 kB
      Arvind Prabhakar
    3. SQOOP-316.patch
      7 kB
      Arvind Prabhakar

      Activity

      Hide
      Hudson added a comment -

      Integrated in Sqoop-jdk-1.6 #12 (See https://builds.apache.org/job/Sqoop-jdk-1.6/12/)
      SQOOP-316. Added troubleshooting section to user guide.

      arvind : http://svn.apache.org/viewvc/?view=rev&rev=1158959
      Files :

      • /incubator/sqoop/trunk/src/docs/user/SqoopUserGuide.txt
      • /incubator/sqoop/trunk/src/docs/user/troubleshooting.txt
      Show
      Hudson added a comment - Integrated in Sqoop-jdk-1.6 #12 (See https://builds.apache.org/job/Sqoop-jdk-1.6/12/ ) SQOOP-316 . Added troubleshooting section to user guide. arvind : http://svn.apache.org/viewvc/?view=rev&rev=1158959 Files : /incubator/sqoop/trunk/src/docs/user/SqoopUserGuide.txt /incubator/sqoop/trunk/src/docs/user/troubleshooting.txt
      Arvind Prabhakar made changes -
      Status Patch Available [ 10002 ] Resolved [ 5 ]
      Resolution Fixed [ 1 ]
      Hide
      Arvind Prabhakar added a comment -

      Patch committed.

      Show
      Arvind Prabhakar added a comment - Patch committed.
      Hide
      jiraposter@reviews.apache.org added a comment -

      -----------------------------------------------------------
      This is an automatically generated e-mail. To reply, visit:
      https://reviews.apache.org/r/1541/
      -----------------------------------------------------------

      (Updated 2011-08-17 15:49:43.929770)

      Review request for Sqoop and Ahmed Radwan.

      Changes
      -------

      Incorporated review comments. Thanks Jon and Ahmed for the review!

      Summary
      -------

      Added a troubleshooting section.

      This addresses bug SQOOP-316.
      https://issues.apache.org/jira/browse/SQOOP-316

      Diffs (updated)


      /src/docs/user/SqoopUserGuide.txt 1158375
      /src/docs/user/troubleshooting.txt PRE-CREATION

      Diff: https://reviews.apache.org/r/1541/diff

      Testing
      -------

      Built documentation and checked to see that the new section shows up correctly.

      Thanks,

      Arvind

      Show
      jiraposter@reviews.apache.org added a comment - ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/1541/ ----------------------------------------------------------- (Updated 2011-08-17 15:49:43.929770) Review request for Sqoop and Ahmed Radwan. Changes ------- Incorporated review comments. Thanks Jon and Ahmed for the review! Summary ------- Added a troubleshooting section. This addresses bug SQOOP-316 . https://issues.apache.org/jira/browse/SQOOP-316 Diffs (updated) /src/docs/user/SqoopUserGuide.txt 1158375 /src/docs/user/troubleshooting.txt PRE-CREATION Diff: https://reviews.apache.org/r/1541/diff Testing ------- Built documentation and checked to see that the new section shows up correctly. Thanks, Arvind
      Arvind Prabhakar made changes -
      Attachment SQOOP-316-2.patch [ 12490665 ]
      Hide
      jiraposter@reviews.apache.org added a comment -

      On 2011-08-17 07:03:34, Ahmed Radwan wrote:

      > /src/docs/user/troubleshooting.txt, line 35

      > <https://reviews.apache.org/r/1541/diff/2/?file=32968#file32968line35>

      >

      > "Make sure that the necessary input files or input/output tables are present and can be accessed by ... ".

      >

      > Just to take into account the export output tables too.

      >

      >

      Agree.

      On 2011-08-17 07:03:34, Ahmed Radwan wrote:

      > /src/docs/user/troubleshooting.txt, line 43

      > <https://reviews.apache.org/r/1541/diff/2/?file=32968#file32968line43>

      >

      > "... For example an import that creates and populates ..."

      Agree.

      On 2011-08-17 07:03:34, Ahmed Radwan wrote:

      > /src/docs/user/troubleshooting.txt, line 45

      > <https://reviews.apache.org/r/1541/diff/2/?file=32968#file32968line45>

      >

      > "... and the second to create and populate a Hive table ..."

      The command that creates and populates the Hive table implicitly does the import as well. However, when that fails (which is the case in the said example), the troubleshooting suggestion is to first do the import, and next do the "create-hive-table" only. This only provisions the Hive metastore but does not load the data in the table, which can be manually done. The key thing here is that if there is a problem in accessing Hive or doing import, it will likely show up in one of these two steps. I will make this explicit in the document.

      On 2011-08-17 07:03:34, Ahmed Radwan wrote:

      > /src/docs/user/troubleshooting.txt, line 47

      > <https://reviews.apache.org/r/1541/diff/2/?file=32968#file32968line47>

      >

      > "... or during the creation and population of ..."

      Agree.

      • Arvind

      -----------------------------------------------------------
      This is an automatically generated e-mail. To reply, visit:
      https://reviews.apache.org/r/1541/#review1491
      -----------------------------------------------------------

      On 2011-08-17 03:00:00, Arvind Prabhakar wrote:

      -----------------------------------------------------------

      This is an automatically generated e-mail. To reply, visit:

      https://reviews.apache.org/r/1541/

      -----------------------------------------------------------

      (Updated 2011-08-17 03:00:00)

      Review request for Sqoop and Ahmed Radwan.

      Summary

      -------

      Added a troubleshooting section.

      This addresses bug SQOOP-316.

      https://issues.apache.org/jira/browse/SQOOP-316

      Diffs

      -----

      /src/docs/user/SqoopUserGuide.txt 1158375

      /src/docs/user/troubleshooting.txt PRE-CREATION

      Diff: https://reviews.apache.org/r/1541/diff

      Testing

      -------

      Built documentation and checked to see that the new section shows up correctly.

      Thanks,

      Arvind

      Show
      jiraposter@reviews.apache.org added a comment - On 2011-08-17 07:03:34, Ahmed Radwan wrote: > /src/docs/user/troubleshooting.txt, line 35 > < https://reviews.apache.org/r/1541/diff/2/?file=32968#file32968line35 > > > "Make sure that the necessary input files or input/output tables are present and can be accessed by ... ". > > Just to take into account the export output tables too. > > Agree. On 2011-08-17 07:03:34, Ahmed Radwan wrote: > /src/docs/user/troubleshooting.txt, line 43 > < https://reviews.apache.org/r/1541/diff/2/?file=32968#file32968line43 > > > "... For example an import that creates and populates ..." Agree. On 2011-08-17 07:03:34, Ahmed Radwan wrote: > /src/docs/user/troubleshooting.txt, line 45 > < https://reviews.apache.org/r/1541/diff/2/?file=32968#file32968line45 > > > "... and the second to create and populate a Hive table ..." The command that creates and populates the Hive table implicitly does the import as well. However, when that fails (which is the case in the said example), the troubleshooting suggestion is to first do the import, and next do the "create-hive-table" only. This only provisions the Hive metastore but does not load the data in the table, which can be manually done. The key thing here is that if there is a problem in accessing Hive or doing import, it will likely show up in one of these two steps. I will make this explicit in the document. On 2011-08-17 07:03:34, Ahmed Radwan wrote: > /src/docs/user/troubleshooting.txt, line 47 > < https://reviews.apache.org/r/1541/diff/2/?file=32968#file32968line47 > > > "... or during the creation and population of ..." Agree. Arvind ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/1541/#review1491 ----------------------------------------------------------- On 2011-08-17 03:00:00, Arvind Prabhakar wrote: ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/1541/ ----------------------------------------------------------- (Updated 2011-08-17 03:00:00) Review request for Sqoop and Ahmed Radwan. Summary ------- Added a troubleshooting section. This addresses bug SQOOP-316 . https://issues.apache.org/jira/browse/SQOOP-316 Diffs ----- /src/docs/user/SqoopUserGuide.txt 1158375 /src/docs/user/troubleshooting.txt PRE-CREATION Diff: https://reviews.apache.org/r/1541/diff Testing ------- Built documentation and checked to see that the new section shows up correctly. Thanks, Arvind
      Hide
      jiraposter@reviews.apache.org added a comment -

      On 2011-08-17 04:10:58, jmhsieh wrote:

      > lgtm. I

      >

      > Do you think this should this go in the wiki or in the formal docs? (I lean towards wiki personally, but not sure why).

      Personally, I feel that the wiki should host an FAQ style document. This on the other hand falls in the category of standard procedure for troubleshooting.

      On 2011-08-17 04:10:58, jmhsieh wrote:

      > /src/docs/user/troubleshooting.txt, line 2

      > <https://reviews.apache.org/r/1541/diff/2/?file=32968#file32968line2>

      >

      > copyright date?

      >

      > Seems like HBase puts this at the top above the license but hadoop does not. Not sure which is prescribed.

      >

      > * Copyright 2010 The Apache Software Foundation

      I would rather leave it to SQOOP-310 to resolve this uniformly across the codebase.

      • Arvind

      -----------------------------------------------------------
      This is an automatically generated e-mail. To reply, visit:
      https://reviews.apache.org/r/1541/#review1488
      -----------------------------------------------------------

      On 2011-08-17 03:00:00, Arvind Prabhakar wrote:

      -----------------------------------------------------------

      This is an automatically generated e-mail. To reply, visit:

      https://reviews.apache.org/r/1541/

      -----------------------------------------------------------

      (Updated 2011-08-17 03:00:00)

      Review request for Sqoop and Ahmed Radwan.

      Summary

      -------

      Added a troubleshooting section.

      This addresses bug SQOOP-316.

      https://issues.apache.org/jira/browse/SQOOP-316

      Diffs

      -----

      /src/docs/user/SqoopUserGuide.txt 1158375

      /src/docs/user/troubleshooting.txt PRE-CREATION

      Diff: https://reviews.apache.org/r/1541/diff

      Testing

      -------

      Built documentation and checked to see that the new section shows up correctly.

      Thanks,

      Arvind

      Show
      jiraposter@reviews.apache.org added a comment - On 2011-08-17 04:10:58, jmhsieh wrote: > lgtm. I > > Do you think this should this go in the wiki or in the formal docs? (I lean towards wiki personally, but not sure why). Personally, I feel that the wiki should host an FAQ style document. This on the other hand falls in the category of standard procedure for troubleshooting. On 2011-08-17 04:10:58, jmhsieh wrote: > /src/docs/user/troubleshooting.txt, line 2 > < https://reviews.apache.org/r/1541/diff/2/?file=32968#file32968line2 > > > copyright date? > > Seems like HBase puts this at the top above the license but hadoop does not. Not sure which is prescribed. > > * Copyright 2010 The Apache Software Foundation I would rather leave it to SQOOP-310 to resolve this uniformly across the codebase. Arvind ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/1541/#review1488 ----------------------------------------------------------- On 2011-08-17 03:00:00, Arvind Prabhakar wrote: ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/1541/ ----------------------------------------------------------- (Updated 2011-08-17 03:00:00) Review request for Sqoop and Ahmed Radwan. Summary ------- Added a troubleshooting section. This addresses bug SQOOP-316 . https://issues.apache.org/jira/browse/SQOOP-316 Diffs ----- /src/docs/user/SqoopUserGuide.txt 1158375 /src/docs/user/troubleshooting.txt PRE-CREATION Diff: https://reviews.apache.org/r/1541/diff Testing ------- Built documentation and checked to see that the new section shows up correctly. Thanks, Arvind
      Hide
      jiraposter@reviews.apache.org added a comment -

      -----------------------------------------------------------
      This is an automatically generated e-mail. To reply, visit:
      https://reviews.apache.org/r/1541/#review1491
      -----------------------------------------------------------

      Ship it!

      Looks good. Thanks Arvind!
      Minor comments below.

      /src/docs/user/troubleshooting.txt
      <https://reviews.apache.org/r/1541/#comment3411>

      "Make sure that the necessary input files or input/output tables are present and can be accessed by ... ".

      Just to take into account the export output tables too.

      /src/docs/user/troubleshooting.txt
      <https://reviews.apache.org/r/1541/#comment3412>

      "... For example an import that creates and populates ..."

      /src/docs/user/troubleshooting.txt
      <https://reviews.apache.org/r/1541/#comment3413>

      "... and the second to create and populate a Hive table ..."

      /src/docs/user/troubleshooting.txt
      <https://reviews.apache.org/r/1541/#comment3414>

      "... or during the creation and population of ..."

      • Ahmed

      On 2011-08-17 03:00:00, Arvind Prabhakar wrote:

      -----------------------------------------------------------

      This is an automatically generated e-mail. To reply, visit:

      https://reviews.apache.org/r/1541/

      -----------------------------------------------------------

      (Updated 2011-08-17 03:00:00)

      Review request for Sqoop and Ahmed Radwan.

      Summary

      -------

      Added a troubleshooting section.

      This addresses bug SQOOP-316.

      https://issues.apache.org/jira/browse/SQOOP-316

      Diffs

      -----

      /src/docs/user/SqoopUserGuide.txt 1158375

      /src/docs/user/troubleshooting.txt PRE-CREATION

      Diff: https://reviews.apache.org/r/1541/diff

      Testing

      -------

      Built documentation and checked to see that the new section shows up correctly.

      Thanks,

      Arvind

      Show
      jiraposter@reviews.apache.org added a comment - ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/1541/#review1491 ----------------------------------------------------------- Ship it! Looks good. Thanks Arvind! Minor comments below. /src/docs/user/troubleshooting.txt < https://reviews.apache.org/r/1541/#comment3411 > "Make sure that the necessary input files or input/output tables are present and can be accessed by ... ". Just to take into account the export output tables too. /src/docs/user/troubleshooting.txt < https://reviews.apache.org/r/1541/#comment3412 > "... For example an import that creates and populates ..." /src/docs/user/troubleshooting.txt < https://reviews.apache.org/r/1541/#comment3413 > "... and the second to create and populate a Hive table ..." /src/docs/user/troubleshooting.txt < https://reviews.apache.org/r/1541/#comment3414 > "... or during the creation and population of ..." Ahmed On 2011-08-17 03:00:00, Arvind Prabhakar wrote: ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/1541/ ----------------------------------------------------------- (Updated 2011-08-17 03:00:00) Review request for Sqoop and Ahmed Radwan. Summary ------- Added a troubleshooting section. This addresses bug SQOOP-316 . https://issues.apache.org/jira/browse/SQOOP-316 Diffs ----- /src/docs/user/SqoopUserGuide.txt 1158375 /src/docs/user/troubleshooting.txt PRE-CREATION Diff: https://reviews.apache.org/r/1541/diff Testing ------- Built documentation and checked to see that the new section shows up correctly. Thanks, Arvind
      Hide
      jiraposter@reviews.apache.org added a comment -

      -----------------------------------------------------------
      This is an automatically generated e-mail. To reply, visit:
      https://reviews.apache.org/r/1541/#review1488
      -----------------------------------------------------------

      Ship it!

      lgtm. I

      Do you think this should this go in the wiki or in the formal docs? (I lean towards wiki personally, but not sure why).

      /src/docs/user/troubleshooting.txt
      <https://reviews.apache.org/r/1541/#comment3400>

      copyright date?

      Seems like HBase puts this at the top above the license but hadoop does not. Not sure which is prescribed.

      • Copyright 2010 The Apache Software Foundation
      • jmhsieh

      On 2011-08-17 03:00:00, Arvind Prabhakar wrote:

      -----------------------------------------------------------

      This is an automatically generated e-mail. To reply, visit:

      https://reviews.apache.org/r/1541/

      -----------------------------------------------------------

      (Updated 2011-08-17 03:00:00)

      Review request for Sqoop and Ahmed Radwan.

      Summary

      -------

      Added a troubleshooting section.

      This addresses bug SQOOP-316.

      https://issues.apache.org/jira/browse/SQOOP-316

      Diffs

      -----

      /src/docs/user/SqoopUserGuide.txt 1158375

      /src/docs/user/troubleshooting.txt PRE-CREATION

      Diff: https://reviews.apache.org/r/1541/diff

      Testing

      -------

      Built documentation and checked to see that the new section shows up correctly.

      Thanks,

      Arvind

      Show
      jiraposter@reviews.apache.org added a comment - ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/1541/#review1488 ----------------------------------------------------------- Ship it! lgtm. I Do you think this should this go in the wiki or in the formal docs? (I lean towards wiki personally, but not sure why). /src/docs/user/troubleshooting.txt < https://reviews.apache.org/r/1541/#comment3400 > copyright date? Seems like HBase puts this at the top above the license but hadoop does not. Not sure which is prescribed. Copyright 2010 The Apache Software Foundation jmhsieh On 2011-08-17 03:00:00, Arvind Prabhakar wrote: ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/1541/ ----------------------------------------------------------- (Updated 2011-08-17 03:00:00) Review request for Sqoop and Ahmed Radwan. Summary ------- Added a troubleshooting section. This addresses bug SQOOP-316 . https://issues.apache.org/jira/browse/SQOOP-316 Diffs ----- /src/docs/user/SqoopUserGuide.txt 1158375 /src/docs/user/troubleshooting.txt PRE-CREATION Diff: https://reviews.apache.org/r/1541/diff Testing ------- Built documentation and checked to see that the new section shows up correctly. Thanks, Arvind
      Hide
      Arvind Prabhakar added a comment -

      Updated the patch to remove some trailing whitespaces.

      Show
      Arvind Prabhakar added a comment - Updated the patch to remove some trailing whitespaces.
      Hide
      jiraposter@reviews.apache.org added a comment -

      -----------------------------------------------------------
      This is an automatically generated e-mail. To reply, visit:
      https://reviews.apache.org/r/1541/
      -----------------------------------------------------------

      Review request for Sqoop and Ahmed Radwan.

      Summary
      -------

      Added a troubleshooting section.

      This addresses bug SQOOP-316.
      https://issues.apache.org/jira/browse/SQOOP-316

      Diffs


      /src/docs/user/SqoopUserGuide.txt 1158375
      /src/docs/user/troubleshooting.txt PRE-CREATION

      Diff: https://reviews.apache.org/r/1541/diff

      Testing
      -------

      Built documentation and checked to see that the new section shows up correctly.

      Thanks,

      Arvind

      Show
      jiraposter@reviews.apache.org added a comment - ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/1541/ ----------------------------------------------------------- Review request for Sqoop and Ahmed Radwan. Summary ------- Added a troubleshooting section. This addresses bug SQOOP-316 . https://issues.apache.org/jira/browse/SQOOP-316 Diffs /src/docs/user/SqoopUserGuide.txt 1158375 /src/docs/user/troubleshooting.txt PRE-CREATION Diff: https://reviews.apache.org/r/1541/diff Testing ------- Built documentation and checked to see that the new section shows up correctly. Thanks, Arvind
      Arvind Prabhakar made changes -
      Attachment SQOOP-316-1.patch [ 12490596 ]
      Arvind Prabhakar made changes -
      Status Open [ 1 ] Patch Available [ 10002 ]
      Fix Version/s 1.4.0 [ 12317345 ]
      Arvind Prabhakar made changes -
      Field Original Value New Value
      Attachment SQOOP-316.patch [ 12490595 ]
      Hide
      Arvind Prabhakar added a comment -

      Added a section in the user guide for troubleshooting.

      Show
      Arvind Prabhakar added a comment - Added a section in the user guide for troubleshooting.
      Arvind Prabhakar created issue -

        People

        • Assignee:
          Arvind Prabhakar
          Reporter:
          Arvind Prabhakar
        • Votes:
          0 Vote for this issue
          Watchers:
          0 Start watching this issue

          Dates

          • Created:
            Updated:
            Resolved:

            Development