Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-674

Sqoop should allow a "where" clause to avoid having to export entire tables

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Sqoop currently only exports at the granularity of a table. This doesn't work well on systems with large tables, where the overhead of performing a full dump each time is significant. Allowing the user to specify a where clause is a relatively simple task which will give Sqoop a lot more flexibility.

      1. HADOOP-6115.patch
        13 kB
        Kevin Weil
      2. MAPREDUCE-674.patch
        13 kB
        Kevin Weil

        Activity

        Kevin Weil created issue -
        Kevin Weil made changes -
        Field Original Value New Value
        Summary Sqoop should allow a where clause in its export statements Sqoop should allow a "where" clause to avoid having to export entire tables
        Kevin Weil made changes -
        Attachment HADOOP-6115.patch [ 12412042 ]
        Kevin Weil made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Chris Douglas made changes -
        Project Hadoop Common [ 12310240 ] Hadoop Map/Reduce [ 12310941 ]
        Key HADOOP-6115 MAPREDUCE-674
        Affects Version/s 0.21.0 [ 12313563 ]
        Component/s contrib/sqoop [ 12312930 ]
        Component/s contrib/sqoop [ 12312884 ]
        Kevin Weil made changes -
        Attachment MAPREDUCE-674.patch [ 12412131 ]
        Kevin Weil made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Kevin Weil made changes -
        Affects Version/s 0.21.0 [ 12314045 ]
        Status Open [ 1 ] Patch Available [ 10002 ]
        Aaron Kimball made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Aaron Kimball made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Tom White made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Assignee Kevin Weil [ kevinweil ]
        Resolution Fixed [ 1 ]
        Tom White made changes -
        Fix Version/s 0.21.0 [ 12314045 ]
        Affects Version/s 0.21.0 [ 12314045 ]
        Tom White made changes -
        Fix Version/s 0.21.0 [ 12314045 ]
        Chris Douglas made changes -
        Component/s contrib/sqoop [ 12312930 ]

          People

          • Assignee:
            Kevin Weil
            Reporter:
            Kevin Weil
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development