Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.4.6
    • Component/s: tools
    • Labels:
      None

      Description

      Add supports for different compression codecs

      1. SQOOP-1391.patch
        6 kB
        Qian Xu
      2. SQOOP-1391.3.patch
        6 kB
        Qian Xu
      3. SQOOP-1391.2.patch
        7 kB
        Qian Xu

        Issue Links

          Activity

          Qian Xu created issue -
          Qian Xu made changes -
          Field Original Value New Value
          Component/s tools [ 12315207 ]
          Qian Xu made changes -
          Summary Schema handling Compression codec handling
          Description Conceptually, each column from the database will be mapped to a corresponding column of Parquet file. We need to make sure if a corresponding data type mapping between the two sides is necessary. Add supports for different compression codecs
          Qian Xu made changes -
          Assignee Qian Xu [ stanleyxu2005 ]
          Qian Xu made changes -
          Comment [ Hi, thanks for the info. Great work. I'll create a patch using kite trunk asap.

          --徐骞 (Stanley Xu)
          Sent from my phone


          ]
          Qian Xu made changes -
          Status Open [ 1 ] In Progress [ 3 ]
          Qian Xu made changes -
          Attachment SQOOP-1391.patch [ 12666760 ]
          Qian Xu made changes -
          Remote Link This issue links to "Review at Reviewboard (Web Link)" [ 18200 ]
          Qian Xu made changes -
          Status In Progress [ 3 ] Patch Available [ 10002 ]
          Qian Xu made changes -
          Attachment SQOOP-1391.2.patch [ 12667345 ]
          Qian Xu made changes -
          Parent SQOOP-1366 [ 12726247 ]
          Issue Type Sub-task [ 7 ] Improvement [ 4 ]
          Qian Xu made changes -
          Comment [ I've submitted a patch for the compression codec support. Now it supports snappy (default) and deflate. Note that it requires Kite 0.17.0. If someone wants to use it right now, I recommend compile Kite using the revison refer to CDK-299 and apply patch for CDK-654. ]
          Qian Xu made changes -
          Attachment SQOOP-1391.2.patch [ 12667345 ]
          Qian Xu made changes -
          Attachment SQOOP-1391.patch [ 12666760 ]
          Qian Xu made changes -
          Remote Link This issue links to "Review at Reviewboard (Web Link)" [ 18200 ]
          Qian Xu made changes -
          Attachment SQOOP-1391.patch [ 12674789 ]
          Qian Xu made changes -
          Remote Link This issue links to "Review Link (Web Link)" [ 19278 ]
          Qian Xu made changes -
          Attachment SQOOP-1391.2.patch [ 12677229 ]
          Qian Xu made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Qian Xu made changes -
          Link This issue is blocked by SQOOP-1693 [ SQOOP-1693 ]
          Qian Xu made changes -
          Attachment SQOOP-1391.3.patch [ 12680538 ]
          Jarek Jarcec Cecho made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Fix Version/s 1.4.6 [ 12327469 ]
          Resolution Fixed [ 1 ]
          Qian Xu made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Qian Xu
              Reporter:
              Qian Xu
            • Votes:
              1 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development