Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-2907

Export parquet files to RDBMS: don't require .metadata for parquet files

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: 1.4.6
    • Fix Version/s: None
    • Component/s: metastore
    • Labels:
    • Environment:

      sqoop 1.4.6
      export parquet files to Oracle

      Description

      Kite currently requires .metadata.
      Parquet files have their own metadata stored along data files.
      It would be great for Export operation on parquet files to RDBMS not to require .metadata.
      We have most of the files created by Spark and Hive, and they don't create .metadata, it only Kite that does.
      It makes sqoop export of parquet files usability very limited.

        Attachments

        1. SQOOP-2907-3.patch
          13 kB
          Zac Zhou
        2. SQOOP-2907.patch2
          13 kB
          Zac Zhou
        3. SQOOP-2907.patch1
          12 kB
          Zac Zhou
        4. SQOOP-2907.patch
          21 kB
          ChenKai

          Issue Links

            Activity

              People

              • Assignee:
                sanysandish@gmail.com Sandish Kumar HN
                Reporter:
                Tagar Ruslan Dautkhanov
              • Votes:
                3 Vote for this issue
                Watchers:
                11 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: