Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-198

parquet-cascading Add Parquet Avro Scheme

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.6.0
    • Fix Version/s: 1.6.0
    • Component/s: parquet-mr
    • Labels:
      None

      Description

      At the moment using parquet-cascading writing Parquet files when using Avro as the object format is not possible as a Schema is not yet provided.

      As part of this ticket, a ParquetAvroScheme will be introduced, and also a local.ParquetAvroScheme , so that from Cascading / Scalding developers can read / write and test in both --hdfs and --local mode Parquet-Avro files.

        Attachments

          Activity

            People

            • Assignee:
              antwnis Antonios Chalkiopoulos
              Reporter:
              antwnis Antonios Chalkiopoulos
            • Votes:
              2 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated: