Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.7.2
    • Component/s: java, spec
    • Labels:
      None

      Description

      Define a column-major file format. This would permit better compression and also permit efficient skipping of fields that are not of interest.

      1. AVRO-806.patch
        31 kB
        Doug Cutting
      2. AVRO-806-v2.patch
        75 kB
        Thiruvalluvan M. G.
      3. avro-file-columnar.pdf
        61 kB
        Thiruvalluvan M. G.
      4. AVRO-806.patch
        239 kB
        Doug Cutting

        Issue Links

          Activity

          Doug Cutting created issue -
          Doug Cutting made changes -
          Field Original Value New Value
          Assignee Doug Cutting [ cutting ]
          Doug Cutting made changes -
          Attachment AVRO-806.patch [ 12477176 ]
          Thiruvalluvan M. G. made changes -
          Attachment AVRO-806-v2.patch [ 12482810 ]
          Attachment avro-file-columnar.pdf [ 12482811 ]
          Jeff Hammerbacher made changes -
          Link This issue is related to HIVE-352 [ HIVE-352 ]
          Jeff Hammerbacher made changes -
          Link This issue is related to HIVE-756 [ HIVE-756 ]
          Doug Cutting made changes -
          Fix Version/s 1.6.0 [ 12316198 ]
          Doug Cutting made changes -
          Fix Version/s 1.7.0 [ 12318848 ]
          Fix Version/s 1.6.0 [ 12316198 ]
          Doug Cutting made changes -
          Fix Version/s 1.7.0 [ 12318848 ]
          Doug Cutting made changes -
          Attachment AVRO-806.patch [ 12543933 ]
          Doug Cutting made changes -
          Summary add a column-major codec for data files add a column-major file format
          Description Define a codec that, when a data file's schema is a record schema, writes blocks within the file in column-major order. This would permit better compression and also permit efficient skipping of fields that are not of interest. Define a column-major file format. This would permit better compression and also permit efficient skipping of fields that are not of interest.
          Doug Cutting made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Fix Version/s 1.7.2 [ 12322476 ]
          Resolution Fixed [ 1 ]
          Doug Cutting made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Russell Jurney made changes -
          Link This issue is related too HIVE-3585 [ HIVE-3585 ]
          Russell Jurney made changes -
          Link This issue relates to PIG-3015 [ PIG-3015 ]
          Russell Jurney made changes -
          Link This issue relates to PIG-3059 [ PIG-3059 ]
          Gavin made changes -
          Link This issue is related to HIVE-3585 [ HIVE-3585 ]
          Gavin made changes -
          Link This issue is related to HIVE-3585 [ HIVE-3585 ]

            People

            • Assignee:
              Doug Cutting
              Reporter:
              Doug Cutting
            • Votes:
              6 Vote for this issue
              Watchers:
              33 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development