Pig
  1. Pig
  2. PIG-3445

Make Parquet format available out of the box in Pig

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.12.0
    • Component/s: None
    • Labels:
      None

      Description

      We would add the Parquet jar in the Pig packages to make it available out of the box to pig users.
      On top of that we could add the parquet.pig package to the list of packages to search for UDFs. (alternatively, the parquet jar could contain classes name or.apache.pig.builtin.ParquetLoader and ParquetStorer)
      This way users can use Parquet simply by typing:
      A = LOAD 'foo' USING ParquetLoader();
      STORE A INTO 'bar' USING ParquetStorer();

      1. PIG-3445-5.patch
        27 kB
        Lorand Bendig
      2. PIG-3445-4.patch
        28 kB
        Lorand Bendig
      3. PIG-3445-3.patch
        28 kB
        Lorand Bendig
      4. PIG-3445-2.patch
        13 kB
        Lorand Bendig
      5. PIG-3445.patch
        4 kB
        Lorand Bendig

        Activity

        Julien Le Dem created issue -
        Lorand Bendig made changes -
        Field Original Value New Value
        Attachment PIG-3445.patch [ 12602062 ]
        Dmitriy V. Ryaboy made changes -
        Fix Version/s 0.12 [ 12323380 ]
        Lorand Bendig made changes -
        Attachment PIG-3445-2.patch [ 12606203 ]
        Lorand Bendig made changes -
        Attachment PIG-3445-3.patch [ 12606375 ]
        Lorand Bendig made changes -
        Attachment PIG-3445-4.patch [ 12606549 ]
        Lorand Bendig made changes -
        Assignee Lorand Bendig [ lbendig ]
        Lorand Bendig made changes -
        Attachment PIG-3445-5.patch [ 12606886 ]
        Aniket Mokashi made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Daniel Dai made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Lorand Bendig
            Reporter:
            Julien Le Dem
          • Votes:
            0 Vote for this issue
            Watchers:
            14 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development