Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3445

Make Parquet format available out of the box in Pig

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.12.0
    • None
    • None

    Description

      We would add the Parquet jar in the Pig packages to make it available out of the box to pig users.
      On top of that we could add the parquet.pig package to the list of packages to search for UDFs. (alternatively, the parquet jar could contain classes name or.apache.pig.builtin.ParquetLoader and ParquetStorer)
      This way users can use Parquet simply by typing:
      A = LOAD 'foo' USING ParquetLoader();
      STORE A INTO 'bar' USING ParquetStorer();

      Attachments

        1. PIG-3445.patch
          4 kB
          Lorand Bendig
        2. PIG-3445-2.patch
          13 kB
          Lorand Bendig
        3. PIG-3445-3.patch
          28 kB
          Lorand Bendig
        4. PIG-3445-4.patch
          28 kB
          Lorand Bendig
        5. PIG-3445-5.patch
          27 kB
          Lorand Bendig

        Activity

          People

            lbendig Lorand Bendig
            julienledem Julien Le Dem
            Votes:
            0 Vote for this issue
            Watchers:
            14 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: