Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3445

Make Parquet format available out of the box in Pig

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.12.0
    • None
    • None

    Description

      We would add the Parquet jar in the Pig packages to make it available out of the box to pig users.
      On top of that we could add the parquet.pig package to the list of packages to search for UDFs. (alternatively, the parquet jar could contain classes name or.apache.pig.builtin.ParquetLoader and ParquetStorer)
      This way users can use Parquet simply by typing:
      A = LOAD 'foo' USING ParquetLoader();
      STORE A INTO 'bar' USING ParquetStorer();

      Attachments

        1. PIG-3445-5.patch
          27 kB
          Lorand Bendig
        2. PIG-3445-4.patch
          28 kB
          Lorand Bendig
        3. PIG-3445-3.patch
          28 kB
          Lorand Bendig
        4. PIG-3445-2.patch
          13 kB
          Lorand Bendig
        5. PIG-3445.patch
          4 kB
          Lorand Bendig

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            lbendig Lorand Bendig
            julienledem Julien Le Dem
            Votes:
            0 Vote for this issue
            Watchers:
            14 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment