Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-2889

HBaseAvroStorage UDF

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.11
    • None
    • data, piggybank
    • None

    Description

      I want to use HBaseStorage without specifying the schema. Storing data in Avro format in HBase is a very common practice. I would like to create a UDF, HBaseAvroStorage that works just like the internal HBaseStorage UDF, but loads the Avro schema metadata so that specifying a schema is unnecessary.

      I haven't thought through all the particulars, so if you have - please chime in

      I am also not sure if this isn't sort of handled some place in HCatalog?

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            russell.jurney Russell Jurney
            russell.jurney Russell Jurney

            Dates

              Created:
              Updated:

              Slack

                Issue deployment