Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-833

Storage access layer

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.4.0
    • None
    • None

    Description

      A layer is needed to provide a high level data access abstraction and a tabular view of data in Hadoop, and could free Pig users from implementing their own data storage/retrieval code. This layer should also include a columnar storage format in order to provide fast data projection, CPU/space-efficient data serialization, and a schema language to manage physical storage metadata. Eventually it could also support predicate pushdown for further performance improvement. Initially, this layer could be a contrib project in Pig and become a hadoop subproject later on.

      Attachments

        1. hadoop20.jar.bz2
          9.76 MB
          Raghu Angadi
        2. PIG-833-zebra.patch
          1.12 MB
          Raghu Angadi
        3. zebra-javadoc.tgz
          85 kB
          Raghu Angadi
        4. PIG-833-zebra.patch.bz2
          110 kB
          Raghu Angadi
        5. PIG-833-zebra.patch.bz2
          110 kB
          Raghu Angadi
        6. test.out
          14 kB
          Alan Gates
        7. TEST-org.apache.hadoop.zebra.pig.TestCheckin1.txt
          2 kB
          Alan Gates

        Issue Links

          is duplicated by

          New Feature - A new feature of the product, which has yet to be developed. PIG-210 Column store

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              rangadi Raghu Angadi
              jaytang Jay Tang
              Votes:
              0 Vote for this issue
              Watchers:
              20 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: