Details

    • Type: New Feature New Feature
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      In the last 18 month PigLatin has gained significant popularity within the open source community. Many users like its data flow model, its rich type system and its ability to work with any data available on HDFS or outside. We have also heard from many users that having Pig speak SQL would bring many more users. Having a single system that exports multiple interfaces is a big advantage as it guarantees consistent semantics, custom code reuse, and reduces the amount of maintenance. This is especially relevant for project where using both interfaces for different parts of the system is relevant. For instance, in a
      data warehousing system, you would have ETL component that brings data into the warehouse and a component that analyzes the data and produces reports. PigLatin is uniquely suited for ETL processing while SQL might be a better fit for report generation.

      To start, it would make sense to implement a subset of SQL92 standard and to be as much as possible standard compliant. This would include all the standard constructs: select, from, where, group-by + having, order by, limit, join (inner + outer). Several extensions such as support for pig's UDFs and possibly streaming, multiquery and support for pig's complex types would be helpful.

      This work is dependent on metadata support outlined in https://issues.apache.org/jira/browse/PIG-823

      1. PIG-824.binfiles.tar.gz
        2.30 MB
        Thejas M Nair
      2. PIG-824.1.patch
        664 kB
        Thejas M Nair
      3. SQL_IN_PIG.html
        3 kB
        Thejas M Nair
      4. pigsql.patch
        1.42 MB
        Thejas M Nair
      5. pig_sql_beta.pdf
        86 kB
        Thejas M Nair
      6. java-cup-11a-runtime.jar
        13 kB
        Thejas M Nair
      7. java-cup-11a.jar
        94 kB
        Thejas M Nair
      8. students2.bin
        0.2 kB
        Thejas M Nair
      9. students_attr.bin
        0.6 kB
        Thejas M Nair
      10. pigsql_tutorial.txt
        5 kB
        Thejas M Nair

        Activity

        Olga Natkovich created issue -
        Thejas M Nair made changes -
        Field Original Value New Value
        Attachment PIG-824.binfiles.tar.gz [ 12416642 ]
        Attachment PIG-824.1.patch [ 12416643 ]
        Attachment SQL_IN_PIG.html [ 12416644 ]
        Thejas M Nair made changes -
        Attachment pigsql.patch [ 12443638 ]
        Attachment pig_sql_beta.pdf [ 12443639 ]
        Attachment java-cup-11a-runtime.jar [ 12443640 ]
        Thejas M Nair made changes -
        Assignee Thejas M Nair [ thejas ]
        Thejas M Nair made changes -
        Attachment java-cup-11a.jar [ 12443641 ]
        Attachment students2.bin [ 12443642 ]
        Attachment students_attr.bin [ 12443643 ]
        Thejas M Nair made changes -
        Attachment pigsql_tutorial.txt [ 12443645 ]
        Alan Gates made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Won't Fix [ 2 ]

          People

          • Assignee:
            Thejas M Nair
            Reporter:
            Olga Natkovich
          • Votes:
            0 Vote for this issue
            Watchers:
            30 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development