Details

    • Type: New Feature New Feature
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      In the last 18 month PigLatin has gained significant popularity within the open source community. Many users like its data flow model, its rich type system and its ability to work with any data available on HDFS or outside. We have also heard from many users that having Pig speak SQL would bring many more users. Having a single system that exports multiple interfaces is a big advantage as it guarantees consistent semantics, custom code reuse, and reduces the amount of maintenance. This is especially relevant for project where using both interfaces for different parts of the system is relevant. For instance, in a
      data warehousing system, you would have ETL component that brings data into the warehouse and a component that analyzes the data and produces reports. PigLatin is uniquely suited for ETL processing while SQL might be a better fit for report generation.

      To start, it would make sense to implement a subset of SQL92 standard and to be as much as possible standard compliant. This would include all the standard constructs: select, from, where, group-by + having, order by, limit, join (inner + outer). Several extensions such as support for pig's UDFs and possibly streaming, multiquery and support for pig's complex types would be helpful.

      This work is dependent on metadata support outlined in https://issues.apache.org/jira/browse/PIG-823

      1. students2.bin
        0.2 kB
        Thejas M Nair
      2. students_attr.bin
        0.6 kB
        Thejas M Nair
      3. SQL_IN_PIG.html
        3 kB
        Thejas M Nair
      4. pigsql.patch
        1.42 MB
        Thejas M Nair
      5. pigsql_tutorial.txt
        5 kB
        Thejas M Nair
      6. PIG-824.binfiles.tar.gz
        2.30 MB
        Thejas M Nair
      7. PIG-824.1.patch
        664 kB
        Thejas M Nair
      8. pig_sql_beta.pdf
        86 kB
        Thejas M Nair
      9. java-cup-11a-runtime.jar
        13 kB
        Thejas M Nair
      10. java-cup-11a.jar
        94 kB
        Thejas M Nair

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Thejas M Nair
            Reporter:
            Olga Natkovich
          • Votes:
            0 Vote for this issue
            Watchers:
            30 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development