Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-9554

Expose complex type interface through UDFs

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Backend, Frontend
    • Labels:

      Description

      Once there is a better understanding of how complex types could be added to builtin functions then we can expose the complex type support through UDFs by allowing complex types as parameters or as return values.
      The reason this should come as a second step is that once we have exposed these UDF changes we have to keep backward compatibility in the following releases so there won’t be much room to adjust.
      What brings some complexity is that CollectionVal uses Impala’s internal tuple representation and it is not trivial to expose through UDFs. There might be 2 ways:

      1. Expose helper functions to extract tuples, fields, etc.
      2. For UDFs use a different representation than tuples and translate them to the internal representation when a UDF is called.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              gaborkaszab Gabor Kaszab
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: