Uploaded image for project: 'Apache Hop (incubating)'
  1. Apache Hop (incubating)
  2. HOP-2476

Support for Objects and Array data types

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      As a developer I come across objects and arrays stored as part of a record fairly regularly. I'd like Hop to natively support them with dedicated data types so that extracting values becomes easier (no need to use any scripting or coding).

      In example, similarly to Trifacta, Hop could offer easy to use functions like these ones then:

      1) "Flatten array values into new rows":
      [\{"type":"primary","colour":"green","product_number":3899},\{"type":"secondary","colour":"red","product_number":3899}]

      returns two rows:

      {"type":"primary","colour":"green","product_number":3899} {"type":"secondary","colour":"red","product_number":3899}

      2) "Unnest values into new columns". The unnest transformation takes a nested key-value pair in the object and extracts it to a new column. e.g. unnest product_number:{"type":"secondary","colour":"red","product_number":3899} => 3899

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            diethard.steiner Diethard Steiner
            Votes:
            1 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: