Uploaded image for project: 'Hivemall'
  1. Hivemall
  2. HIVEMALL-88

Support a function to flatten a nested schema

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.5.0
    • Labels:

      Description

      Since parquet is first-citizen in Spark, most of users use nested schemas in DF. In some usecases, they need to flatten nested schemas into flat ones to dump data into the other systems that do not support nested schemas, e.g., RDBMS. So, it is useful to support conversion function from nested schemas to flat ones.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                maropu Takeshi Yamamuro
                Reporter:
                maropu Takeshi Yamamuro
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: