Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-8518

Investigate support for insert events from SparkSQL

    XMLWordPrintableJSON

    Details

    • Type: Task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: Impala 3.2.0
    • Fix Version/s: None
    • Component/s: Frontend
    • Labels:
      None
    • Epic Color:
      ghx-label-8

      Description

      Hive can issue insert events when data is inserted into tables and partitions. These events are used to update Impala's catalog to refresh the file metadata information for such tables and partitions. We should investigate if we can do something similar for Spark so that ETL jobs run using spark can also be supported.

        Attachments

          Activity

            People

            • Assignee:
              bharos92 Bharath Krishna
              Reporter:
              bharos92 Bharath Krishna
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: