Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-8518

Investigate support for insert events from SparkSQL

    XMLWordPrintableJSON

Details

    • Task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • Impala 3.2.0
    • Impala 4.1.0
    • Frontend
    • None

    Description

      Hive can issue insert events when data is inserted into tables and partitions. These events are used to update Impala's catalog to refresh the file metadata information for such tables and partitions. We should investigate if we can do something similar for Spark so that ETL jobs run using spark can also be supported.

      Attachments

        Issue Links

          is fixed by

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-27173 Add method for Spark to be able to trigger DML events

          • Major - Major loss of function.
          • Closed

          Activity

            People

              hemanth619 Sai Hemanth Gantasala
              bharos92 Bharath Krishna
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: