Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-1936

Introduce a optional property for conditional upsert

    XMLWordPrintableJSON

Details

    Description

      If anyone wants to use custom upsert logic then they have to override the Latest avro payload class which is only possible in java or scala . 

      Python developers have no such option . 

      Will be introducing a new payload class and a new key which can work in java , scala and python 

      This class will be responsible for custom upsert logic and a new key hoodie.update.key which will accept the columns which only need to be updated 

       

      "hoodie.update.keys": "admission_date,name",  #comma seperated key 
      "hoodie.datasource.write.payload.class": "com.hudiUpsert.hudiCustomUpsert" #custom upsert key 

       

      so this will only update the column admission_date and name in the target table 

       

       

      Attachments

        Issue Links

          Activity

            People

              Biswajit11 Biswajit mohapatra
              Biswajit11 Biswajit mohapatra
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: