Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-26881

tblproperties are not cleaned from jobConf for TezTask

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.1.3
    • None
    • Hive
    • None

    Description

      Users uses xmlserde to read xml files, when user create table they specify tblproperties and it uses jobConf 

      https://github.com/VenkataNU/hivexmlserde/blob/main/src/main/java/com/ibm/spss/hive/serde2/xml/XmlInputFormat.java#L72

      in Tez mode, after 1st query run, those tblproperties are part of Driver.conf, so then next query runs, the jobConf of the tez job contains the tblproperties from last run. This is cause wrong results since the next query should not use last query's tblproperties.

      Attachments

        Activity

          People

            Unassigned Unassigned
            yigress Yi Zhang
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: