Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7984

AccumuloOutputFormat Configuration items from StorageHandler not re-set in Configuration in Tez

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.14.0
    • StorageHandler, Tez
    • None

    Description

      Ran AccumuloStorageHandler queries with Tez and found that configuration elements that are pulled from the -hiveconf and passed to the inputJobProperties or outputJobProperties by the AccumuloStorageHandler aren't available inside of the Tez container.

      I'm guessing that there is a disconnect from the configuration that the StorageHandler creates and what the Tez container sees.

      The HBaseStorageHandler likely doesn't run into this because it expects to have hbase-site.xml available via tmpjars (and can extrapolate connection information from that file). Accumulo's site configuration file is not meant to be shared with consumers which means that this exact approach is not sufficient.

      Attachments

        1. HIVE-7984.1.patch
          4 kB
          Gunther Hagleitner
        2. HIVE-7984-1.diff
          4 kB
          Josh Elser
        3. HIVE-7984-1.patch
          4 kB
          Josh Elser

        Activity

          People

            elserj Josh Elser
            elserj Josh Elser
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: