Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-2402

Hive Sync supports Kerberos authentication

    XMLWordPrintableJSON

Details

    Description

      For Hive with Kerberos enabled, THE HMS of HUDI cannot access the Hive metadata
      Hive.get(configuration).getMSC()
      Methods before
      Perform Kerberos authentication on the Flink client
      Set the parameters for enabling Kerberos authentication and the configuration parameters for transmitting hive Principal to Hive
      I added two parameters
      1.hive_sync.use_kerberos
      2.hive_sync.kerberos_principal
      Use the following method to enable Hive Kerberos access control
      CREATE TABLE t2(
      Uuid VARCHAR (20),
      The name VARCHAR (10),
      The age INT,
      Ts TIMESTAMP (3),
      ` partition ` VARCHAR (20)
      )
      PARTITIONED BY (`partition`)
      with(
      'connector' = 'hudi',
      'hive_sync.enable'='true',
      'hive_sync.db'='test',
      'hive_sync.table'='t2',
      'hive_sync.mode'='hms',
      'path' = 'hdfs://ip:8020/warehouse/hudi/t2',
      'hive_sync.metastore.uris'='thrift://ip:9083',
      'hive_sync.use_kerberos' = 'true',
      'hive_sync.kerberos_principal' = 'hive/_HOST@BIGDATA'
      )

      Attachments

        Activity

          People

            Unassigned Unassigned
            王晓宇 王晓宇
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 3h
                3h
                Remaining:
                Remaining Estimate - 3h
                3h
                Logged:
                Time Spent - Not Specified
                Not Specified