Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-3068

Rename deprecated parameter for HDFS block size in HiveColumnCardinalityJob

    XMLWordPrintableJSON

Details

    • Task
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • v2.2.0
    • v2.3.0
    • Job Engine
    • None
    • HDP 2.5.3, Kylin 2.2.0

    Description

      While setting MR job configuration HiveColumnCardinalityJob.java uses deprecated parameter name for HDFS block size.
      Since Hadoop 2.5 (at least) recommended parameter name is dfs.blocksize, while the existing code (2.2.0 and earlier) uses dfs.block.size (please refer to the list of Hadoop deprecated parameters - http://hadoop.apache.org/docs/r2.7.3/hadoop-project-dist/hadoop-common/DeprecatedProperties.html)

      Attachments

        1. KYLIN-3068.master.001.patch
          1 kB
          Vsevolod Ostapenko

        Activity

          People

            seva_ostapenko Vsevolod Ostapenko
            seva_ostapenko Vsevolod Ostapenko
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 24h
                24h
                Remaining:
                Remaining Estimate - 24h
                24h
                Logged:
                Time Spent - Not Specified
                Not Specified