Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-11193

Rocksdb timer service factory configuration option is not settable per job

    XMLWordPrintableJSON

    Details

      Description

      set state backends is rocksdb 

      set 'state.backend.rocksdb.timer-service.factory' by  Configuration

      RocksDBStateBackend backend = new RocksDBStateBackend(checkpointPath,true);
      Configuration configuration = new Configuration();
      configuration.setString(
         RocksDBOptions.TIMER_SERVICE_FACTORY,
         RocksDBStateBackend.PriorityQueueStateType.ROCKSDB.toString());
      backend = backend.configure(configuration);
      

      then submit the job by client

      but  the job runtime the 'TIMER_SERVICE_FACTORY'  Covered  by jobmaster

      jobmaster code

      org.apache.flink.runtime.state.StateBackendLoader

      backend = ((ConfigurableStateBackend) fromApplication).configure(config);
      
      

      jobmaster  buildGraph  config is from flink-conf.yaml

      Final execution of the same method

      org.apache.flink.contrib.streaming.state.RocksDBStateBackend

      final String priorityQueueTypeString = config.getString(TIMER_SERVICE_FACTORY);
      
      this.priorityQueueStateType = priorityQueueTypeString.length() > 0 ?
         PriorityQueueStateType.valueOf(priorityQueueTypeString.toUpperCase()) : original.priorityQueueStateType;
      

      the problem is  config.getString(TIMER_SERVICE_FACTORY)   always have value regardless of configuration

      so my customize config is Covered by jobmaster

       

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                aitozi Aitozi
                Reporter:
                fanweiwen Fan weiwen
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 40m
                  40m