Uploaded image for project: 'Tajo (Retired)'
  1. Tajo (Retired)
  2. TAJO-1578

User configuration for pull server port is ignored.

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.12.0, 0.11.1
    • None

    Description

      See the title.
      When TajoPullServerService is initialized, it overwrites user-configured pull server port with the default value as follows.

      ...
      @Override
        public void init(Configuration conf) {
          try {
            manageOsCache = conf.getBoolean(SHUFFLE_MANAGE_OS_CACHE,
                DEFAULT_SHUFFLE_MANAGE_OS_CACHE);
      
            readaheadLength = conf.getInt(SHUFFLE_READAHEAD_BYTES,
                DEFAULT_SHUFFLE_READAHEAD_BYTES);
      
            int workerNum = conf.getInt("tajo.shuffle.rpc.server.worker-thread-num",
                Runtime.getRuntime().availableProcessors() * 2);
      
            selector = RpcChannelFactory.createServerChannelFactory("TajoPullServerService", workerNum)
                         .option(ChannelOption.TCP_NODELAY, true)
                         .childOption(ChannelOption.ALLOCATOR, PooledByteBufAllocator.DEFAULT)
                         .childOption(ChannelOption.TCP_NODELAY, true);
      
            localFS = new LocalFileSystem();
      
            conf.setInt(TajoConf.ConfVars.PULLSERVER_PORT.varname
                , TajoConf.ConfVars.PULLSERVER_PORT.defaultIntVal);
            super.init(conf);
            LOG.info("Tajo PullServer initialized: readaheadLength=" + readaheadLength);
          } catch (Throwable t) {
            LOG.error(t, t);
          }
        }
      ...
      

      Attachments

        Activity

          People

            dkhwangbo Dongkyu Hwangbo
            jihoonson Jihoon Son
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment