Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-1578

User configuration for pull server port is ignored.

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.12.0, 0.11.1
    • Component/s: None
    • Labels:

      Description

      See the title.
      When TajoPullServerService is initialized, it overwrites user-configured pull server port with the default value as follows.

      ...
      @Override
        public void init(Configuration conf) {
          try {
            manageOsCache = conf.getBoolean(SHUFFLE_MANAGE_OS_CACHE,
                DEFAULT_SHUFFLE_MANAGE_OS_CACHE);
      
            readaheadLength = conf.getInt(SHUFFLE_READAHEAD_BYTES,
                DEFAULT_SHUFFLE_READAHEAD_BYTES);
      
            int workerNum = conf.getInt("tajo.shuffle.rpc.server.worker-thread-num",
                Runtime.getRuntime().availableProcessors() * 2);
      
            selector = RpcChannelFactory.createServerChannelFactory("TajoPullServerService", workerNum)
                         .option(ChannelOption.TCP_NODELAY, true)
                         .childOption(ChannelOption.ALLOCATOR, PooledByteBufAllocator.DEFAULT)
                         .childOption(ChannelOption.TCP_NODELAY, true);
      
            localFS = new LocalFileSystem();
      
            conf.setInt(TajoConf.ConfVars.PULLSERVER_PORT.varname
                , TajoConf.ConfVars.PULLSERVER_PORT.defaultIntVal);
            super.init(conf);
            LOG.info("Tajo PullServer initialized: readaheadLength=" + readaheadLength);
          } catch (Throwable t) {
            LOG.error(t, t);
          }
        }
      ...
      

        Attachments

          Activity

            People

            • Assignee:
              dkhwangbo Dongkyu Hwangbo
              Reporter:
              jihoonson Jihoon Son
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: