Uploaded image for project: 'Phoenix'
  1. Phoenix
  2. PHOENIX-3113

Automatic build of async index will happen even if mapreduce.framework.name is not set in any configuration

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • None
    • 4.8.0
    • None
    • None

    Description

      As per below code, we are starting automatic build of async index even if mapreduce.framework.name is not set in any of the configuration(because conf.get(QueryServices.MAPRED_FRAMEWORK_NAME) will always return LOCAL as a default value).
      This may cause problem in the hbase cluster where mapreduce is not deployed or this configuration is not set or included in the classpath.

      String hbaseClusterDistributedMode = conf.get(QueryServices.HBASE_CLUSTER_DISTRIBUTED_ATTRIB);
              String mapredFrameworkName = conf.get(QueryServices.MAPRED_FRAMEWORK_NAME);
      if ((hbaseClusterDistributedMode != null && !hbaseClusterDistributedMode.equals(HBASE_CLUSTER_DISTRIBUTED_CONFIG)) || 
                  (mapredFrameworkName != null && !mapredFrameworkName.equals(MAPRED_FRAMEWORK_YARN_CONFIG)))
              {
                  LOG.info("Enabling Async Index rebuilder");
                  AsyncIndexRebuilderTask asyncIndexRebuilderTask = new AsyncIndexRebuilderTask(e.getEnvironment());
                  // run async index rebuilder task every 10 secs to rebuild any newly created async indexes
                  executor.scheduleAtFixedRate(asyncIndexRebuilderTask, 10000, rebuildIndexTimeInterval, TimeUnit.MILLISECONDS);
              }
      

      Attachments

        1. PHOENIX-3113_addendum1.patch
          1 kB
          James R. Taylor
        2. PHOENIX-3113_test_wip.patch
          4 kB
          James R. Taylor
        3. phoenix-3113.patch
          8 kB
          Loknath Priyatham Teja Singamsetty
        4. phoenix-3113-v2.patch
          14 kB
          Loknath Priyatham Teja Singamsetty
        5. phoenix-3113-v3.patch
          26 kB
          Loknath Priyatham Teja Singamsetty
        6. PHOENIX-3113-v4.patch
          43 kB
          Thomas D'Silva
        7. PHOENIX-3113-v5.patch
          43 kB
          Thomas D'Silva
        8. PHOENIX-3113-v6.patch
          26 kB
          Thomas D'Silva
        9. PHOENIX-3113-v7.patch
          14 kB
          Thomas D'Silva

        Issue Links

          Activity

            People

              singamteja Loknath Priyatham Teja Singamsetty
              ankit@apache.org Ankit Singhal
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: