Uploaded image for project: 'Phoenix'
  1. Phoenix
  2. PHOENIX-3113

Automatic build of async index will happen even if mapreduce.framework.name is not set in any configuration

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.8.0
    • Component/s: None
    • Labels:
      None

      Description

      As per below code, we are starting automatic build of async index even if mapreduce.framework.name is not set in any of the configuration(because conf.get(QueryServices.MAPRED_FRAMEWORK_NAME) will always return LOCAL as a default value).
      This may cause problem in the hbase cluster where mapreduce is not deployed or this configuration is not set or included in the classpath.

      String hbaseClusterDistributedMode = conf.get(QueryServices.HBASE_CLUSTER_DISTRIBUTED_ATTRIB);
              String mapredFrameworkName = conf.get(QueryServices.MAPRED_FRAMEWORK_NAME);
      if ((hbaseClusterDistributedMode != null && !hbaseClusterDistributedMode.equals(HBASE_CLUSTER_DISTRIBUTED_CONFIG)) || 
                  (mapredFrameworkName != null && !mapredFrameworkName.equals(MAPRED_FRAMEWORK_YARN_CONFIG)))
              {
                  LOG.info("Enabling Async Index rebuilder");
                  AsyncIndexRebuilderTask asyncIndexRebuilderTask = new AsyncIndexRebuilderTask(e.getEnvironment());
                  // run async index rebuilder task every 10 secs to rebuild any newly created async indexes
                  executor.scheduleAtFixedRate(asyncIndexRebuilderTask, 10000, rebuildIndexTimeInterval, TimeUnit.MILLISECONDS);
              }
      

        Attachments

        1. PHOENIX-3113_addendum1.patch
          1 kB
          James R. Taylor
        2. PHOENIX-3113_test_wip.patch
          4 kB
          James R. Taylor
        3. phoenix-3113.patch
          8 kB
          Loknath Priyatham Teja Singamsetty
        4. phoenix-3113-v2.patch
          14 kB
          Loknath Priyatham Teja Singamsetty
        5. phoenix-3113-v3.patch
          26 kB
          Loknath Priyatham Teja Singamsetty
        6. PHOENIX-3113-v4.patch
          43 kB
          Thomas D'Silva
        7. PHOENIX-3113-v5.patch
          43 kB
          Thomas D'Silva
        8. PHOENIX-3113-v6.patch
          26 kB
          Thomas D'Silva
        9. PHOENIX-3113-v7.patch
          14 kB
          Thomas D'Silva

          Issue Links

            Activity

              People

              • Assignee:
                singamteja Loknath Priyatham Teja Singamsetty
                Reporter:
                ankit@apache.org Ankit Singhal
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: