Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-2709

clean temp file and table throw exception

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Cannot Reproduce
    • v2.0.0
    • None
    • None
    • None

    Description

      when execute command ./kylin.sh org.apache.kylin.storage.hbase.util.StorageCleanupJob --delete false for check temp files and tables,it will throw exception

      the detail log like this:--------------------

      2017-07-04 09:37:39,182 INFO [main StorageCleanupJob:283]: Checking table OK
      2017-07-04 09:37:39,182 INFO [main StorageCleanupJob:283]: Checking table kylin_intermediate_cube_fact_pvuv_19700101000000_20161101010500
      2017-07-04 09:37:39,183 INFO [main StorageCleanupJob:307]: Skip because not match pattern
      2017-07-04 09:37:39,183 INFO [main StorageCleanupJob:283]: Checking table kylin_intermediate_cube_interface_20150528000000_20150529000000
      2017-07-04 09:37:39,183 INFO [main StorageCleanupJob:307]: Skip because not match pattern
      2017-07-04 09:37:39,183 INFO [main StorageCleanupJob:283]: Checking table kylin_intermediate_cube_pvuv_20160609000000_20160610050000
      2017-07-04 09:37:39,183 INFO [main StorageCleanupJob:307]: Skip because not match pattern
      2017-07-04 09:37:39,183 INFO [main StorageCleanupJob:283]: Checking table kylin_intermediate_cube_pvuv_20160609000000_20160610090000
      2017-07-04 09:37:39,183 INFO [main StorageCleanupJob:307]: Skip because not match pattern
      2017-07-04 09:37:39,184 INFO [main StorageCleanupJob:283]: Checking table kylin_intermediate_cube_pvuv_20160609000000_20160610140000
      2017-07-04 09:37:39,184 INFO [main StorageCleanupJob:307]: Skip because not match pattern
      2017-07-04 09:37:39,184 INFO [main StorageCleanupJob:283]: Checking table kylin_intermediate_cube_pvuv_20160609000000_20161210100000
      2017-07-04 09:37:39,184 INFO [main StorageCleanupJob:307]: Skip because not match pattern
      2017-07-04 09:37:39,184 INFO [main StorageCleanupJob:283]: Checking table kylin_intermediate_cube_pvuv_20161201220000_20161202060000
      2017-07-04 09:37:39,184 INFO [main StorageCleanupJob:307]: Skip because not match pattern
      2017-07-04 09:37:39,184 INFO [main StorageCleanupJob:283]: Checking table kylin_intermediate_cube_test_full_build
      2017-07-04 09:37:39,184 INFO [main StorageCleanupJob:311]: Skip because length not qualified
      2017-07-04 09:37:39,184 INFO [main StorageCleanupJob:283]: Checking table kylin_intermediate_cube_work_loan_full_build
      2017-07-04 09:37:39,185 INFO [main StorageCleanupJob:311]: Skip because length not qualified
      2017-07-04 09:37:39,185 INFO [main StorageCleanupJob:283]: Checking table kylin_intermediate_cube_workloan_new_full_build
      2017-07-04 09:37:39,185 INFO [main StorageCleanupJob:311]: Skip because length not qualified
      2017-07-04 09:37:39,185 INFO [main StorageCleanupJob:283]: Checking table kylin_intermediate_cube_xn_order_19700101000000_20161111000000
      2017-07-04 09:37:39,185 INFO [main StorageCleanupJob:307]: Skip because not match pattern
      2017-07-04 09:37:39,185 INFO [main StorageCleanupJob:283]: Checking table kylin_intermediate_cube_xn_order_d81dade9_348f_43c0_b60b_ba4b47a535d0
      Exception in thread "main" java.lang.RuntimeException: error execute org.apache.kylin.storage.hbase.util.StorageCleanupJob
      at org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:42)
      at org.apache.kylin.storage.hbase.util.StorageCleanupJob.main(StorageCleanupJob.java:362)
      Caused by: java.lang.NullPointerException
      at org.apache.kylin.common.util.ClassUtil.forRenamedClass(ClassUtil.java:84)
      at org.apache.kylin.common.util.ClassUtil.forName(ClassUtil.java:76)
      at org.apache.kylin.job.execution.ExecutableManager.parseTo(ExecutableManager.java:439)
      at org.apache.kylin.job.execution.ExecutableManager.getJob(ExecutableManager.java:129)
      at org.apache.kylin.storage.hbase.util.StorageCleanupJob.isTableInUse(StorageCleanupJob.java:347)
      at org.apache.kylin.storage.hbase.util.StorageCleanupJob.cleanUnusedIntermediateHiveTable(StorageCleanupJob.java:302)
      at org.apache.kylin.storage.hbase.util.StorageCleanupJob.execute(StorageCleanupJob.java:153)
      at org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:37)
      ... 1 more
      2017-07-04 09:37:39,193 INFO [Thread-0 ConnectionManager$HConnectionImplementation:2068]: Closing master protocol: MasterService
      2017-07-04 09:37:39,204 INFO [Thread-0 ConnectionManager$HConnectionImplementation:1676]: Closing zookeeper sessionid=0x35a5a288150658a
      2017-07-04 09:37:39,206 INFO [main-EventThread ClientCnxn:512]: EventThread shut down
      2017-07-04 09:37:39,206 INFO [Thread-0 ZooKeeper:684]: Session: 0x35a5a288150658a closed

      Attachments

        Activity

          People

            Unassigned Unassigned
            catchen catchen
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: