Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-3770

ZipFileUtils is not compatible CubeMetaIngester

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: v2.3.0, v2.4.0, v2.5.0, v2.6.0
    • Fix Version/s: v2.6.1
    • Component/s: Tools, Build and Test
    • Labels:
      None

      Description

      KYLIN-3401 had changed the zip compress tool, so the unzip dir structure is as follows:

      unzip base_2019_01_15_17_45_28.zip 
      Archive:  base_2019_01_15_17_45_28.zip
        inflating: kylin_env               
         creating: cube/
        inflating: cube/test_global_dict1.json  
        inflating: info                    
         creating: table/
        inflating: table/DEFAULT.TEST_GLOBAL_DICT1--tianpeng.json  
         creating: table_exd/
        inflating: table_exd/DEFAULT.TEST_GLOBAL_DICT1--tianpeng.json  
        inflating: commit_SHA1             
         creating: cube_statistics/
         creating: cube_statistics/test_global_dict1/
        inflating: cube_statistics/test_global_dict1/24e4967f-f635-440f-82e8-d73f7cbb2f2d.seq  
        inflating: cube_statistics/test_global_dict1/adfb447f-4369-4dd8-9d76-94bc7f91d278.seq  
         creating: model_desc/
        inflating: model_desc/test_global_dict1.json  
        inflating: UUID                    
         creating: cube_desc/
        inflating: cube_desc/test_global_dict1.json  
      

      However, before the changing of KYLIN-3401, the unzip dir structure is :

      unzip base_2019_01_15_18_18_26.zip 
      Archive:  base_2019_01_15_18_18_26.zip
        inflating: base_2019_01_15_18_18_26/kylin_env  
        inflating: base_2019_01_15_18_18_26/cube/test_global_dict1.json  
        inflating: base_2019_01_15_18_18_26/info  
        inflating: base_2019_01_15_18_18_26/table/DEFAULT.TEST_GLOBAL_DICT1--tianpeng.json  
        inflating: base_2019_01_15_18_18_26/table_exd/DEFAULT.TEST_GLOBAL_DICT1--tianpeng.json  
        inflating: base_2019_01_15_18_18_26/commit_SHA1  
        inflating: base_2019_01_15_18_18_26/cube_statistics/test_global_dict1/24e4967f-f635-440f-82e8-d73f7cbb2f2d.seq  
        inflating: base_2019_01_15_18_18_26/cube_statistics/test_global_dict1/adfb447f-4369-4dd8-9d76-94bc7f91d278.seq  
        inflating: base_2019_01_15_18_18_26/model_desc/test_global_dict1.json  
        inflating: base_2019_01_15_18_18_26/UUID  
        inflating: base_2019_01_15_18_18_26/cube_desc/test_global_dict1.json  
      

      This modification led to the CubeMetaIngester will always throw the IllegalStateException, as the tempFolder.list().length will never be 1.

        Attachments

        1. KYLIN-3770.master.003.patch
          2 kB
          Temple Zhou
        2. KYLIN-3770.master.001.patch
          1 kB
          Temple Zhou

          Activity

            People

            • Assignee:
              temple.zhou Temple Zhou
              Reporter:
              temple.zhou Temple Zhou
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: