[HAWQ-1113] In force mode, hawq register error when files in yaml is disordered

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.1.0.0-incubating
• Fix Version/s: 2.1.0.0-incubating
• Component/s: Command Line Tools
• Assignee: Chunling Wang
• Reporter: Chunling Wang
• Created: 19/Oct/16 06:06
• Updated: 18/Feb/17 05:27
• Resolved: 22/Dec/16 06:40

Description

In force mode, hawq register error when files in yaml is in disordered. For example, the files order in yaml is as following:

  Files:
  - path: /hawq_default/16385/@DATABASE_OID@/@TABLE_OID_OLD@/2
    size: 250
  - path: /hawq_default/16385/@DATABASE_OID@/@TABLE_OID_OLD@/4
    size: 250
  - path: /hawq_default/16385/@DATABASE_OID@/@TABLE_OID_OLD@/5
    size: 258
  - path: /hawq_default/16385/@DATABASE_OID@/@TABLE_OID_OLD@/6
    size: 270
  - path: /hawq_default/16385/@DATABASE_OID@/@TABLE_OID_OLD@/3
    size: 258
  - path: /hawq_default/16385/@DATABASE_OID@/@TABLE_OID_NEW2@/1
    size: 228
  - path: /hawq_default/16385/@DATABASE_OID@/@TABLE_OID_NEW@/2
    size: 215
  - path: /hawq_default/16385/@DATABASE_OID@/@TABLE_OID_NEW@/3
    size: 215
  - path: /hawq_default/16385/@DATABASE_OID@/@TABLE_OID_NEW@/4
    size: 220
  - path: /hawq_default/16385/@DATABASE_OID@/@TABLE_OID_OLD@/1
    size: 254
  - path: /hawq_default/16385/@DATABASE_OID@/@TABLE_OID_NEW@/6
    size: 215
  - path: /hawq_default/16385/@DATABASE_OID@/@TABLE_OID_NEW@/5
    size: 210

After hawq register success, we select data from table and get the error:

ERROR:  hdfs file length does not equal to metadata logic length! (cdbdatalocality.c:1102)

Issue Links

• relates to: HAWQ-991 "HAWQ register" could register tables according to .yml configuration file
• links to: GitHub Pull Request #970
• links to: GitHub Pull Request #971
• links to: GitHub Pull Request #980