[HIVE-27350] Unable to Create Table with 380+ Columns

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 3.1.2
• Component/s: Metastore, Standalone Metastore

Environment

Production

• Target Version/s: 3.1.2
• Assignee: Karthik
• Reporter: Karthik
• Created: 17/May/23 01:32
• Updated: 17/May/23 11:16
• Resolved: 17/May/23 11:16

Description

When we try to Iceberg table via Hive MetaStore with 388 Columns we get below exception:

org.apache.hadoop.hive.metastore.api.MetaException: Add request failed : INSERT INTO `COLUMNS_V2` (`CD_ID`,`COMMENT`,`COLUMN_NAME`,`TYPE_NAME`,`INTEGER_IDX`) VALUES (?,?,?,?,?) 	at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$create_table_with_environment_context_result$create_table_with_environment_context_resultStandardScheme.read(ThriftHiveMetastore.java:54908) ~[hive-standalone-metastore-3.1.3.jar:3.1.3]	at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$create_table_with_environment_context_result$create_table_with_environment_context_resultStandardScheme.read(ThriftHiveMetastore.java:54876) ~[hive-standalone-metastore-3.1.3.jar:3.1.3]	at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$create_table_with_environment_context_result.read(ThriftHiveMetastore.java:54802) ~[hive-standalone-metastore-3.1.3.jar:3.1.3]	at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:86) ~[libthrift-0.9.3.jar:0.9.3]	at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_create_table_with_environment_context(ThriftHiveMetastore.java:1556) ~[hive-standalone-metastore-3.1.3.jar:3.1.3]	at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.create_table_with_environment_context(ThriftHiveMetastore.java:1542) ~[hive-standalone-metastore-3.1.3.jar:3.1.3]	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.create_table_with_environment_context(HiveMetaStoreClient.java:2867) ~[hive-standalone-metastore-3.1.3.jar:3.1.3]	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:837) ~[hive-standalone-metastore-3.1.3.jar:3.1.3]	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:822) ~[hive-standalone-metastore-3.1.3.jar:3.1.3]	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?]	at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]	at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?]	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:208) ~[hive-standalone-metastore-3.1.3.jar:3.1.3]	at jdk.proxy2.$Proxy20.createTable(Unknown Source) ~[?:?]	at org.apache.iceberg.hive.HiveTableOperations.lambda$persistTable$4(HiveTableOperations.java:405) ~[iceberg-spark-runtime-3.2_2.12-1.1.0.jar:?]	at org.apache.iceberg.ClientPoolImpl.run(ClientPoolImpl.java:58) ~[iceberg-spark-runtime-3.2_2.12-1.1.0.jar:?]	at org.apache.iceberg.ClientPoolImpl.run(ClientPoolImpl.java:51) ~[iceberg-spark-runtime-3.2_2.12-1.1.0.jar:?]	at org.apache.iceberg.hive.CachedClientPool.run(CachedClientPool.java:82) ~[iceberg-spark-runtime-3.2_2.12-1.1.0.jar:?]	at org.apache.iceberg.hive.HiveTableOperations.persistTable(HiveTableOperations.java:403) ~[iceberg-spark-runtime-3.2_2.12-1.1.0.jar:?]	at org.apache.iceberg.hive.HiveTableOperations.doCommit(HiveTableOperations.java:327) ~[iceberg-spark-runtime-3.2_2.12-1.1.0.jar:?]	at org.apache.iceberg.BaseMetastoreTableOperations.commit(BaseMetastoreTableOperations.java:135) ~[iceberg-spark-runtime-3.2_2.12-1.1.0.jar:?]	at org.apache.iceberg.BaseMetastoreCatalog$BaseMetastoreCatalogTableBuilder.create(BaseMetastoreCatalog.java:196) ~[iceberg-spark-runtime-3.2_2.12-1.1.0.jar:?]

When we reduce columns size 380, Table is created. Our metastore DB is Postgres.

Validated SD_PARAMS and SERDE_PARAMS table, both table has PARAM_VALUE as TEXT datatype only.

This is specific to COLUMNS_V2 table. Changed TYPE_NAME to TEXT type as well and Restarted Metastore but didn't work.

For reference Below is the Table Object(toString)

Table(tableName:credit_bureau, dbName:lz_agrinetwork, owner:karthikeyankarunanithi-NC23599, createTime:587637, lastAccessTime:587637, retention:2147483647, sd:StorageDescriptor(cols:[FieldSchema(name:creditBureauRating_num_dpd_0_instances_l3m_al, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l6m_al, type:double, comment:null), FieldSchema(name:computedCreditScore, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l6m_cc, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l12m_unsec, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l12m_gl, type:double, comment:null), FieldSchema(name:creditBureauRating_balc_sanc_amt_ratio_total, type:double, comment:null), FieldSchema(name:creditBureauRating_count_60plus_12m, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l6m_sec, type:double, comment:null), FieldSchema(name:creditBureauRating_count_sec_loans_opened_3m, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l6m_sec, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_24m_sec, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_ever_unsec, type:double, comment:null), FieldSchema(name:creditBureauRating_count_HL_open, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_ever_twl, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_6m_HL, type:double, comment:null), FieldSchema(name:creditBureauRating_count_OD_ever, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_ever_unsec, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l3m_bl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l3m, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_12m_sec, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_12m_GL, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l6m_bl, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_36m_HL, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_ever_cvl, type:double, comment:null), FieldSchema(name:creditBureauRating_count_open_unsecured, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_6m_GL, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_ever, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l12m, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l12m_cc, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l12m, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l24m, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_36m_sec, type:double, comment:null), FieldSchema(name:creditBureauRating_max_DPD_12m_CC, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l6m, type:double, comment:null), FieldSchema(name:creditBureauRating_balc_sanc_amt_ratio_unsec, type:double, comment:null), FieldSchema(name:creditBureauRating_Total_unsec_sanc_amount_6m, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l12m_cvl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_active_overdue_loans_l24m, type:double, comment:null), FieldSchema(name:creditBureauRating_count_loans_closed_6m, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_12m_unsec, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l24m, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l12m, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_12m_HL, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l12m_cc, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l6m_cc, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_active_l24m, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l3m, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l3m_cc, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_ever_twl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l6m_al, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l6m_pl, type:double, comment:null), FieldSchema(name:realmId, type:string, comment:null), FieldSchema(name:creditBureauRating_count_closed_loans, type:double, comment:null), FieldSchema(name:creditBureauRating_cc_highcredit_ratio, type:double, comment:null), FieldSchema(name:creditBureauRating_count_AL_open, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l12m_bl, type:double, comment:null), FieldSchema(name:creditBureauRating_count_active_closed_6m, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_ever_cvl, type:double, comment:null), FieldSchema(name:userId, type:string, comment:null), FieldSchema(name:creditBureauRating_Ratio_opened_closed_loans_3m, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_6m_sec, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l6m_bl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l12m_twl, type:double, comment:null), FieldSchema(name:creditBureauRating_active_cc_limit, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l3m_pl, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_12m_BL, type:double, comment:null), FieldSchema(name:creditBureauRating_cc_balc_highcredit_ratio, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l12m_cc, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l12m_al, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l6m, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l12m_al, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_ever_BL, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l12m_bl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l3m, type:double, comment:null), FieldSchema(name:creditBureauRating_max_emi_l24m, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l6m_sec, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l12m_bl, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_ever_AL, type:double, comment:null), FieldSchema(name:creditBureauRating_count_loans_closed_3m, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l12m_sec, type:double, comment:null), FieldSchema(name:creditBureauRating_ratio_PL_open_total, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l3m_unsec, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_12m_CC, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l12m_al, type:double, comment:null), FieldSchema(name:creditBureauRating_count_GL_ever, type:double, comment:null), FieldSchema(name:creditBureauRating_ratio_open_loans, type:double, comment:null), FieldSchema(name:creditBureauRating_count_sec_loans_opened_6m, type:double, comment:null), FieldSchema(name:creditBureauRating_active_od_bl_limit, type:double, comment:null), FieldSchema(name:creditBureauRating_Ratio_0plus_6m_12m, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l6m_al, type:double, comment:null), FieldSchema(name:creditBureauRating_Ratio_opened_closed_loans_6m, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l12m_unsec, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l6m_sec, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_3m_AL, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l3m_unsec, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l6m_bl, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_3m_BL, type:double, comment:null), FieldSchema(name:externalId, type:string, comment:null), FieldSchema(name:creditBureauRating_thick_thin_flag, type:string, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_6m, type:double, comment:null), FieldSchema(name:creditBureauRating_ratio_HL_open_total, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_15_instances_l3m, type:double, comment:null), FieldSchema(name:creditBureauRating_ratio_BL_open_total, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l12m_pl, type:double, comment:null), FieldSchema(name:creditBureauRating_suit_filed_ever_flag, type:boolean, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l6m_gl, type:double, comment:null), FieldSchema(name:creditBureauRating_balc_sanc_amt_ratio_sec, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_3m_CVL, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l3m_cvl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_loan_facilities_availed_l3m, type:double, comment:null), FieldSchema(name:creditBureauRating_cc_utilization_ratio, type:double, comment:null), FieldSchema(name:id, type:string, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_3m_TWL, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l3m_twl, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_24m_PL, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l6m_hl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l12m_al, type:double, comment:null), FieldSchema(name:creditBureauRating_count_PL_open, type:double, comment:null), FieldSchema(name:creditBureauRating_count_CC_ever, type:double, comment:null), FieldSchema(name:creditBureauRating_report_date, type:string, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_ever_twl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l12m_twl, type:double, comment:null), FieldSchema(name:creditBureauRating_count_loans_doubtful, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l3m_unsec, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_closed_l24m, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l12m_cvl, type:double, comment:null), FieldSchema(name:creditBureauRating_settled_ever_flag, type:boolean, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l3m_cvl, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_3m, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_6m_BL, type:double, comment:null), FieldSchema(name:creditBureauRating_count_LABD_open, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l12m_bl, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_36m_CC, type:double, comment:null), FieldSchema(name:creditBureauRating_wrt_off_setld_ever_flag, type:boolean, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l3m_twl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l6m_hl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l12m_cc, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l12m_sec, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_ever_cvl, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_36m_BL, type:double, comment:null), FieldSchema(name:creditBureauRating_count_loans_suit_filed, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_12m_AL, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_ever_CC, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_6m_AL, type:double, comment:null), FieldSchema(name:creditBureauRating_Total_sec_sanc_amount_36m, type:double, comment:null), FieldSchema(name:creditBureauRating_Total_sec_sanc_amount_24m, type:double, comment:null), FieldSchema(name:creditBureauRating_Total_sec_sanc_amount_12m, type:double, comment:null), FieldSchema(name:creditBureauRating_jlg_loan_bal_amt, type:double, comment:null), FieldSchema(name:creditBureauRating_count_unsecured, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l6m_gl, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_36m_AL, type:double, comment:null), FieldSchema(name:creditBureauRating_count_BL_ever, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_ever_CVL, type:double, comment:null), FieldSchema(name:creditBureauRating_count_loans_closed_36m, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l3m_pl, type:double, comment:null), FieldSchema(name:creditBureauRating_count_loans_closed_24m, type:double, comment:null), FieldSchema(name:creditBureauRating_count_loans_closed_12m, type:double, comment:null), FieldSchema(name:creditBureauRating_count_loans_wrt_off_sttld, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l3m_bl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l3m_unsec, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l6m_gl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l6m_cc, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l6m_bl, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_ever_TWL, type:double, comment:null), FieldSchema(name:creditBureauRating_count_AL_ever, type:double, comment:null), FieldSchema(name:creditBureauRating_Ratio_0plus_3m_ever, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l3m_cc, type:double, comment:null), FieldSchema(name:creditBureauRating_count_open_secured, type:double, comment:null), FieldSchema(name:creditBureauRating_balc_sanc_amt_ratio_PL, type:double, comment:null), FieldSchema(name:creditBureauRating_ratio_0plus_3m_12m, type:double, comment:null), FieldSchema(name:creditBureauRating_current_overdue, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l3m_al, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_ever, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l6m_al, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l6m_hl, type:double, comment:null), FieldSchema(name:creditBureauRating_count_credit_lines, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_6m_CC, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l12m_gl, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_ever_HL, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l3m_sec, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_36m_GL, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_ever_pl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_ever_pl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_ever_al, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l12m_gl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l3m_sec, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l12m_hl, type:double, comment:null), FieldSchema(name:creditBureauRating_balc_sanc_amt_ratio_LABD, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_ever_GL, type:double, comment:null), FieldSchema(name:creditBureauRating_ratio_GL_open_total, type:double, comment:null), FieldSchema(name:creditBureauRating_Total_sec_sanc_amount_3m, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_ever_sec, type:double, comment:null), FieldSchema(name:vintageWithNinjacart, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_36m, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_24m, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_12m, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l6m, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l6m_cc, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l12m_hl, type:double, comment:null), FieldSchema(name:creditBureauRating_count_loans, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_ever_bl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l6m_cvl, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_24m_CVL, type:double, comment:null), FieldSchema(name:creditBureauRating_count_BL_open, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_ever_sec, type:double, comment:null), FieldSchema(name:creditBureauRating_count_LABD_ever, type:double, comment:null), FieldSchema(name:creditBureauRating_active_od_limit, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l3m_al, type:double, comment:null), FieldSchema(name:creditBureauRating_count_CC_open, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_24m_HL, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l6m_twl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l6m_cvl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_ever_al, type:double, comment:null), FieldSchema(name:creditBureauRating_count_loans_loss, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l3m_cc, type:double, comment:null), FieldSchema(name:creditBureauRating_Total_sanc_amount_12m, type:double, comment:null), FieldSchema(name:creditBureauRating_active_emi, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_ever_al, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_ever_cc, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l6m_pl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l6m_twl, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_36m_TWL, type:double, comment:null), FieldSchema(name:creditBureauRating_updated_ts, type:string, comment:null), FieldSchema(name:creditBureauRating_Total_sanc_amount_36m, type:double, comment:null), FieldSchema(name:creditBureauRating_Total_sanc_amount_24m, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_ever_cc, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l3m_bl, type:double, comment:null), FieldSchema(name:creditBureauRating_ratio_open_secured, type:double, comment:null), FieldSchema(name:creditBureauRating_Ratio_0plus_3m_6m, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_24m_GL, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_ever_bl, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_12m_CVL, type:double, comment:null), FieldSchema(name:creditBureauRating_count_loans_opened_3m, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_ever_bl, type:double, comment:null), FieldSchema(name:creditBureauRating_balc_sanc_amt_ratio_CL, type:double, comment:null), FieldSchema(name:creditBureauRating_Total_sec_sanc_amount_6m, type:double, comment:null), FieldSchema(name:creditBureauRating_count_PL_ever, type:double, comment:null), FieldSchema(name:creditBureauRating_ratio_open_unsecured, type:double, comment:null), FieldSchema(name:creditBureauRating_Total_unsec_sanc_amount_36m, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_12m_TWL, type:double, comment:null), FieldSchema(name:creditBureauRating_count_GL_open, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_6m_CVL, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l6m_unsec, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_6m_unsec, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_ever_sec, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l3m_al, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_36m_CVL, type:double, comment:null), FieldSchema(name:creditBureauRating_balc_sanc_amt_ratio_BL, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_6m_TWL, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_ever_cc, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l6m_unsec, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l12m_sec, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l3m_bl, type:double, comment:null), FieldSchema(name:creditBureauRating_Total_unsec_sanc_amount_12m, type:double, comment:null), FieldSchema(name:creditBureauRating_Total_unsec_sanc_amount_24m, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_24m_TWL, type:double, comment:null), FieldSchema(name:creditBureauRating_balc_sanc_amt_ratio_AL, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l6m_twl, type:double, comment:null), FieldSchema(name:source, type:string, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_ever_hl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_ever_unsec, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l12m_cvl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l6m_cvl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l6m_pl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l3m_gl, type:double, comment:null), FieldSchema(name:creditBureauRating_balc_sanc_amt_ratio_HL, type:double, comment:null), FieldSchema(name:creditBureauRating_max_cc_limit, type:double, comment:null), FieldSchema(name:creditBureauRating_count_loans_opened_6m, type:double, comment:null), FieldSchema(name:creditBureauRating_jlg_loan_active_emi, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l12m_twl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_ever_gl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_ever_gl, type:double, comment:null), FieldSchema(name:creditBureauRating_count_secured, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_3m_PL, type:double, comment:null), FieldSchema(name:creditBureauRating_Ratio_opened_closed_loans_12m, type:double, comment:null), FieldSchema(name:creditBureauRating_Ratio_opened_closed_loans_24m, type:double, comment:null), FieldSchema(name:creditBureauRating_balc_sanc_amt_ratio_GL, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l3m_hl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l12m_pl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_ever_hl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l6m_cvl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l3m_hl, type:double, comment:null), FieldSchema(name:creditBureauRating_doubtful_ever_flag, type:boolean, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_ever_hl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l12m_unsec, type:double, comment:null), FieldSchema(name:creditBureauRating_Ratio_opened_closed_loans_36m, type:double, comment:null), FieldSchema(name:creditBureauRating_ratio_secured_loans, type:double, comment:null), FieldSchema(name:creditBureauRating_count_write_off_loans, type:double, comment:null), FieldSchema(name:creditBureauRating_count_OD_open, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_ever_gl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l6m_twl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l3m_cc, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l12m_pl, type:double, comment:null), FieldSchema(name:creditBureauRating_count_settled_loans, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l3m_gl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l12m_pl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l6m_pl, type:double, comment:null), FieldSchema(name:creditBureauRating_write_off_ever_flag, type:boolean, comment:null), FieldSchema(name:creditBureauRating_count_open_loans, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_ever_gl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_ever_hl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l3m_pl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_delinquent_l24m, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_ever_PL, type:double, comment:null), FieldSchema(name:vintageBusinessName, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l3m_sec, type:double, comment:null), FieldSchema(name:creditBureauRating_num_write_off_settled_l24m, type:double, comment:null), FieldSchema(name:creditBureauRating_loss_ever_flag, type:boolean, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_3m_CC, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_6m_PL, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_24m_unsec, type:double, comment:null), FieldSchema(name:creditBureauRating_count_HL_ever, type:double, comment:null), FieldSchema(name:creditBureauRating_Ratio_0plus_3m_12m, type:double, comment:null), FieldSchema(name:creditBureauRating_balc_sanc_amt_ratio_CVL, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l12m_unsec, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_ever_sec, type:double, comment:null), FieldSchema(name:creditBureauRating_unsecured_sanction_flag, type:boolean, comment:null), FieldSchema(name:creditBureauRating_Total_sanc_amount_3m, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_36m_PL, type:double, comment:null), FieldSchema(name:creditBureauRating_balc_sanc_amt_ratio_TWL, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l12m_sec, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l6m_unsec, type:double, comment:null), FieldSchema(name:creditBureauRating_ratio_LABD_open_total, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_3m_unsec, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l12m_cvl, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_12m_PL, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l3m_gl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l3m_sec, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l12m_twl, type:double, comment:null), FieldSchema(name:creditBureauRating_active_od_bl_flag, type:boolean, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_3m_sec, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l3m_hl, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_3m_GL, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_ever_pl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_ever_unsec, type:double, comment:null), FieldSchema(name:creditBureauRating_Total_sanc_amount_6m, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_1_instances_l3m, type:double, comment:null), FieldSchema(name:creditBureauRating_ratio_CC_open_total, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_ever_al, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l6m, type:double, comment:null), FieldSchema(name:creditBureauRating_count_sec_loans_opened_24m, type:double, comment:null), FieldSchema(name:creditBureauRating_count_sec_loans_opened_36m, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l12m, type:double, comment:null), FieldSchema(name:creditBureauRating_count_sec_loans_opened_12m, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_3m_HL, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l12m_hl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_ever_cc, type:double, comment:null), FieldSchema(name:creditBureauRating_Total_unsec_sanc_amount_3m, type:double, comment:null), FieldSchema(name:creditBureauRating_bureau_score, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_ever_bl, type:double, comment:null), FieldSchema(name:count_active_closed_6m, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_24m_CC, type:double, comment:null), FieldSchema(name:creditBureauRating_expiry_date, type:string, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l6m_gl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l12m_gl, type:double, comment:null), FieldSchema(name:creditBureauRating_count_loans_opened_36m, type:double, comment:null), FieldSchema(name:creditBureauRating_count_loans_opened_24m, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_ever_unsec, type:double, comment:null), FieldSchema(name:creditBureauRating_num_write_off_l24m, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l3m_cvl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l3m_cvl, type:double, comment:null), FieldSchema(name:creditBureauRating_total_sanc_amount_3m, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_24m_BL, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_ever_pl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l3m_twl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l3m_gl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l3m_twl, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_36m_unsec, type:double, comment:null), FieldSchema(name:creditBureauRating_balc_sanc_amt_ratio_LAS, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l6m_hl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l12m_hl, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_ever_sec, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_ever, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_ever_cvl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_ever, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_ever, type:double, comment:null), FieldSchema(name:creditBureauRating_ratio_AL_open_total, type:double, comment:null), FieldSchema(name:creditBureauRating_Max_DPD_24m_AL, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_60_instances_l6m_unsec, type:double, comment:null), FieldSchema(name:creditBureauRating_count_loans_opened_12m, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_90_instances_l3m, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_l3m_pl, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_0_instances_l3m_hl, type:double, comment:null), FieldSchema(name:creditBureauRating_bureau_vintage, type:double, comment:null), FieldSchema(name:creditBureauRating_num_dpd_30_instances_ever_twl, type:double, comment:null), FieldSchema(name:sys__processed_ts, type:timestamp, comment:null), FieldSchema(name:sys__event_id, type:string, comment:null)], location:abfs://[e-mail]/landingzone/lz_agrinetwork.db/credit_bureau, inputFormat:org.apache.hadoop.mapred.FileInputFormat, outputFormat:org.apache.hadoop.mapred.FileOutputFormat, compressed:false, numBuckets:0, serdeInfo:SerDeInfo(name:null, serializationLib:org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, parameters:{}), bucketCols:null, sortCols:null, parameters:null), partitionKeys:[], parameters:{EXTERNAL=TRUE, write.format.default=parquet, write.metadata.previous-versions-max=5, metadata_location=abfs://[e-mail]/landingzone/lz_agrinetwork.db/credit_bureau/metadata/00000-d32267f0-61ba-4a3a-8571-b9aa24b7f921.metadata.json, write.metadata.delete-after-commit.enabled=true, default-partition-spec={"spec-id":0,"fields":[{"name":"sys__processed_ts_hour","transform":"hour","source-id":387,"field-id":1000}]}, snapshot-count=0, uuid=f491f592-d865-4fee-b69e-852bcd82cfca, table_type=ICEBERG}, viewOriginalText:null, viewExpandedText:null, tableType:EXTERNAL_TABLE, catName:hive, ownerType:USER)