[CARBONDATA-1945] documentation for bad records action needs to be updated

• Type: Improvement
• Status: Resolved
• Priority: Trivial
• Resolution: Fixed
• Affects Version/s: 1.3.0
• Fix Version/s: 1.3.0
• Component/s: docs
• Environment: spark 2.1
• Assignee: Vandana Yadav
• Reporter: Vandana Yadav
• Created: 28/Dec/17 05:41
• Updated: 28/Jan/18 06:33
• Resolved: 28/Jan/18 06:33

Description

We should update bad record action's default value as while creating and loading data with some empty or bad record it is giving exception

Error: java.lang.Exception: Data load failed due to bad record:

Steps to reproduce:

1) Create Table:
CREATE TABLE uniqdata (CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION string, DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2 decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 double,INTEGER_COLUMN1 int) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES ("TABLE_BLOCKSIZE"= "256 MB")

2) Load data:
LOAD DATA inpath 'hdfs://localhost:54310/Data/uniqdata/2000_UniqData.csv' INTO table uniqdata options('DELIMITER'=',', 'FILEHEADER'='CUST_ID, CUST_NAME, ACTIVE_EMUI_VERSION, DOB, DOJ, BIGINT_COLUMN1, BIGINT_COLUMN2, DECIMAL_COLUMN1, DECIMAL_COLUMN2, Double_COLUMN1, Double_COLUMN2, INTEGER_COLUMN1','TIMESTAMPFORMAT'='yyyy-MM-dd HH:mm:ss');

3) Output:

Expected output: data should be loaded successfully.

Actual Output: Error: java.lang.Exception: Data load failed due to bad record: The value with column name dob and column data type TIMESTAMP is not a valid TIMESTAMP type. (state=,code=0)

Issue Links

• links to: GitHub Pull Request #1842