[CARBONDATA-2871] Formatting and broken link issues in http://carbondata.apache.org pages

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 1.4.1
• Component/s: docs
• Assignee: Gururaj Shetty
• Reporter: Chetan Bhat
• Due: 31/Aug/18
• Created: 21/Aug/18 10:47
• Updated: 21/Aug/18 11:37

Description

Formatting and broken link issues in http://carbondata.apache.org pages.

http://carbondata.apache.org/data-management-on-carbondata.html

1. CarbonData supports streaming ingestion for real-time data. You can create the ?streaming? table using the following table properties.

COLUMN_META_CACHE=??

    *COLUMN_META_CACHE=?col1?*

    *COLUMN_META_CACHE=?col1,col2,col3,??*

  CREATE TABLE [dbName].tableName (col1 String, col2 String, col3 int,?) STORED BY ?carbondata? TBLPROPERTIES (?COLUMN_META_CACHE?=?col1,col2,??){{}}

CREATE TABLE employee (name String, city String, id int) STORED BY ?carbondata? TBLPROPERTIES (?COLUMN_META_CACHE?=?name?){{}}

ALTER TABLE [dbName].tableName SET TBLPROPERTIES (?COLUMN_META_CACHE?=?col1,col2,??){{}}

ALTER TABLE employee SET TBLPROPERTIES (?COLUMN_META_CACHE?=?city?){{}}

CACHE_LEVEL= ?BLOCK?{{}}

CACHE_LEVEL= ?BLOCKLET?{{}}

CREATE TABLE [dbName].tableName (col1 String, col2 String, col3 int,?) STORED BY ?carbondata? TBLPROPERTIES (?CACHE_LEVEL?=?Blocklet?)

CREATE TABLE employee (name String, city String, id int) STORED BY ?carbondata? TBLPROPERTIES (?CACHE_LEVEL?=?Blocklet?)

ALTER TABLE [dbName].tableName SET TBLPROPERTIES (?CACHE_LEVEL?=?Blocklet?){{}}

ALTER TABLE employee SET TBLPROPERTIES (?CACHE_LEVEL?=?Blocklet?){{}}

CREATE TABLE employee (name String, city String, id int) STORED BY ?carbondata? TBLPROPERTIES ('flat_folder'='true'){{}}

CREATE EXTERNAL TABLE [IF NOT EXISTS] [db_name.]table_name STORED BY 'carbondata' LOCATION ?$FilesPath?{{}}

CREATE DATABASE carbon LOCATION ?hdfs://name_cluster/dir1/carbonstore?

COMMENT ?This is table comment?

2. http://carbondata.apache.org/file-structure-of-carbondata.html

• File Footer : it contains Number of rows, segmentinfo ,all blocklets? info and index, you can find the detail from the below diagram.

3. http://carbondata.apache.org/streaming-guide.html

The user can use ?SHOW SEGMENTS FOR TABLE tableName? to check segment status.

4. http://carbondata.apache.org/faq.html

Spark executor shows task as failed after the maximum number of retry attempts, but loading the data having bad records and BAD_RECORDS_ACTION (carbon.bad.records.action) is set as ?FAIL?

 5. http://carbondata.apache.org/bloomfilter-datamap-guide.html

Font for the statement is bold and large , different from other statements - "The datamap by default is enabled. To support tuning on query, we can disable a specific datamap during query to observe whether we can gain performance enhancement from it. This will only take effect current session."

 6. http://carbondata.apache.org/timeseries-datamap-guide.html

Please refer to Pre-aggregate DataMap --> Link when clicked displays page not found error.

Refer to Compaction section in preaggregation datamap. --> Link when clicked displays page not found error.

Refer to Data Management section in preaggregation datamap --> Link when clicked displays page not found error.

7. http://carbondata.apache.org/data-management-on-carbondata.html

Here writer path will have carbondata and index files. This can be SDK output. Refer SDK Writer Guide. --> Link when clicked displays page not found error.

8. http://carbondata.apache.org/s3-guide.html

Object Storage like S3 does not support file leasing mechanism(supported by HDFS) that is required to take locks which ensure consistency between concurrent operations therefore, it is recommended to set the configurable lock path property(carbon.lock.path --> Link when clicked displays page not found error.

9. http://carbondata.apache.org/datamap-management.html

event_time, xx_granularity, please refer to Timeseries DataMap  --> Link when clicked displays page not found error.

 

10. http://carbondata.apache.org/lucene-datamap-guide.html

Note: For lucene queries and syntax, refer to lucene-syntax --> Link when clicked displays page not found error.

11. http://carbondata.apache.org/preaggregate-datamap-guide.html

Please refer to Timeseries DataMap --> Link when clicked displays page not found error.

 

12. http://carbondata.apache.org/useful-tips-on-carbondata.html

You can find more information about it in BloomFilter datamap document. --> Link when clicked displays page not found error.