Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-3680

Support secondary index on carbon table

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0.0
    • Component/s: None
    • Labels:
      None

      Description

      Currently we have datamaps like, default datamaps which are block and blocklet and coarse grained datamaps like bloom, and fine grained datamaps like lucene
      which helps in better pruning during query. What if we introduce another kind of datamap which can hold blockletId as index? Initial level, we call it as index which
      will work as a child table to the main table like we have MV in our current code.

      Yes, lets introduce the secondary index to carbon table which will be the child table to main table and it can be created on column like we create lucene datamap,
      where we give index columns to create index. In a similar way, we create secondary index on column, so indexes on these column will be blocklet IDs which will
      help in better pruning and faster query when we have a filter query on the index column.

        Attachments

        1. Secondary Index.pdf
          100 kB
          Indhumathi Muthumurugesh

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              Indhumathi27 Indhumathi Muthumurugesh
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 21.5h
                21.5h