Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-2278

Save the datamaps to system folder of warehouse

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.4.0
    • None
    • None

    Description

      Problem
      Currently, datamap schema is saved inside the main table schema itself. This approach cannot satisfy if a datamap belongs to more than one table. For suppose if we need to create a datamap joining 2 tables then we cannot keep the datamap schema under any one table.
      And also accessing the datamaps required to read the main table schema every time, it is not well optimized. And if we need to create multiple datamaps for a table then all datamaps need to store under the schema of that table so the size of main table schema grows and impacts the performance.

      Solution
      Make the datamap schema independent of main table schema. And store the schema under _system}}folder location. This location is configurable by using carbon property {{carbon.system.folder.location , by default, it stores under the store location.
      Created datamap schema in JSON format for better readability. And has the interfaces to store it in database.
      Made on table <tablename> for datamap DDL as optional , so now user can create/drop or show datamaps without on table option.

      Attachments

        Issue Links

          Activity

            People

              ravi.pesala Ravindra Pesala
              ravi.pesala Ravindra Pesala
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 2h 50m
                  2h 50m