Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-4195

Materialized view loading time increased due to full refresh

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.1.0
    • Fix Version/s: 2.1.0
    • Component/s: core
    • Labels:
      None

      Description

      Hi Team,

      We are using carbon 2.1.0 in our project where parallel data loading is happening.

      We are working on getting optimal performance for aggregated queries using materialized views.

      We observed that continues data loading and full refresh of MV is causing increased load time and high memory usage which doesn't have to be this way.

      Can you suggest a way to perform incremental refresh because we do not need to calculate old data again while loading ? 

       

       

       

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              Mayuri94 Mayuri Patole
            • Votes:
              3 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: