Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-4084

Error when loading string field with high cardinary

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.0.0, 2.1.0, 2.0.1
    • 2.1.1
    • spark-integration

    Description

      When i am try load string field with more than 1M distinct value, some rows show strange value.

       

      I'm trying with this setting: carbon.local.dictionary.enable=false then it works as expect. So seems like have some bugs on decoder fallback.

       

       

      Attachments

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            brucemen711 Nguyen Dinh Huynh
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 1h
                1h

                Slack

                  Issue deployment