Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-3031

Find wrong description in the document for 'carbon.number.of.cores.while.loading'

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.5.1
    • None
    • None

    Description

      The document says that the default value of ‘carbon.number.of.cores.while.loading’ is 2. But actually during data loading, carbondata use the the value of 'spark.executor.cores', which means that the description in document is incorrect.

      But this doesn't mean that the default value of 'carbon.number.of.cores.while.loading' is useless – in compaction and sdk, carbondata still use this default value.

      In a word, we need to fix the implementation as well as the document, maybe some refactoring is needed.

      Attachments

        Issue Links

          Activity

            People

              lianganping lianganping
              xuchuanyin Chuanyin Xu
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 5h 40m
                  5h 40m