Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-2465

Improve the carbondata file reliability in data load when direct hdfs write is enabled

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.4.0
    • None
    • None

    Description

      At present if we enable direct write on HDFS, file is written with replication of 1. As the setReplication is asyn operation, it can cause data loss if any DN is down before NN finishes the replication.

      Attachments

        Issue Links

          Activity

            People

              kanaka Kanaka Kumar Avvaru
              kanaka Kanaka Kumar Avvaru
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 50m
                  1h 50m