Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-2230

Add a path into table path to store lock files and delete useless segment lock files before loading

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 1.3.0, 1.4.0
    • 1.3.0, 1.4.0
    • data-load
    • None

    Description

      After PR1984 merged, it doesn't delete the lock files when unlock, there are many useless lock files in table path, especially segment lock files, they grow after every batch loading.

      Solution :
      1. add a child path into table path, called Locks, all lock files will be stored in this path;
      2. Before loading, get all useless segment lock files and delete them, because just segment lock files will grow, other lock files dosen't grow.

      Attachments

        Activity

          People

            zzcclp Zhichao Zhang
            zzcclp Zhichao Zhang
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 24h
                24h