Uploaded image for project: 'Chukwa'
  1. Chukwa
  2. CHUKWA-589

Functionality allowing collectors to close .chukwa files at a fixed offset inside the rotateInterval

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.5.0
    • Fix Version/s: 0.5.0
    • Component/s: Data Collection
    • Labels:
      None
    • Release Note:
      Allow collectors to close .chukwa files at fixed offset.

      Description

      We have a system built on top of Chukwa that introduces the need to have all .chukwa files for a given rotateInterval closed and available at a predictable time. Currently, we are experience some drift in the times that the sequence files are closed due to the way the TimerTask is scheduled in the SeqFileWriter class. We would like to submit a solution that will allow people to configure the time all collectors should close their files for processing in a given interval, while still supporting the default functionality.

        Attachments

        1. CHUKWA-589_1.patch
          18 kB
          Himanshu Gahlot
        2. CHUKWA-589_2.patch
          19 kB
          Shweta Shah
        3. CHUKWA-589_3.patch
          20 kB
          Shweta Shah

          Activity

            People

            • Assignee:
              hgahlot Himanshu Gahlot
              Reporter:
              hgahlot Himanshu Gahlot
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: