Chukwa
  1. Chukwa
  2. CHUKWA-589

Functionality allowing collectors to close .chukwa files at a fixed offset inside the rotateInterval

    Details

    • Type: New Feature New Feature
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.5.0
    • Fix Version/s: 0.5.0
    • Component/s: Data Collection
    • Labels:
      None
    • Release Note:
      Allow collectors to close .chukwa files at fixed offset.

      Description

      We have a system built on top of Chukwa that introduces the need to have all .chukwa files for a given rotateInterval closed and available at a predictable time. Currently, we are experience some drift in the times that the sequence files are closed due to the way the TimerTask is scheduled in the SeqFileWriter class. We would like to submit a solution that will allow people to configure the time all collectors should close their files for processing in a given interval, while still supporting the default functionality.

      1. CHUKWA-589_1.patch
        18 kB
        Himanshu Gahlot
      2. CHUKWA-589_2.patch
        19 kB
        Shweta Shah
      3. CHUKWA-589_3.patch
        20 kB
        Shweta Shah

        Activity

          People

          • Assignee:
            Himanshu Gahlot
            Reporter:
            Himanshu Gahlot
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development