Uploaded image for project: 'Chukwa'
  1. Chukwa
  2. CHUKWA-318

Stop the collector if there's less than XX% capacity

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.2.0, 0.3.0
    • Fix Version/s: 0.2.0, 0.3.0
    • Component/s: Data Collection
    • Labels:
      None

      Description

      The localWriter is writting to the localFileSystem. The improvement is to add a protection on the available disk space.

      1. CHUKWA-318.patch
        3 kB
        Jerome Boulon

        Activity

        Hide
        asrabkin Ari Rabkin added a comment -

        It should also be possible to specify a policy "push data once there's X megabytes accumulated."

        Show
        asrabkin Ari Rabkin added a comment - It should also be possible to specify a policy "push data once there's X megabytes accumulated."
        Hide
        jboulon Jerome Boulon added a comment - - edited

        Ideally you don't want to wait before pushing data. You already have a way to control how frequent you want to close the dataSink file so I assume if the rotate period is set to 5 minutes it's because you want to get what ever is available every 5 minutes, correct?
        But the rotate function could be changed to close on another condition (rotate policy)

        Show
        jboulon Jerome Boulon added a comment - - edited Ideally you don't want to wait before pushing data. You already have a way to control how frequent you want to close the dataSink file so I assume if the rotate period is set to 5 minutes it's because you want to get what ever is available every 5 minutes, correct? But the rotate function could be changed to close on another condition (rotate policy)
        Hide
        jboulon Jerome Boulon added a comment -

        Check for disk space while rotating

        Show
        jboulon Jerome Boulon added a comment - Check for disk space while rotating
        Hide
        eyang Eric Yang added a comment -

        +1 looks good.

        Show
        eyang Eric Yang added a comment - +1 looks good.
        Hide
        eyang Eric Yang added a comment -

        I just committed this, thanks Jerome.

        Show
        eyang Eric Yang added a comment - I just committed this, thanks Jerome.
        Hide
        hudson Hudson added a comment -
        Show
        hudson Hudson added a comment - Integrated in Chukwa-trunk #61 (See http://hudson.zones.apache.org/hudson/job/Chukwa-trunk/61/ )

          People

          • Assignee:
            jboulon Jerome Boulon
            Reporter:
            jboulon Jerome Boulon
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development