Uploaded image for project: 'Chukwa (retired)'
  1. Chukwa (retired)
  2. CHUKWA-504

Implement ability to delete file in FileAdaptor after successfully uploaded

Add voteWatch issue
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: In Progress
    • Minor
    • Resolution: Unresolved
    • 0.4.0
    • None
    • Data Collection
    • None

    Description

      My client's use case is to feed lots of little data files into the Chukwa system. They're collected first by a web API, saved to disk, and then a locally-running agent is notified with the path to the file name.

      Naturally, there's an issue of wasting disk space by keeping all the files around on the web nodes unnecessarily. So a simple addition of an optional "delete" parameter when adding a FileAdaptor appears to do the trick.

      Forthcoming is a patch against 0.4.0 that we used to achieve this. The parameter is optional in order to maintain compatibility.

      Attachments

        1. FileAdaptor.patch
          2 kB
          Kirk True

        Activity

          People

            asrabkin Ariel Shemaiah Rabkin
            kirktrue Kirk True

            Dates

              Created:
              Updated:

              Slack

                Issue deployment