Uploaded image for project: 'Chukwa'
  1. Chukwa
  2. CHUKWA-819

Add CaffeONSpark support to Chukwa for memory leak detection

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.8.0
    • Fix Version/s: 0.9.0
    • Component/s: None
    • Labels:
      None

      Description

      Computer vision algorithm can be used to detect patterns in common problems. This new feature is design to automate some troubleshooting advise that can be identified by looking at metrics chart patterns.

      CaffeOnSpark is a computer vision library that can be used for enforced machine learning training to classify common traits that might be detectable by visualization.

      This feature is composed of:

      1. Metrics to graph generator
      2. Caffe on Spark configuration for categorizing problems.
      3. Docker scripts to show end to end integration
      4. Documentation on how to use the training framework.

        Activity

        Hide
        eyang Eric Yang added a comment -

        Hi Fay,

        This new feature can be quite big on it's own. It would be nice to describe the motivation, and the design, then open sub-tasks to describe each required components to accomplish the sub-goals to reach completion of what you are proposing.

        Show
        eyang Eric Yang added a comment - Hi Fay, This new feature can be quite big on it's own. It would be nice to describe the motivation, and the design, then open sub-tasks to describe each required components to accomplish the sub-goals to reach completion of what you are proposing.
        Hide
        Fay Wang Fay Wang added a comment -

        Hi Eric, I don't have permission to create epic. Could you create an epic to address the issue of applying machine learning to hadoop problem determination ? I will then create sub-tasks under it. Thanks!

        Show
        Fay Wang Fay Wang added a comment - Hi Eric, I don't have permission to create epic. Could you create an epic to address the issue of applying machine learning to hadoop problem determination ? I will then create sub-tasks under it. Thanks!
        Hide
        eyang Eric Yang added a comment -
        Show
        eyang Eric Yang added a comment - Pull request: https://github.com/apache/chukwa/pull/6
        Hide
        eyang Eric Yang added a comment -

        +1 Looks good. Thank you Fay.

        Show
        eyang Eric Yang added a comment - +1 Looks good. Thank you Fay.

          People

          • Assignee:
            Fay Wang Fay Wang
            Reporter:
            Fay Wang Fay Wang
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development