Uploaded image for project: 'Chukwa'
  1. Chukwa
  2. CHUKWA-278

Improve post process manager and metric data loader to support data loading from pig aggregation

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.2.0
    • Component/s: Data Processors
    • Labels:
      None
    • Environment:

      Redhat EL 5.1, Java 6

      Description

      The current post process manager loads sequence file to database only. Ideally, the post process manager should be able to load data into different data loader. Hence, DataLoaderFactory should be defined as an interface or abstract class for third party to implement their own data loader. The current implementation of pig aggregator generates down sampled data as different record type. There should be a new capability for Metric Data Loader to identify table partition base on record type.

        Attachments

        1. CHUKWA-278-3.patch
          60 kB
          Eric Yang
        2. CHUKWA-278-2.patch
          74 kB
          Eric Yang
        3. CHUKWA-278-1.patch
          66 kB
          Eric Yang
        4. CHUKWA-278.patch
          64 kB
          Eric Yang

          Activity

            People

            • Assignee:
              eyang Eric Yang
              Reporter:
              eyang Eric Yang
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: