Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-5029

Add utilities to load chukwa sequence file to database

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Environment:

      RedHat EL 5.1, Java 6

    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      What is new in HADOOP-5029:

      - Added mdl script to manually load chukwa sequence file to database.
      Show
      What is new in HADOOP-5029 : - Added mdl script to manually load chukwa sequence file to database.

      Description

      When data need to be reprocessed in the database, there is currently no manual method to reload the chukwa sequence files into database.
      A few minor tweaks to MetricsDataLoader should be possible to create a command line utility to do this.

        Activity

        Hide
        eyang Eric Yang added a comment -
        • Added SQL batching limit for MetricsDataLoader.
        • Updated parameter passing to MetricsDataLoader.
        • Added shell script to accept parameter for loading sequence file to database manually.
        Show
        eyang Eric Yang added a comment - Added SQL batching limit for MetricsDataLoader. Updated parameter passing to MetricsDataLoader. Added shell script to accept parameter for loading sequence file to database manually.
        Hide
        asrabkin Ari Rabkin added a comment -

        +1

        Show
        asrabkin Ari Rabkin added a comment - +1
        Hide
        hudson Hudson added a comment -
        Show
        hudson Hudson added a comment - Integrated in Hadoop-trunk #778 (See http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/778/ )

          People

          • Assignee:
            eyang Eric Yang
            Reporter:
            eyang Eric Yang
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development