Uploaded image for project: 'Chukwa (retired)'
  1. Chukwa (retired)
  2. CHUKWA-316

jobconf Error in mr_job_* table

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • 0.2.0
    • 0.2.0, 0.3.0
    • Data Processors
    • None
    • Redhat EL 5,1, Java 6

    Description

      The current mr_job table, jobconf columns contains the content of jobconf for some rows, and other rows contains the
      path of the jobconf.

      In the sequence file, jobconf is the field for location of the jobconf path. The content of the jobconf is
      JOBCONF-JSON. In database table, jobconf is the content of the jobconf. Unfortunately, the new automatic mapping will
      detect sequence file "jobconf" field is a match with "jobconf" column in the database. Hence the
      last update wins.

      To work around this problem, we need ability to undefine sequence file field to match to database column.

      Personally, I think indirect data translation mapping is the wrong thing to do. The mapping should be as straight forward as possible.

      Attachments

        1. CHUKWA-316-1.patch
          1 kB
          Eric Yang
        2. CHUKWA-316.patch
          1 kB
          Eric Yang

        Activity

          People

            eyang Eric Yang
            eyang Eric Yang
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: