Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-2245

Service to periodically check database schema

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 5.0.0b1
    • core
    • None

    Description

      We've seen a number of issues related to the database schema being incorrect (more than you would think). It seems some users go and muck around in the Oozie database, adding/removing columns and indexes, changing the default value of columns, etc. The issues caused by this can be very difficult to track down because their cause is not obvious and we generally assume the database schema is correct. For example, we saw an issue where Oozie was taking a long time to create Coordinator actions, and it turned out that the cause was that some indexes were missing, which made the Purge queries slow, which slowed down the whole database whenever the PurgeService ran. Another example was that the pause time was automatically being set whenever a Coordinator job was submitted, because the default value for the column was incorrect.

      We should create a Service which periodically runs and checks that the schema is correct. It can output details about what's wrong to the log.

      Attachments

        1. OOZIE-2245.003.patch
          31 kB
          Robert Kanter
        2. OOZIE-2245.002.patch
          29 kB
          Robert Kanter
        3. OOZIE-2245.patch
          29 kB
          Robert Kanter

        Issue Links

          Activity

            People

              rkanter Robert Kanter
              rkanter Robert Kanter
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: