Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-3134

Potential inconsistency between the in-memory SLA map and the Oozie database

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 5.1.0
    • Component/s: None
    • Labels:
      None

      Description

      Upon SLACalculatorMemory.addRegistration, Oozie puts an entry into an in-memory concurrent hashmap ("slaMap"), and later persists it in the Oozie database.

      However, if there is a failure during the database operation, a JPAExecutorException is thrown, and the entry is not removed from the SLA map.
      It may introduce inconsistency between the Oozie database and the SLA map.

      To prevent this, a rollback mechanism (with proper logging) should be implemented. It would also make sense to do more sanity/consistency check in the Oozie server.

        Attachments

        1. OOZIE-3134-007.patch
          18 kB
          Kinga Marton
        2. OOZIE-3134-006.patch
          18 kB
          Kinga Marton
        3. OOZIE-3134-005.patch
          17 kB
          Kinga Marton
        4. OOZIE-3134-004.patch
          17 kB
          Kinga Marton
        5. OOZIE-3134-003.patch
          17 kB
          Kinga Marton
        6. OOZIE-3134-002.patch
          17 kB
          Kinga Marton
        7. OOZIE-3134-001.patch
          15 kB
          Kinga Marton

          Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. OOZIE-3260 [sla] Remove stale item above max retries on JPA related errors from in-memory SLA map

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. OOZIE-1980 Sql error should not fail coord job

          • Major - Major loss of function.
          • Patch Available
          links to

          Web Link Review board

            Activity

              People

              • Assignee:
                kmarton Kinga Marton
                Reporter:
                asasvari Attila Sasvári
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: