Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-1486

Cut down on number of small files created to track a running action

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: trunk
    • Fix Version/s: 4.1.0
    • Component/s: None

      Description

      Oozie creates multiple files while running a action. This has been observed to be an overkill and can be consolidated (as applicable) into a lesser files. Advantages involve not only staying within user storage quotas but also reducing Namenode pressure in a large production environment.

      static final String ACTION_CONF_XML = "action.xml";
      public static final String ACTION_PREPARE_XML = "oozie.action.prepare.xml";
      private static final String ACTION_OUTPUT_PROPS = "output.properties";
      private static final String ACTION_STATS_PROPS = "stats.properties";
      private static final String ACTION_EXTERNAL_CHILD_IDS_PROPS =
      "externalChildIds.properties";
      private static final String ACTION_NEW_ID_PROPS = "newId.properties";
      private static final String ACTION_ERROR_PROPS = "error.properties";

      Consolidate and reduce the number of files required.

        Attachments

        1. OOZIE-1486.patch
          92 kB
          Mona Chitnis
        2. OOZIE-1486.patch
          91 kB
          Mona Chitnis
        3. OOZIE-1486.patch
          75 kB
          Mona Chitnis

          Issue Links

          There are no Sub-Tasks for this issue.

            Activity

              People

              • Assignee:
                chitnis Mona Chitnis
                Reporter:
                chitnis Mona Chitnis
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - 3h
                  3h
                  Remaining:
                  Remaining Estimate - 3h
                  3h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified