Uploaded image for project: 'Giraph'
  1. Giraph
  2. GIRAPH-312

Giraph needs an admin script

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 1.0.0
    • Fix Version/s: 1.0.0
    • Component/s: conf and scripts, zookeeper
    • Labels:
      None

      Description

      Our zookeeper instances have very long uptimes on our cluster, and failed job trees are never cleaned from memory. There is a separate shell script to do this, but its not picky about which node trees it erases, and on some systems some Giraph users may not have access to it.

      This patch will add a shell script to activate a new class which will use Giraph conf file options or our normal -Dgiraph.XYZ command-line opts to get the ZK quorum info, and clean out the remnants from its memory of old failed and killed jobs. They do pile up over time.

      This led to the larger idea that Giraph needs a general giraph-admin shell script as a home for stuff like this. Jakob suggested it would be a good idea to put this into such a script since then admin groups can be created so that not every Giraph client can run it. This script currently only has code to start up the zk cleaner, but can have more options added to it as JIRA's to add features crop up.

        Attachments

        1. GIRAPH-312-8.patch
          14 kB
          Eli Reisman
        2. GIRAPH-312-7.patch
          14 kB
          Eli Reisman
        3. GIRAPH-312-6.patch
          14 kB
          Eli Reisman
        4. GIRAPH-312-5.patch
          14 kB
          Eli Reisman
        5. GIRAPH-312-4.patch
          13 kB
          Eli Reisman
        6. GIRAPH-312-3.patch
          13 kB
          Eli Reisman
        7. GIRAPH-312-3.patch
          13 kB
          Eli Reisman
        8. GIRAPH-312-2.patch
          10 kB
          Eli Reisman
        9. GIRAPH-312-1.patch
          10 kB
          Eli Reisman

          Issue Links

            Activity

              People

              • Assignee:
                initialcontext Eli Reisman
                Reporter:
                initialcontext Eli Reisman
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: