Details

    • Type: Improvement Improvement
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 0.90.1
    • Fix Version/s: None
    • Component/s: scripts
    • Labels:
      None

      Description

      The settings we ship with aren't really optimal for an actual deployment. We can take a look at some things like /proc/cpuinfo and figure out whether to enable parallel GC, turn off CMSIncrementalMode, etc.

      1. hbase-env.sh
        3 kB
        Ted Yu
      2. hbase-3457.txt
        3 kB
        Todd Lipcon
      3. hbase-3457.txt
        3 kB
        Todd Lipcon

        Activity

        Hide
        Todd Lipcon added a comment -

        What do y'all think about something like this?

        Show
        Todd Lipcon added a comment - What do y'all think about something like this?
        Hide
        Todd Lipcon added a comment -

        Take two, accidentally made patch against an old tree

        Show
        Todd Lipcon added a comment - Take two, accidentally made patch against an old tree
        Hide
        stack added a comment -

        +1

        Its great. Better than what we had.

        Show
        stack added a comment - +1 Its great. Better than what we had.
        Hide
        Ted Yu added a comment -

        When patch applied to attached hbase-env.sh, I saw duplicate parameters:

        -Xmx4000m -ea -XX:+HeapDumpOnOutOfMemoryError -Xmx4000m -Xms4000m -Xmn400m -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+UseCMSInitiatingOccupancyOnly -XX:+UseParNewGC -XX:+CMSParallelRemarkEnabled -ea -XX:+HeapDumpOnOutOfMemoryError -Xmx4000m -Xms4000m -Xmn400m -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+UseCMSInitiatingOccupancyOnly -XX:+UseParNewGC -XX:+CMSParallelRemarkEnabled -ea -XX:+HeapDumpOnOutOfMemoryError -Xmx4000m -Xms4000m -Xmn400m -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+UseCMSInitiatingOccupancyOnly -XX:+UseParNewGC -XX:+CMSParallelRemarkEnabled
        
        Show
        Ted Yu added a comment - When patch applied to attached hbase-env.sh, I saw duplicate parameters: -Xmx4000m -ea -XX:+HeapDumpOnOutOfMemoryError -Xmx4000m -Xms4000m -Xmn400m -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+UseCMSInitiatingOccupancyOnly -XX:+UseParNewGC -XX:+CMSParallelRemarkEnabled -ea -XX:+HeapDumpOnOutOfMemoryError -Xmx4000m -Xms4000m -Xmn400m -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+UseCMSInitiatingOccupancyOnly -XX:+UseParNewGC -XX:+CMSParallelRemarkEnabled -ea -XX:+HeapDumpOnOutOfMemoryError -Xmx4000m -Xms4000m -Xmn400m -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+UseCMSInitiatingOccupancyOnly -XX:+UseParNewGC -XX:+CMSParallelRemarkEnabled
        Hide
        stack added a comment -

        Marking patch available (though seems like patch needs some work going by Ted's report)

        Show
        stack added a comment - Marking patch available (though seems like patch needs some work going by Ted's report)
        Hide
        Jean-Daniel Cryans added a comment -

        Todd is busy saving the world, he told me I can punt it to 0.90.3

        Show
        Jean-Daniel Cryans added a comment - Todd is busy saving the world, he told me I can punt it to 0.90.3
        Hide
        Jean-Daniel Cryans added a comment -

        With Todd playing the world traveller and since this is an improvement, I'm punting to 0.92

        Show
        Jean-Daniel Cryans added a comment - With Todd playing the world traveller and since this is an improvement, I'm punting to 0.92
        Hide
        stack added a comment -

        Moving out of 0.92.0. Pull it back in if you think different.

        Show
        stack added a comment - Moving out of 0.92.0. Pull it back in if you think different.
        Hide
        Jean-Daniel Cryans added a comment -

        Unmarking patch available to trigger discussion.

        Show
        Jean-Daniel Cryans added a comment - Unmarking patch available to trigger discussion.

          People

          • Assignee:
            Todd Lipcon
            Reporter:
            Todd Lipcon
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:

              Development