Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-16956

Introduce inverse quantiles for metrics where higher numeric value is better

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.3.0, 3.4.0
    • None
    • datanode, metrics
    • None

    Description

      Currently quantiles are used for latencies, where lower numeric value is better.

      Hence p90 gives us a value val(p90) such that 90% of our sample set has a value better (lower) than val(p90)

       

      However for metrics such as calculating transfer rates (eg : HDFS-16917 ) higher numeric value is better. Thus for such metrics the current quantiles dont work.

      For these metrics in order for p90 to give a value val(p90) where 90% of the sample set is better (higher) than val(p90) we need to inverse the selection by choosing a value at the (100 - 90)th location instead of the usual 90th position.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            rdingankar Ravindra Dingankar

            Dates

              Created:
              Updated:

              Slack

                Issue deployment