XMLWordPrintableJSON

Details

    • Task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.3-incubating
    • 0.4
    • metrics

    Description

      We have a few metrics (Spatial/SeasonalStdDevRatio and similar PatternCorrelation ones) that do a temporal rebin. We've discussed this before, but I think it's worth revisiting.

      In my opinion, we shouldn't be doing rebins/regrids/manipulations during an evaluation unless it's 100% necessary for the metric to make sense. In other words:

      ds1 = ocw.local.load_file(...)
      ds2 = ocw.local.load_file(...)
      
      evaluation = Evaluation.evaluation(ds1, [ds2], [metrics.TemporalStdDevRatio()])
      evaluation.run()
      

      Should really be:

      ds1 = ocw.local.load_file(...)
      ds2 = ocw.local.load_file(...)
      
      ds1 = ocw.dataset_processor.temporal_rebin(ds1, ...)
      ds2 = ocw.dataset_processor.temporal_rebin(ds2, ...)
      
      evaluation = Evaluation.evaluation(ds1, [ds2], [metrics.StdDevRatio()])
      evaluation.run()
      

      That is a more correct usage of the redesigned API in my opinion.

      Thoughts? Comments? I'm going to send a PR for this change, but let's discuss please.

      Attachments

        Issue Links

          Activity

            People

              mjoyce Michael Joyce
              mjoyce Michael Joyce
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: