Uploaded image for project: 'Mahout'
  1. Mahout
  2. MAHOUT-673

Stochastic projection (SSVD) to use 64bit murmur hash to produce uniform distribution matrix elements

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 0.4
    • 0.5, 0.6
    • None
    • None

    Description

      So, per earlier discussion on the list: for random matrix Omega in stochastic projection, let's use murmur hash to generate uniformly distributed elements in a closed interval (-1,+1] instead of using Random.nextGaussian().

      I am not sure if there's really compelling mathematical reason to do this but maybe it's just faster and more inline with practice accepted in Mahout for all this.

      The murmur 64bit value is already in the code. I just need to figure the optimal way to convert it into a uniform distribution.

      Github url for this issue tree: https://github.com/dlyubimov/mahout-commits/branches/MAHOUT-673, pull requests are welcome.

      Attachments

        1. MAHOUT-673-1.patch
          3 kB
          Dmitriy Lyubimov
        2. MAHOUT-673-1.patch
          3 kB
          Dmitriy Lyubimov

        Activity

          People

            dlyubimov Dmitriy Lyubimov
            dlyubimov Dmitriy Lyubimov
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: