Uploaded image for project: 'Ignite'
  1. Ignite
  2. IGNITE-14769

Key hash calculation.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0-alpha4
    • None
    • Docs Required, Release Notes Required

    Description

      There are next possible ways for cache calculation.

      1. Update hash on every write method call as it works for now.
      2. Calculate for all key chunk (hash of byte[]) - all columns including a null-map.

      Let's choose and implement the best way and along with a better hash function,
      e.g. xxHash64 [1], Murmur3 [2]released in Apache Commons, CityHash (from Google) [3], FastHash32 [4].

       

      [1]https://github.com/Cyan4973/xxHash/

      [2]https://commons.apache.org/proper/commons-codec/jacoco/org.apache.commons.codec.digest/MurmurHash3.java.html

      [3] https://github.com/google/cityhash

      [4] https://github.com/rurban/smhasher/blob/master/fasthash.cpp

      Attachments

        1. Partition count 1024.png
          48 kB
          Konstantin Orlov
        2. Partition count 100.png
          24 kB
          Konstantin Orlov
        3. Partition count 128.png
          36 kB
          Konstantin Orlov
        4. Partition count 32.png
          17 kB
          Konstantin Orlov
        5. Partition count 480.png
          56 kB
          Konstantin Orlov
        6. Partition count 8.png
          14 kB
          Konstantin Orlov
        7. Partition count 1024 (rnd).png
          64 kB
          Konstantin Orlov
        8. Partition count 16 (rnd).png
          28 kB
          Konstantin Orlov
        9. Partition count 480 (rnd).png
          66 kB
          Konstantin Orlov
        10. Partition count 128 (rnd).png
          77 kB
          Konstantin Orlov

        Issue Links

          Activity

            People

              korlov Konstantin Orlov
              amashenkov Andrey Mashenkov
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - 96h
                  96h
                  Remaining:
                  Remaining Estimate - 95h 50m
                  95h 50m
                  Logged:
                  Remaining Estimate - 95h 50m
                  10m