Uploaded image for project: 'Ignite'
  1. Ignite
  2. IGNITE-4461

Hadoop: automatically define best "partially raw" comparator based on key type

    XMLWordPrintableJSON

Details

    • Task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.8
    • 2.0
    • hadoop
    • None

    Description

      We have special PartiallyRawComparator interface which provides nice speedup by removing unnecessary objects deserializations during insert into result multi-map. And we have a one implementation for now for Text class: TextPartiallyRawComparator.

      We should do the following:
      1) Try guessing proper comparator in runtime using JobConf.getOutputKeyClass() property.
      2) Add ability to disable this automatic resolution.

      Attachments

        Activity

          People

            vozerov Vladimir Ozerov
            vozerov Vladimir Ozerov
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: