Hadoop Common
  1. Hadoop Common
  2. HADOOP-2302

Streaming should provide an option for numerical sort of keys

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.19.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Introduced numerical key comparison for streaming.

      Description

      It would be good to have an option for numerical sort of keys for streaming.

      1. 2302-new2.patch
        52 kB
        Devaraj Das
      2. 2302-new1.patch
        52 kB
        Devaraj Das
      3. 2302-new.patch
        52 kB
        Devaraj Das
      4. 2302-new.patch
        51 kB
        Devaraj Das
      5. 2302.3.patch
        43 kB
        Devaraj Das
      6. 2302.1.patch
        41 kB
        Devaraj Das

        Activity

        Lohit Vijayarenu created issue -
        Lohit Vijayarenu made changes -
        Field Original Value New Value
        Issue Type Bug [ 1 ] Improvement [ 4 ]
        Devaraj Das made changes -
        Assignee Devaraj Das [ devaraj ]
        Devaraj Das made changes -
        Fix Version/s 0.19.0 [ 12313211 ]
        Devaraj Das made changes -
        Attachment 2302.1.patch [ 12386652 ]
        Devaraj Das made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Devaraj Das made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Devaraj Das made changes -
        Attachment 2302.3.patch [ 12386822 ]
        Devaraj Das made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Devaraj Das made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Devaraj Das made changes -
        Attachment 2302-new.patch [ 12387221 ]
        Devaraj Das made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Devaraj Das made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Devaraj Das made changes -
        Attachment 2302-new.patch [ 12387255 ]
        Devaraj Das made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Devaraj Das made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Devaraj Das made changes -
        Attachment 2302-new1.patch [ 12387272 ]
        Devaraj Das made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Devaraj Das made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Devaraj Das made changes -
        Attachment 2302-new2.patch [ 12387506 ]
        Devaraj Das made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Devaraj Das made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Resolution Fixed [ 1 ]
        Release Note Provides a way to compare keys using numerical comparison. The key specification of the form -k pos1[,pos2], is supported, where,
           * pos is of the form f[.c][opts], where f is the number of the key field to use, and c is the number of the first character from the beginning of the field. Fields and character posns are numbered starting with 1; a character position of zero in pos2 indicates the field's last character. If '.c' is omitted from pos1, it defaults to 1 (the beginning of the field); if omitted from pos2, it defaults to 0 (the end of the field). opts are ordering options. The supported options are:
           * -n, (Sort numerically)
           * -r, (Reverse the result of comparison)
        Multiple key specifications can be provided to sort on multiple key fields (in order). The key fields are assumed to be separated using map.output.key.field.separator. Specifying only -n as an option will make the comparator treat the all key bytes as one field.
        Robert Chansler made changes -
        Release Note Provides a way to compare keys using numerical comparison. The key specification of the form -k pos1[,pos2], is supported, where,
           * pos is of the form f[.c][opts], where f is the number of the key field to use, and c is the number of the first character from the beginning of the field. Fields and character posns are numbered starting with 1; a character position of zero in pos2 indicates the field's last character. If '.c' is omitted from pos1, it defaults to 1 (the beginning of the field); if omitted from pos2, it defaults to 0 (the end of the field). opts are ordering options. The supported options are:
           * -n, (Sort numerically)
           * -r, (Reverse the result of comparison)
        Multiple key specifications can be provided to sort on multiple key fields (in order). The key fields are assumed to be separated using map.output.key.field.separator. Specifying only -n as an option will make the comparator treat the all key bytes as one field.
        Introduced numerical key comparison for streaming.
        Nigel Daley made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Owen O'Malley made changes -
        Component/s contrib/streaming [ 12310972 ]

          People

          • Assignee:
            Devaraj Das
            Reporter:
            Lohit Vijayarenu
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development