Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.7.0
    • Fix Version/s: 0.7.0
    • Component/s: UDF
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      This is a poor man's answer to the standard analytic function row_number(); it assigns a sequence of numbers to rows, starting from 1.

      I'm calling it row_sequence() to distinguish it from the real analytic function, so that once we add support for those, there won't be any conflict with the existing UDF.

      The problem with this UDF approach is that there are no guarantees about ordering in SQL processing internals, so use with caution.

      1. HIVE-1304.3.patch
        12 kB
        John Sichi
      2. HIVE-1304.2.patch
        9 kB
        John Sichi
      3. ASF.LICENSE.NOT.GRANTED--HIVE-1304.1.patch
        9 kB
        John Sichi

        Issue Links

          Activity

          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Patch Available Patch Available Open Open
          4h 18m 2 John Sichi 23/Jun/10 00:00
          Open Open Patch Available Patch Available
          69d 22h 40m 3 John Sichi 23/Jun/10 01:29
          Patch Available Patch Available Resolved Resolved
          6h 46m 1 Namit Jain 23/Jun/10 08:16
          Resolved Resolved Closed Closed
          541d 16h 43m 1 Carl Steinbach 16/Dec/11 23:59
          Carl Steinbach made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Carl Steinbach made changes -
          Affects Version/s 0.7.0 [ 12315150 ]
          Affects Version/s 0.6.0 [ 12314524 ]
          Component/s UDF [ 12313585 ]
          Component/s Query Processor [ 12312586 ]
          Namit Jain made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags [Reviewed]
          Resolution Fixed [ 1 ]
          Hide
          Namit Jain added a comment -

          Committed. Thanks John

          Show
          Namit Jain added a comment - Committed. Thanks John
          Hide
          Namit Jain added a comment -

          +1

          will commit if the tests pass

          Show
          Namit Jain added a comment - +1 will commit if the tests pass
          John Sichi made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          John Sichi added a comment -

          New patch with test moved to contrib, and DESCRIBE and EXPLAIN thrown in for good measure.

          Show
          John Sichi added a comment - New patch with test moved to contrib, and DESCRIBE and EXPLAIN thrown in for good measure.
          John Sichi made changes -
          Attachment HIVE-1304.3.patch [ 12447780 ]
          John Sichi made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Hide
          John Sichi added a comment -

          Oops, need to move test to contrib too.

          Show
          John Sichi added a comment - Oops, need to move test to contrib too.
          John Sichi made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          John Sichi added a comment -

          New patch addresses Namit's comments.

          Show
          John Sichi added a comment - New patch addresses Namit's comments.
          John Sichi made changes -
          Attachment HIVE-1304.2.patch [ 12447732 ]
          John Sichi made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Hide
          Namit Jain added a comment -

          Can you explicitly set the number of reducers to 1, so ensure same results ? It doesn't matter today, but should be a issue with miniMr etc.
          Also, do you want to keep it in contrib - since this is not guaranteed - multiple mappers may give same results etc.

          Show
          Namit Jain added a comment - Can you explicitly set the number of reducers to 1, so ensure same results ? It doesn't matter today, but should be a issue with miniMr etc. Also, do you want to keep it in contrib - since this is not guaranteed - multiple mappers may give same results etc.
          John Sichi made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          John Sichi made changes -
          Fix Version/s 0.7.0 [ 12315150 ]
          Affects Version/s 0.6.0 [ 12314524 ]
          Affects Version/s 0.7.0 [ 12315150 ]
          John Sichi made changes -
          Affects Version/s 0.7.0 [ 12315150 ]
          Affects Version/s 0.6.0 [ 12314524 ]
          John Sichi made changes -
          Fix Version/s 0.6.0 [ 12314524 ]
          Jeff Hammerbacher made changes -
          Link This issue is related to HIVE-896 [ HIVE-896 ]
          John Sichi made changes -
          Component/s Query Processor [ 12312586 ]
          Component/s Metastore [ 12312584 ]
          Hide
          Edward Capriolo added a comment -

          Can we work on... https://issues.apache.org/jira/browse/HIVE-1265..first.

          As of now commits on UDF's is a major pain. Two or three times already I had had to regenerate UDFs because someone else touched the FunctionRegistry. I have had two or three waves of UDF's I want to commit ReflectionUDF, MathUDF, EncryptionUDF but something else sneaks in and I have to regenerate. It is a major pain.

          Show
          Edward Capriolo added a comment - Can we work on... https://issues.apache.org/jira/browse/HIVE-1265..first . As of now commits on UDF's is a major pain. Two or three times already I had had to regenerate UDFs because someone else touched the FunctionRegistry. I have had two or three waves of UDF's I want to commit ReflectionUDF, MathUDF, EncryptionUDF but something else sneaks in and I have to regenerate. It is a major pain.
          John Sichi made changes -
          Field Original Value New Value
          Attachment HIVE-1304.1.patch [ 12441655 ]
          John Sichi created issue -

            People

            • Assignee:
              John Sichi
              Reporter:
              John Sichi
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development