Hive
  1. Hive
  2. HIVE-885

Better error messages for debugging serde problem at reducer input

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.5.0
    • Fix Version/s: 0.5.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Sometimes we are seeing serde exceptions at the reducer side with hadoop 0.20.
      This should help debug the problem.

        Activity

        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Patch Available Patch Available
        17m 3s 1 Zheng Shao 17/Oct/09 23:57
        Patch Available Patch Available Resolved Resolved
        3d 6h 5m 1 Namit Jain 21/Oct/09 06:03
        Resolved Resolved Closed Closed
        786d 19h 3m 1 Carl Steinbach 17/Dec/11 00:06
        Carl Steinbach made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Namit Jain made changes -
        Resolution Fixed [ 1 ]
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Fix Version/s 0.5.0 [ 12314156 ]
        Hide
        Namit Jain added a comment -

        Committed. Thanks Zheng.

        Show
        Namit Jain added a comment - Committed. Thanks Zheng.
        Hide
        Zheng Shao added a comment -

        Yes, that is determined by ExecDriver.java:437:

            job.setMapOutputValueClass(BytesWritable.class);
        
        Show
        Zheng Shao added a comment - Yes, that is determined by ExecDriver.java:437: job.setMapOutputValueClass(BytesWritable.class);
        Hide
        Ashish Thusoo added a comment -

        Will values.next() always return a BytesWritable?

        Show
        Ashish Thusoo added a comment - Will values.next() always return a BytesWritable?
        Zheng Shao made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Affects Version/s 0.5.0 [ 12314156 ]
        Zheng Shao made changes -
        Assignee Zheng Shao [ zshao ]
        Zheng Shao made changes -
        Field Original Value New Value
        Attachment HIVE-885.1.patch [ 12422465 ]
        Zheng Shao created issue -

          People

          • Assignee:
            Zheng Shao
            Reporter:
            Zheng Shao
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development