Hive
  1. Hive
  2. HIVE-885

Better error messages for debugging serde problem at reducer input

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.5.0
    • Fix Version/s: 0.5.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Sometimes we are seeing serde exceptions at the reducer side with hadoop 0.20.
      This should help debug the problem.

        Activity

        Hide
        Namit Jain added a comment -

        Committed. Thanks Zheng.

        Show
        Namit Jain added a comment - Committed. Thanks Zheng.
        Hide
        Zheng Shao added a comment -

        Yes, that is determined by ExecDriver.java:437:

            job.setMapOutputValueClass(BytesWritable.class);
        
        Show
        Zheng Shao added a comment - Yes, that is determined by ExecDriver.java:437: job.setMapOutputValueClass(BytesWritable.class);
        Hide
        Ashish Thusoo added a comment -

        Will values.next() always return a BytesWritable?

        Show
        Ashish Thusoo added a comment - Will values.next() always return a BytesWritable?

          People

          • Assignee:
            Zheng Shao
            Reporter:
            Zheng Shao
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development