[HADOOP-8654] TextInputFormat delimiter bug:- Input Text portion ends with & Delimiter starts with same char/char sequence

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.20.204.0, 1.0.3, 0.21.0, 2.0.0-alpha
• Fix Version/s: 2.0.2-alpha
• Component/s: util
• Labels: patch

Environment

Linux

• Target Version/s: 2.0.2-alpha
• Tags: TextInputFormat record delimiter
• Assignee: Unassigned
• Reporter: Gelesh
• Created: 03/Aug/12 15:56
• Updated: 04/Sep/14 00:59
• Resolved: 16/Aug/12 14:25

Description

TextInputFormat delimiter bug scenario , a character sequence of the input text, in which the first character matches with the first character of delimiter, and the remaining input text character sequence matches with the entire delimiter character sequence from the starting position of the delimiter.

eg delimiter ="record";
and Text =" record 1:- name = Gelesh e mail = [e-mail] Location Bangalore record 2: name = sdf .. location =Bangalorrecord 3: name .... "

Here string "=Bangalorrecord 3: " satisfy two conditions
1) contains the delimiter "record"
2) The character / character sequence immediately before the delimiter (ie ' r ') matches with first character (or character sequence ) of delimiter. (ie "=Bangalor" ends with and Delimiter starts with same character/char sequence 'r' ),

Here the delimiter is not encountered by the program resulting in improper value text in map that contains the delimiter