Index: src/java/org/apache/lucene/analysis/standard/READ_BEFORE_REGENERATING.txt =================================================================== --- src/java/org/apache/lucene/analysis/standard/READ_BEFORE_REGENERATING.txt (revision 0) +++ src/java/org/apache/lucene/analysis/standard/READ_BEFORE_REGENERATING.txt (revision 0) @@ -0,0 +1,7 @@ +WARNING: if you change StandardTokenizerImpl.jflex and need to regenerate + the tokenizer, only use Java 1.4 !!! + This grammar currently uses constructs (eg :digit:, :letter:) whose + meaning can vary according to the JRE used to run jflex. See + https://issues.apache.org/jira/browse/LUCENE-1126 for details. + For current backwards compatibility it is needed to support + only Java 1.4 - this will change in Lucene 3.1. Property changes on: src\java\org\apache\lucene\analysis\standard\READ_BEFORE_REGENERATING.txt ___________________________________________________________________ Added: svn:keywords + Date Author Id Revision HeadURL Added: svn:eol-style + native Index: src/java/org/apache/lucene/analysis/standard/StandardTokenizerImpl.java =================================================================== --- src/java/org/apache/lucene/analysis/standard/StandardTokenizerImpl.java (revision 880749) +++ src/java/org/apache/lucene/analysis/standard/StandardTokenizerImpl.java (working copy) @@ -21,11 +21,13 @@ /* -NOTE: if you change this file and need to regenerate the tokenizer, - remember to use JRE 1.4 when running jflex (before Lucene 3.0). - This grammar now uses constructs (eg :digit:) whose meaning can - vary according to the JRE used to run jflex. See - https://issues.apache.org/jira/browse/LUCENE-1126 for details +WARNING: if you change StandardTokenizerImpl.jflex and need to regenerate + the tokenizer, only use Java 1.4 !!! + This grammar currently uses constructs (eg :digit:, :letter:) whose + meaning can vary according to the JRE used to run jflex. See + https://issues.apache.org/jira/browse/LUCENE-1126 for details. + For current backwards compatibility it is needed to support + only Java 1.4 - this will change in Lucene 3.1. */ Index: src/java/org/apache/lucene/analysis/standard/StandardTokenizerImpl.jflex =================================================================== --- src/java/org/apache/lucene/analysis/standard/StandardTokenizerImpl.jflex (revision 880749) +++ src/java/org/apache/lucene/analysis/standard/StandardTokenizerImpl.jflex (working copy) @@ -19,12 +19,13 @@ /* -NOTE: if you change StandardTokenizerImpl.jflex and need to regenerate - the tokenizer, remember to use JRE 1.4 to run jflex (before - Lucene 3.0). This grammar now uses constructs (eg :digit:, - :letter:) whose meaning can vary according to the JRE used to - run jflex. See +WARNING: if you change StandardTokenizerImpl.jflex and need to regenerate + the tokenizer, only use Java 1.4 !!! + This grammar currently uses constructs (eg :digit:, :letter:) whose + meaning can vary according to the JRE used to run jflex. See https://issues.apache.org/jira/browse/LUCENE-1126 for details. + For current backwards compatibility it is needed to support + only Java 1.4 - this will change in Lucene 3.1. */