Mailing List Archive

cvs commit: jakarta-lucene/src/java/org/apache/lucene/analysis/standard StandardTokenizer.jj
otis 2002/06/04 21:54:47

Modified: src/java/org/apache/lucene/analysis/standard
StandardTokenizer.jj
Log:
- Changed the grammar for EMAIL token in order to match user names and
host names with additional valid user name and host name characters, such
as '.", '-', and '_'.

Revision Changes Path
1.3 +1 -1 jakarta-lucene/src/java/org/apache/lucene/analysis/standard/StandardTokenizer.jj

Index: StandardTokenizer.jj
===================================================================
RCS file: /home/cvs/jakarta-lucene/src/java/org/apache/lucene/analysis/standard/StandardTokenizer.jj,v
retrieving revision 1.2
retrieving revision 1.3
diff -u -r1.2 -r1.3
--- StandardTokenizer.jj 25 Sep 2001 18:38:50 -0000 1.2
+++ StandardTokenizer.jj 5 Jun 2002 04:54:47 -0000 1.3
@@ -103,7 +103,7 @@
| <COMPANY: <ALPHA> ("&"|"@") <ALPHA> >

// email addresses
-| <EMAIL: <ALPHANUM> "@" <ALPHANUM> ("." <ALPHANUM>)+ >
+| <EMAIL: <ALPHANUM> ("."|"-"|"_" <ALPHANUM>)+ "@" <ALPHANUM> ("."|"-" <ALPHANUM>)+ >

// hostname
| <HOST: <ALPHANUM> ("." <ALPHANUM>)+ >




--
To unsubscribe, e-mail: <mailto:lucene-dev-unsubscribe@jakarta.apache.org>
For additional commands, e-mail: <mailto:lucene-dev-help@jakarta.apache.org>