Mailing List Archive

Forgot to mention that this problem doesn't exist in RC2. I happens in Nov. 11 and Nov. 13 nightly builds.

-----Original Message-----
From: Paul Friedman [mailto:pfriedman@macromedia.com]
Sent: Wednesday, November 14, 2001 10:25 AM
To: 'lucene-user@jakarta.apache.org'
Subject: QueryParser error when "." in query string


Can somebody please help, this is a BIG issue for the project I'm working on?

I have attached a test case showing that QueryParser (using StandardAnalyzer) throws a TokenMgrError when parsing a query string that contains a "."

Output of the test is shown below.

Thanks.
Paul

D:\Dev\Test Tools\lucene>java -cp %CLASSPATH%;.\ ParseTest
Query string: children.name:John
org.apache.lucene.queryParser.TokenMgrError: Lexical error at line 1, column 9. Encountered: "." (46), after : ""
at org.apache.lucene.queryParser.QueryParserTokenManager.getNextToken(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_scan_token(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_3_1(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_2_1(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.Clause(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.Query(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.parse(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.parse(Unknown Source)
at ParseTest.query(ParseTest.java:25)
at ParseTest.main(ParseTest.java:15)

Query string: text:one.two
org.apache.lucene.queryParser.TokenMgrError: Lexical error at line 1, column 9. Encountered: "." (46), after : ""
at org.apache.lucene.queryParser.QueryParserTokenManager.getNextToken(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_ntk(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.Term(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.Clause(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.Query(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.parse(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.parse(Unknown Source)
at ParseTest.query(ParseTest.java:25)
at ParseTest.main(ParseTest.java:16)

Query string: one.two
org.apache.lucene.queryParser.TokenMgrError: Lexical error at line 1, column 4. Encountered: "." (46), after : ""
at org.apache.lucene.queryParser.QueryParserTokenManager.getNextToken(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_scan_token(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_3_1(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_2_1(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.Clause(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.Query(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.parse(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.parse(Unknown Source)
at ParseTest.query(ParseTest.java:25)
at ParseTest.main(ParseTest.java:17)

Query string: Look for me.
org.apache.lucene.queryParser.TokenMgrError: Lexical error at line 1, column 13. Encountered: <EOF> after : ""
at org.apache.lucene.queryParser.QueryParserTokenManager.getNextToken(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_scan_token(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_3_1(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_2_1(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.Clause(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.Query(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.parse(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.parse(Unknown Source)
at ParseTest.query(ParseTest.java:25)
at ParseTest.main(ParseTest.java:18)

I don't think so (some other punctuation fails too, such as '#'). It's seems pretty random which punctuation is allowed and which causes an error, for instance, '.' and '_' work fine. Is there any rule for this? What characters are / are not valid using the StandardAnalyzer? It seems to me that queries containing punctuation should be valid.

I look forward to a response when I return from vacation. I included the user list on my response in case others have opinions or suggestions.

Thanks for your help.
Paul

-----Original Message-----
From: Brian Goetz [mailto:brian@quiotix.com]
Sent: Friday, November 16, 2001 5:10 PM
To: Paul Friedman
Subject: Re: QueryParser error when "." in query string


> I downloaded last nights build and you were right, queries containing "." now work. However, now queries containing "/" throw the same error.

Did they before?

--
To unsubscribe, e-mail: <mailto:lucene-user-unsubscribe@jakarta.apache.org>
For additional commands, e-mail: <mailto:lucene-user-help@jakarta.apache.org>