Can somebody please help, this is a BIG issue for the project I'm working on?
I have attached a test case showing that QueryParser (using StandardAnalyzer) throws a TokenMgrError when parsing a query string that contains a "."
Output of the test is shown below.
Thanks.
Paul
D:\Dev\Test Tools\lucene>java -cp %CLASSPATH%;.\ ParseTest
Query string: children.name:John
org.apache.lucene.queryParser.TokenMgrError: Lexical error at line 1, column 9. Encountered: "." (46), after : ""
at org.apache.lucene.queryParser.QueryParserTokenManager.getNextToken(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_scan_token(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_3_1(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_2_1(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.Clause(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.Query(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.parse(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.parse(Unknown Source)
at ParseTest.query(ParseTest.java:25)
at ParseTest.main(ParseTest.java:15)
Query string: text:one.two
org.apache.lucene.queryParser.TokenMgrError: Lexical error at line 1, column 9. Encountered: "." (46), after : ""
at org.apache.lucene.queryParser.QueryParserTokenManager.getNextToken(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_ntk(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.Term(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.Clause(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.Query(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.parse(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.parse(Unknown Source)
at ParseTest.query(ParseTest.java:25)
at ParseTest.main(ParseTest.java:16)
Query string: one.two
org.apache.lucene.queryParser.TokenMgrError: Lexical error at line 1, column 4. Encountered: "." (46), after : ""
at org.apache.lucene.queryParser.QueryParserTokenManager.getNextToken(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_scan_token(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_3_1(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_2_1(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.Clause(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.Query(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.parse(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.parse(Unknown Source)
at ParseTest.query(ParseTest.java:25)
at ParseTest.main(ParseTest.java:17)
Query string: Look for me.
org.apache.lucene.queryParser.TokenMgrError: Lexical error at line 1, column 13. Encountered: <EOF> after : ""
at org.apache.lucene.queryParser.QueryParserTokenManager.getNextToken(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_scan_token(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_3_1(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_2_1(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.Clause(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.Query(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.parse(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.parse(Unknown Source)
at ParseTest.query(ParseTest.java:25)
at ParseTest.main(ParseTest.java:18)
I have attached a test case showing that QueryParser (using StandardAnalyzer) throws a TokenMgrError when parsing a query string that contains a "."
Output of the test is shown below.
Thanks.
Paul
D:\Dev\Test Tools\lucene>java -cp %CLASSPATH%;.\ ParseTest
Query string: children.name:John
org.apache.lucene.queryParser.TokenMgrError: Lexical error at line 1, column 9. Encountered: "." (46), after : ""
at org.apache.lucene.queryParser.QueryParserTokenManager.getNextToken(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_scan_token(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_3_1(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_2_1(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.Clause(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.Query(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.parse(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.parse(Unknown Source)
at ParseTest.query(ParseTest.java:25)
at ParseTest.main(ParseTest.java:15)
Query string: text:one.two
org.apache.lucene.queryParser.TokenMgrError: Lexical error at line 1, column 9. Encountered: "." (46), after : ""
at org.apache.lucene.queryParser.QueryParserTokenManager.getNextToken(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_ntk(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.Term(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.Clause(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.Query(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.parse(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.parse(Unknown Source)
at ParseTest.query(ParseTest.java:25)
at ParseTest.main(ParseTest.java:16)
Query string: one.two
org.apache.lucene.queryParser.TokenMgrError: Lexical error at line 1, column 4. Encountered: "." (46), after : ""
at org.apache.lucene.queryParser.QueryParserTokenManager.getNextToken(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_scan_token(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_3_1(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_2_1(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.Clause(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.Query(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.parse(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.parse(Unknown Source)
at ParseTest.query(ParseTest.java:25)
at ParseTest.main(ParseTest.java:17)
Query string: Look for me.
org.apache.lucene.queryParser.TokenMgrError: Lexical error at line 1, column 13. Encountered: <EOF> after : ""
at org.apache.lucene.queryParser.QueryParserTokenManager.getNextToken(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_scan_token(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_3_1(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.jj_2_1(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.Clause(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.Query(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.parse(Unknown Source)
at org.apache.lucene.queryParser.QueryParser.parse(Unknown Source)
at ParseTest.query(ParseTest.java:25)
at ParseTest.main(ParseTest.java:18)