Mailing List Archive: TimeOut Exception when Indexing with EJB (Please Help)

Hi all;

I've tried to index a 100K text file on a empty Index folder (0 MB of
indexed file) and it took 0.77 second. However, when my index folder get
larger (~20MB of Indexed files) the same 100K text file would take up to 30
seconds.

I’m using EJB to do the index processing and my SessionBean will get a
TimeOutException if it take longer than 30 second. I prefer not to re-set
the Transactions TimeOut to longer time. What will happen if the Index
folder get larger (~ 1GB) ?

I understand that the indexing process can be slow but is there a way that I
can speed up the process no matter what the size of my Index folder is?

* If I increase the IndexWriter.mergeFactor = 1000 will it causes
FileNotFoundException (too many open files)? Is there a solution for this
error?

* If I use RAMDirectory, will it cause Out of Memory Exception? Is there a
solution for this error?

Environment:
WebLogic Server 6.1
Java 1.3.1
Document with ( 8 Keyword Fields and 10 Text Fields).
The files range from 10KB – 3000KB

Thanks

TiHon

_________________________________________________________________
MSN Photos is the easiest way to share and print your photos:
http://photos.msn.com/support/worldwide.aspx

--
To unsubscribe, e-mail: <mailto:lucene-user-unsubscribe@jakarta.apache.org>
For additional commands, e-mail: <mailto:lucene-user-help@jakarta.apache.org>

Hello,

I think you should just try your two suggestions and see.
The answer depends on how exactly you do it, OS configuration, etc.
Does this happen on an optimized index, too?

Otis

--- Tihon One <tihonone@hotmail.com> wrote:
> Hi all;
>
> I've tried to index a 100K text file on a empty Index folder (0 MB of
>
> indexed file) and it took 0.77 second. However, when my index folder
> get
> larger (~20MB of Indexed files) the same 100K text file would take up
> to 30
> seconds.
>
> I’m using EJB to do the index processing and my SessionBean will get
> a
> TimeOutException if it take longer than 30 second. I prefer not to
> re-set
> the Transactions TimeOut to longer time. What will happen if the
> Index
> folder get larger (~ 1GB) ?
>
> I understand that the indexing process can be slow but is there a way
> that I
> can speed up the process no matter what the size of my Index folder
> is?
>
> * If I increase the IndexWriter.mergeFactor = 1000 will it causes
> FileNotFoundException (too many open files)? Is there a solution for
> this
> error?
>
> * If I use RAMDirectory, will it cause Out of Memory Exception? Is
> there a
> solution for this error?
>
> Environment:
> WebLogic Server 6.1
> Java 1.3.1
> Document with ( 8 Keyword Fields and 10 Text Fields).
> The files range from 10KB – 3000KB
>
> Thanks
>
> TiHon
>
>
> _________________________________________________________________
> MSN Photos is the easiest way to share and print your photos:
> http://photos.msn.com/support/worldwide.aspx
>
>
> --
> To unsubscribe, e-mail:
> <mailto:lucene-user-unsubscribe@jakarta.apache.org>
> For additional commands, e-mail:
> <mailto:lucene-user-help@jakarta.apache.org>
>

__________________________________________________
Do You Yahoo!?
Try FREE Yahoo! Mail - the world's greatest free email!
http://mail.yahoo.com/

--
To unsubscribe, e-mail: <mailto:lucene-user-unsubscribe@jakarta.apache.org>
For additional commands, e-mail: <mailto:lucene-user-help@jakarta.apache.org>