RE: [smila-dev] OutOfMemoryException during Crawl

[Thomas Menzel <tmenzel@xxxxxxx>]

hi folks,

i suggest we move the discussion of this to bugzilla as it is a defect and thus all those that deem themselves worthy may subscribe to this bug.

@deniel, 
I wanted to add ur email CC to the bug but bugzilla complaint not knowing the email address that u use when writing to the dev list. so u have to do that urself...

Kind regards
Thomas Menzel @ brox IT-Solutions GmbH

-----Original Message-----
From: smila-dev-bounces@xxxxxxxxxxx [mailto:smila-dev-bounces@xxxxxxxxxxx] On Behalf Of Marius Cimpean
Sent: Freitag, 10. Oktober 2008 17:05
To: Smila project developer mailing list
Subject: Re: [smila-dev] OutOfMemoryException during Crawl

Hi Daniel

Is it necessary to base the BinStore implementation on commons VSF ? What 
are the benefits ?
[Marius] ... the commons-vfs was already chosen from long time ... Excluding 
this memory consumption (issue discussed in the last days) commons-vfs 
offers many functionalities and nice API for dealing with the file system. 
Also commons-vfs it is used by other important projects (anyway, ... there 
are many aspects that should be taken into consideration when choosing an 
API... including the community too... and others).

I sent an email two days ago, related to specific requirements in order to 
decide if the binary storage shall be based on file system or other 
solutions could be used... I suggest we should obtain this answer first 
before switching from commons-vfs to other fs API.

Best Regards,
marius

----- Original Message ----- 
From: <Daniel.Stucky@xxxxxxxxxxx>
To: <smila-dev@xxxxxxxxxxx>
Sent: Friday, October 10, 2008 5:46 PM
Subject: AW: [smila-dev] OutOfMemoryException during Crawl


Hi Marius,

I think I found the cause but I was not able to fix it, yet.

The cause lies in class org.apache.commons.vfs.provider.AbstractFileSystem. 
There is a listenerMap that maps from FileName to an ArrayList of listeners 
for that file. The problem is that Listeners are added but never removed. 
Thus the number of entries in the map grows with the number of files stored 
in the BinStore.

Is it necessary to base the BinStore implementation on commons VSF ? What 
are the benefits ?
At the moment commons VSF seems a bit buggy and also is not very up to date.

Bye,
Daniel

> -----Ursprüngliche Nachricht-----
> Von: smila-dev-bounces@xxxxxxxxxxx [mailto:smila-dev-
> bounces@xxxxxxxxxxx] Im Auftrag von Marius Cimpean
> Gesendet: Freitag, 10. Oktober 2008 13:58
> An: Smila project developer mailing list
> Betreff: Re: [smila-dev] OutOfMemoryException during Crawl
>
> Hi Daniel,
>
> Thanks for the hint.
>
> The commons-vfs bundle uses nightly builds ... which is old enough (Apr
> 2007) ... there is a new version of the nightly build (July 2007). I'll
> do
> some more tests based on the most recent available nightly build.
> I also got in contact with the commons-vfs community to find out when
> the
> next release will be... unfortunately no answer yet.
>
> Best Regards,
> Marius
_______________________________________________
smila-dev mailing list
smila-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/smila-dev



_______________________________________________
smila-dev mailing list
smila-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/smila-dev