Page 1 of 1

filtering & deleting spam

PostPosted: Tue Mar 27, 2012 11:10 am
by carlo X
hi
is there a way to speed up filtering & deleting headers from hundred millions or billions posts groups?
e.g. boneless. uses days to download all available headers (astraweb). ok, there is nothing one can do about this. but filtering, marking and deleting for e.g. .exe needs hours.
is there any way to fasten this?
with newsleecher this is absolutely no deal. marking and deleting runs in an eyeblink

carlo X
btw. i like the gui of newsbin 6. good move

Re: filtering & deleting spam

PostPosted: Tue Mar 27, 2012 3:03 pm
by Quade
I think the question is, how are you doing it and how much you have loaded into memory. Newsbin lets you load as little or as much of the group into memory as you want. The more you load up, the slower the processing will be.

The best way to get rid of spam is right click "Delete all Posts from Poster" because they're deleted from storage and you never see them again.

Re: filtering & deleting spam

PostPosted: Wed Mar 28, 2012 12:20 am
by carlo X
Quade wrote:I think the question is, how are you doing it and how much you have loaded into memory. Newsbin lets you load as little or as much of the group into memory as you want. The more you load up, the slower the processing will be.

The best way to get rid of spam is right click "Delete all Posts from Poster" because they're deleted from storage and you never see them again.

well, i loaded all 400.000.000+ posts. taskmananger says newsbinpro64.exe = 13.5gb. now using "Delete all Posts from Poster" lasts way too long.....

Re: filtering & deleting spam

PostPosted: Wed Mar 28, 2012 12:41 am
by carlo X
i don't like referring to newsleecher, but....
as far as i understand, they have pointers in their database. which is what you see as the headers. these seem to be small files which are easy to sort, mark & delete if one think it's spam. deleting these is fast. then, if you want to close newsleecher, it will aks you for cleaning. this also lasts very long. but at this point you've already found out what is spam and which headers aren't. now nl working needs apparently as long as newsbin. but that's ok now.....

Re: filtering & deleting spam

PostPosted: Thu Mar 29, 2012 1:34 am
by Quade
You're doing it the hardest way possible. I'd probably only load a month or 2 at a time, clean that out then switch to the next set of months.

I'd probably not bother with "Poster Lockout" too. Instead "Delete all Posts from Poster" works better. The alternative is to load nothing and just use local search to find the spam, then select it and shift-delete it to delete it from storage.

Re: filtering & deleting spam

PostPosted: Thu Mar 29, 2012 3:05 am
by carlo X
thanks quade. i'll check it out