filtering & deleting spam

Technical support and discussion of Newsbin Version 6 series.

filtering & deleting spam

Postby carlo X » Tue Mar 27, 2012 11:10 am

hi
is there a way to speed up filtering & deleting headers from hundred millions or billions posts groups?
e.g. boneless. uses days to download all available headers (astraweb). ok, there is nothing one can do about this. but filtering, marking and deleting for e.g. .exe needs hours.
is there any way to fasten this?
with newsleecher this is absolutely no deal. marking and deleting runs in an eyeblink

carlo X
btw. i like the gui of newsbin 6. good move
carlo X
n00b
n00b
 
Posts: 4
Joined: Tue Mar 27, 2012 10:40 am

Re: filtering & deleting spam

Postby Quade » Tue Mar 27, 2012 3:03 pm

I think the question is, how are you doing it and how much you have loaded into memory. Newsbin lets you load as little or as much of the group into memory as you want. The more you load up, the slower the processing will be.

The best way to get rid of spam is right click "Delete all Posts from Poster" because they're deleted from storage and you never see them again.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44951
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: filtering & deleting spam

Postby carlo X » Wed Mar 28, 2012 12:20 am

Quade wrote:I think the question is, how are you doing it and how much you have loaded into memory. Newsbin lets you load as little or as much of the group into memory as you want. The more you load up, the slower the processing will be.

The best way to get rid of spam is right click "Delete all Posts from Poster" because they're deleted from storage and you never see them again.

well, i loaded all 400.000.000+ posts. taskmananger says newsbinpro64.exe = 13.5gb. now using "Delete all Posts from Poster" lasts way too long.....
carlo X
n00b
n00b
 
Posts: 4
Joined: Tue Mar 27, 2012 10:40 am

Re: filtering & deleting spam

Postby carlo X » Wed Mar 28, 2012 12:41 am

i don't like referring to newsleecher, but....
as far as i understand, they have pointers in their database. which is what you see as the headers. these seem to be small files which are easy to sort, mark & delete if one think it's spam. deleting these is fast. then, if you want to close newsleecher, it will aks you for cleaning. this also lasts very long. but at this point you've already found out what is spam and which headers aren't. now nl working needs apparently as long as newsbin. but that's ok now.....
carlo X
n00b
n00b
 
Posts: 4
Joined: Tue Mar 27, 2012 10:40 am

Re: filtering & deleting spam

Postby Quade » Thu Mar 29, 2012 1:34 am

You're doing it the hardest way possible. I'd probably only load a month or 2 at a time, clean that out then switch to the next set of months.

I'd probably not bother with "Poster Lockout" too. Instead "Delete all Posts from Poster" works better. The alternative is to load nothing and just use local search to find the spam, then select it and shift-delete it to delete it from storage.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44951
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: filtering & deleting spam

Postby carlo X » Thu Mar 29, 2012 3:05 am

thanks quade. i'll check it out
carlo X
n00b
n00b
 
Posts: 4
Joined: Tue Mar 27, 2012 10:40 am


Return to V6 Technical Support

Who is online

Users browsing this forum: Google [Bot] and 3 guests