Can't open even moderately large group anymore

[darkfalz]

I used to have no problem browsing/searching a group like alt.binaries.teevee on a 4GB laptop, even 300+ days at a time.

Now I can't even open 100 days worth on a 16 GB machine with the db3 files stored on an SSD. It's been working for an hour opening the group, 100% RAM usage, reading ~120 mb/sec and writing (? pagefile?) 20 mb/sec. All the pending group imports are already done and merged.

I know nzbs are the most practical way but I don't want to have to rely on them... something is very wrong here.

[darkfalz]

Oh, okay - it's the spam.

Looking into how to filter it now... hopefully it won't mean a redownload of headers, that would be a nightmare.

[Quade]

You can either re-download or load up smaller chunks of the group and clean the spam out by hand.

So say you "load special" 2 days worth, then purge out the spam. Then load up 4 days worth and so on. The number of days you can load will depends on how bad the spam is. Re-downloading is simply easier.

Limiting the "display age" will also make any groups easier to load.