Page 1 of 1

Silent Import Queue Jams

PostPosted: Fri Feb 10, 2017 6:17 pm
by Lee Thompson
Build: 6.73RC2 4820

Still running into periodic problems where newsbin stops processing the Import queue. I noticed usually active groups didn't have any new posts although the group list showed recent update.

Went into the Imports folder to see over 11000 gunzip (gz) files waiting. The Cache item on the bar showed (200/200) (0).

I'm doing what I usually do and that's move them all into a different folder and move them back into Import in batches. I've found a couple that it just stops processing on, it doesn't give any errors, it just stops doing anything with it.


Is there any data/tests I can do to help the devs fix this issue?

Re: Silent Import Queue Jams

PostPosted: Sat Feb 11, 2017 5:28 am
by Lee Thompson
UPDATE: Part of the issue seems to be processing the autodownload files seems to be unusually slow:

alt.binaries.moovee on Jan 22 files (roughly 25MB each) are taking about 20 minutes per .gz file.


Machine Specs:

Code: Select all
CPU: AMD Phenom II X6 1090T
RAM: 8GB
OS: Windows 7 Enterprise SP1 (x64)


Now the spool_v6 files for the group are rather large:

StorageData.db3 is over 7.5GB
Storage.db3 is nearly 3.5GB