Downloaded headers not showing

[Zen_Rebel]

Hi, I've noticed a few issues with downloading headers since the version 6.30 series...I've been in the habit of downloading the headers from a.b.multimedia on a daily basis where it would be 400 thousand posts per day (i have the filter profile set at 1 day). Since the new versions of newsbin, it loses the memory of downloads and i have to redownload the totality of posts (12 million + or-). OK, no big deal, then it works fine for a few days... then again, forgets the spool setting(?) and i have to re-download the total number of headers again. With the vs. 6.30B6 the same thing happened again on friday, so i re-downloaded all 12 million headers on saturday and today it doesn't show the downloaded headers from the last 24 hours even though it showed a number of 400 thousand available new headers since yesterday. When i look in the data files, i see the correct day linked to the file Downloads.db3. and the same for a.b.multimedia in the folder SPOOL_V6. What should i do to correct this issue which never happened to me before (also i didn't change any of my settings during new installs) thanks.

[DThor]

Odds are newsbin is still processing the headers when you're looking at them. Do you have spool being processed in the background? It's an option. Basically newsbin won't lose anything unless there's something interrupting the spool insertion, or of course there's a problem such as running out of space, etc. Now, even if newsbin shuts down before inserting some spool, it should pick up later, but if the system shuts down or something more catastrophic happens, this might be a problem. Check the logging for problems, but mostly be aware it can take some time to insert very busy groups. Maybe insertion in the foreground is better for you, so you can see it's still working. I just use the disk activity light, myself.

DT

[Zen_Rebel]

Thank's for the speedy reply DT. When the spool finishes downloading, the download list is empty and there are no posts in the a.b.mutimedia tab where they should be displayed. It shows that i have 262Go free space in data folder as well and i have had no crashes or other comp problems. My problem occurs ONLY with the a.b.mutimedia group. Could the problem be with the group or my server? Nothing reported in the Logging tab. I do use a disk activity light as well and it shows the end of downloads

[Quade]

Look down at the bottom of the main window next to the "Cache" line. See if there's a number in parens "(NNN)" if so, this number represents the number of blocks of records that need to be imported.

You could also "Open Data Folder" then go into spool_v6 and look inside the group folder for the group and see what you see. If you delete the files there you can make Newsbin start over.

What's your "Storage Age" and "Download Age" set to?

[Zen_Rebel]

The only number in ( ) is at the far right where is says select data count and size and it's (0) otherwise chunck cache is 70/100 ...Free space in data folder is 225.1Go and the space in data download folders 561.41Go
Storage Age is 14 days
Download Age 30 days

Should i delete the Storage.db3 (465Mo) or the StorageData.db3 (570Mo) ? Or both?

[Quade]

Basically you're telling Newsbin to download 30 days worth of headers and to then delete 16 days worth before it even shows them. That's probably why you don't see anything.

If you really only want to see 14 days worth of headers. Set the download age to 14 too then purge the group and download headers.

The "Storage Age" should always be larger than the download age.

Explain to me what you're wanting. How many days of headers you want to store and so forth and I'll suggest some things.

[Zen_Rebel]

OK, very well, thank you...I now set my "Storage Age" to 30 days and my download age to 10. Then i right-clicked my a.b.multimedia in my group list, went to Post storage - Purge to display age. Then i double clicked a.b.multimedia and i'm now downloading some 401 Million headers so it will be awhile before i know if it will work like before. Therefore i'll keep you updated...thanks for the help....my ultimate goal is just to download the headers of the last 24 hours and to use the Age filter profile by default which always worked fine until recently.

[Quade]

I'd suggest you stop the download, right click the group "Post Storage\Delete Stored Posts". Now do the download latest and it'll only pull 30 days worth. You have to reset when you change the download age if you want it to be obeyed. There's 2 ways to reset it.

- Purge the group by deleting them all

- Delete the range.db3 file.

6.3 gives you the option to reset the group non-destructively from the right click menu "Post Storage" underneath though, it's just deleting the range.db3 file.

[Zen_Rebel]

Thanks for the tip...now i only have 2.8 million headers to download, so it will be a lot faster than before...thanks again

PS: (Next morning) All seems to be working as before...thanks again