Many Posts don't Download, just marked Queued for Download

[Bismark]

I have the latest version of Newsbin Beta 6 loaded and many many posts do not download. They are just marked "queued for download" and sit there. They don't show in the "Downloading Files" either. I have turned of duplicate checking in the advanced options also. It seems to be random. If there is a large set of similar named images, just one or two download. I also removed the signature.db file. Is there anything else I can do to fix this?

[Quade]

I assume you're downloading at the same time. How about hitting the main pause button then, when the speed goes to zero, try adding some downloads and see if they get added. I'm wondering if the connection to the search server is failing.

If this makes it work, I can try some changes to make the connection more robust.

[Bismark]

Hi,
I don't think that is the problem. I just exited Newsbin and came back to it and all seemed to work for a while. I also compacted the database. Downloading video files works all the time. Also, I have seen the problem when nothing is running and I just ask for one file. This happens when Newsbin is busy or not doing anything. If I exit and comeback, the files I tried to download are not marked "queued for download" Hope this gives some clue.

Next time see the problem, I'll try the pause.

Thanks

[Quade]

If you're not using "Search" then pause won't help. If you're using headers. It sounds like the headers are missing from disk. What's your "Storage Age" set to?

[Bismark]

I am using headers and I think they are there as I was able to download them after exiting Newsbin and compacted the newsgroups. My storage age is 200 and all these were less than 20 days old.

[Bismark]

More puzzling information:

If I ask to download about 4 images, it does it. If I ask for many more such as 30, one or two download and the rest show "Queued for Download" but do not show up in the Downloading files tab. It seems something is being overwritten or lost. Hope this helps.

[Quade]

Might be worth purging the group and re-downloading headers. I don't have any issues like this. Headers is all I use too.

Basically right click "Post Storage/Delete Stored Posts" then set say a 200 day download age. Then "Download latest".

[Bismark]

Hi,
I have already purged and reloaded headers and it still happens. One more clue, it does not happen right away after Newsbin is loaded, but after it has done stuff for about 15 -30 minutes. The real interesting thing is that it downloads a few images every time. Is there some sort of dump or trace that may help?

[Quade]

When you add something to download. Newsbin goes to disk to pull the information it needs then sends this information to the download list. It's normally pretty foolproof.

Might be worth exiting Newsbin and deleting the "Downloads.db3" file from the data folder. This will wipe the download, failed and wish lists.

[Bismark]

Well, I did the delete of the Downloads.db3 file and still have the problem. I do notice it doesn't seem to happen when I first start with a Group, but happens after a while. Also, If if restart Newsbin, the files marked for download are not so marked and I can download them.

[Quade]

Are you using multiple search tabs? There's something different between how you download and how I download. I just need to find out what that something is.

[Bismark]

I am not using any search, just open a group and ask to download a number of images. I do have a little more to tell you. After I try to down load a number of images and some are marked "queued for download" if I go back and try to download them again, just by right click and select download, more of them download. If I keep doing that, most but not all do download. Go figure!

[Bismark]

One more clue about the problem. I am using the Groups feature of the Groups List tab and there are 68 usenet groups in the group. If I try to download images from any single group, it seems to work and I can download any number of images.

[Quade]

I had another report and the issue was that the connection was timing out. I'm going to extend the timeout for the next version.

[Bismark]

I'm not sure my problem is related to timeouts as it happens right away. I try to download a 100 images and only 2 or 3 are added to the downloading files tab and it happens in less than a second.

[Quade]

I'm kinda at a loss at this point.

1 - I picked a moderate sized group. Related to breasts.

2 - I "Download all Headers" on the group.

3 - I waited for the import to finish. Then loaded the group. Has files going back about 2000 days.

One thing I did notice if that if you're adding files to the download list while it's still importing (number in parens down near cache greater than zero), the add to download list is a bit slow.

4 - Selected and added blocks. Eventually added all 25,000 pictures. They all made it down there.

What do you think is different with how you do it?

[Bismark]

I don't think I made myself clear. If I try to download images from one news group that was opened by a show posts, it works.

If I combine many newsgroups under one name in the groups tab and select the group name and left click and select show posts, then one tab named for the group name shows with all the posts for all the groups combined. Then, if I select a number of images to download, and as few as 20 will cause problem, all the selected images are immediately marked "queued for Download", but often only a few of the images are listed in the downloading files and only those are downloaded. It does not seem to happen right away, but only after a few tries. and the group of groups that has the most problems has 68 newsgroups in it.

It seems to be related to trying to download from a tab that has lots of newsgroups combined.

Hope this clears it up.

[Bismark]

Just a quick addition: I have 68 newsgroups in the group that has the problem.

[Quade]

I don't have any topics with that many groups.

To test your theory, you could make another topic, put 1/2 the groups into this topic then load the topic and try to add from the new smaller topic.

[Bismark]

I created a topic group with 23 news groups in it and had the same problem, not all the images downloaded. When i just opened one of the groups that had the images, they were still marked queued for downloading, but just selecting them again and doing a download gets them every time.