Downloading headers problem(s)

[stan_newsbin]

Hi,

I am unsure if this is a Newsbin Pro V6.42 Build 2146 problem or not, but here are the symptoms:

Header downloads stop then sporadically start with very low total through speed. While the speeds may burst up to 3 MBps, the duration is short and decreases over time until no headers are downloading. Also, these error messages appear:

[08:42:21] ERROR Socket - Error: WSARecv Socket Error Code: 10060 A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond.

[08:42:21] ERROR NNTPSocket - Server:us.news.astraweb.com NNTPServer: Compressed Headers - Timeout Waiting for Server to send Data: Socket - Read or Write Timeout
[08:42:21] ERROR NNTPSocket - Server:us.news.astraweb.com NNTPServer: Timeout - Waiting for Server to send Data: Socket - Read or Write Timeout
[08:42:21] ERROR Socket - Error: WSASend Socket Error Code: 10038 An operation was attempted on something that is not a socket.

Additionally, at some point new headers cannot be downloaded and reloading all (or a large portion) the headers is needed. This only happens for larger groups. But, the problem may or may not be due to a setting or configuration of Newsbin. Maybe this is all a server problem? Any clues or suggestions for fixes to try are appreciated.

[Quade]

In the server options, really advanced, try disabling "XFeatures" then try some header downloads. I think your virus scanner of firewall is stepping on the connections. Compressed headers are binary meaning that a virus scanner might see something it doesn't like. There can be other problems too. Essentially the connection for the header downloads seems to be failing.

I have AW and Giga here and I see occasional failed connections like this from AW but, typically a retry will fix it.

I'd start by making the V scanner and or firewall ignore the connections Newsbin makes to the news server. They always F up downloads. I sometimes suspect it's on purpose too.

[stan_newsbin]

Thanks for the suggestions. I tried disabling XFeatures. That only appears to slow down the download but does not prevent the header downloads from stopping.

I also disabled the antivirus (AVG free). That appeared to have no effect. This problem downloading headers has happened off-and-on to varying degrees over the last six months. I think it's a server problem.

Also, this is only a header download problem. The binaries and text files never seem to have this trouble.

[Quade]

You understand that we both use the same server right? When I say I'm not really having any real problems with AW, that should be a data point for you. I DO get dropped connections from them from time to time but, not enough to really prevent me from getting headers. I don't have any issues that require me to re-download large blocks of headers.

[stan_newsbin]

Maybe some other software in the PC is causing issues, but the PC is fairly dedicated to Newsbin Pro with only windows updates and AVG (free) software updated. Changing the port seems to help with improving header downloads = at least getting it started again. I never (at least in the last six months) get a continual download. The download is broken into sections as evident by the size changing. Only when header size is smaller (below 50000) that a single connection will complete the download.

I don't think Newsbin Pro is doing this (i.e. stopping the download and then restarting). However, this is an older machine which is more resource limited (1Gb Ram), so there could be some memory limitations. I usually do not receive error messages.

[Quade]

I also disabled the antivirus (AVG free).

I'd remove the virus scanner, reboot, then try some header downloads and see if the symptoms change. If they do, you might consider a different scanner. I'd turn xfeatures back on and test that way too. V scanners are a constant problem.

[stan_newsbin]

Thanks! You were correct - at least on the right track. I uninstalled the AVG 'safe search' software, which seemed to help by itself then the entire anti-virus software. It seems downloading headers does not have the same scheme as for typical files. While testing this out, the download timed out but did not pick up and start where it left off - but started again from zero. This was when testing some larger header file groups using the 'download special' 5,000,000 headers option. The XFeatures option was enabled.

At any rate, the change is a significant improvement. With only two pieces of software (other than Windows), it stands to reason that the other piece of software (AV) was causing problems. But, most of the time downloading headers worked - just not as well as it used to and recently it has gotten worse with error messages. While I am not particularly happy about disabling the AV, it has never stopped any serious virus problem to date; the AVG 'safe search' was not reinstalled. Personally, I don't trust the AV cleanup and repair but instead reload a known clean drive image. However, I do trust when the AV finds a problem. Thanks again.

[Quade]

While I am not particularly happy about disabling the AV, it has never stopped any serious virus problem to date;

I don't use a V scanner. Not on the download machine. I do on the machine I browse the internet with. Microsoft Security Essentials is free and seems pretty good. I've not seen it mess up downloads. You figure it'll stop most non-NSA malware.