downloading headers from large groups

Technical support and discussion of Newsbin Version 6 series.

downloading headers from large groups

Postby vortexx » Wed Aug 07, 2013 3:16 pm

I've been having trouble getting headers from large groups. It'll download headers for hours and then it will fail and there will be no headers when I try to show all headers from the group. Any thoughts?
vortexx
Occasional Contributor
Occasional Contributor
 
Posts: 49
Joined: Thu Jan 12, 2006 1:55 am

Re: downloading headers from large groups

Postby vortexx » Wed Aug 07, 2013 4:53 pm

I forgot to say which version number it is. I'm using 6.50B13: 00 43 1E B3 76 24
vortexx
Occasional Contributor
Occasional Contributor
 
Posts: 49
Joined: Thu Jan 12, 2006 1:55 am

Re: downloading headers from large groups

Postby dexter » Wed Aug 07, 2013 6:08 pm

Do you have a post list open for this group while you are downloading headers? If so, the headers are going straight into RAM and you will run your system out of RAM.

I don't recommend doing a Load All Posts on high traffic newsgroups, you should just load a month at a time. The high traffic groups have like 30 million posts per month. That's alot of posts to go through.

Still, Newsbin shouldn't be losing the headers it downloaded unless it is crashing. Look in the Status bar in the middle where it says something like "Cache: 180/200 (xx)" and see if there are numbers in the parenthesis while headers are downloading. The numbers in parenthesis means Newsbin has a backlog it is processing in the background. When those numbers go to 0 you should be able to load headers.
User avatar
dexter
Site Admin
Site Admin
 
Posts: 9514
Joined: Fri May 18, 2001 3:50 pm
Location: Northern Virginia, US

Registered Newsbin User since: 10/24/97

Re: downloading headers from large groups

Postby Quade » Thu Aug 08, 2013 10:45 am

Just keep in mind EVERY time you do "download all" it will delete everything and download ALL headers.

If you download all one time and the connection fails or you restart. Just "download latest" and it'll take off downloading headers where it left off.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44984
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: downloading headers from large groups

Postby vortexx » Thu Aug 08, 2013 11:29 pm

Thanks for the help. I did not realize that when you download all, it erases the previous headers in that group.

I think it may have crashed when I was downloading the headers.

I've been having another issue in the last few days. Newsbin stops downloading every now and then and I need to shut it down and restart it before it will start downloading again. I just upgraded to the newest beta and it's still doing this. I have unlimited accounts with Giganews and Usenetserver that I use as main and backup servers so it's not the servers. I'm using Windows 8. Anny suggestions?
thanks
vortexx
Occasional Contributor
Occasional Contributor
 
Posts: 49
Joined: Thu Jan 12, 2006 1:55 am

Re: downloading headers from large groups

Postby Quade » Fri Aug 09, 2013 8:55 am

Look down where it says "Cache" and tell me the numbers. If the cache goes to "0/XXX" then Newsbin is having problems writing the data to your disks. Maybe Virus scanner or something like that.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44984
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: downloading headers from large groups

Postby vortexx » Fri Aug 09, 2013 12:38 pm

It says 123/200
vortexx
Occasional Contributor
Occasional Contributor
 
Posts: 49
Joined: Thu Jan 12, 2006 1:55 am

Re: downloading headers from large groups

Postby vortexx » Fri Aug 09, 2013 1:47 pm

I disabled the virus scanner and it happened again.

If I try doing a new clean install, is there a way to keep the settings from the one that is installed at the moment?
vortexx
Occasional Contributor
Occasional Contributor
 
Posts: 49
Joined: Thu Jan 12, 2006 1:55 am

Re: downloading headers from large groups

Postby Quade » Fri Aug 09, 2013 2:20 pm

Disabling the scanners doesn't work. They have to be uninstalled and you'd need to reboot.

What's the chances it's simply downloaded all it could and the files are too damaged to repair?
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44984
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: downloading headers from large groups

Postby vortexx » Fri Aug 09, 2013 2:36 pm

Quade wrote:Disabling the scanners doesn't work. They have to be uninstalled and you'd need to reboot.

What's the chances it's simply downloaded all it could and the files are too damaged to repair?


when I restart it, the files continue downloading at full speed and all the parts are available. I have a fairly big download list and it just moves to the next download if it's unrepairable. I don't think it's the virus scanner but I'll try uninstalling it.
vortexx
Occasional Contributor
Occasional Contributor
 
Posts: 49
Joined: Thu Jan 12, 2006 1:55 am

Re: downloading headers from large groups

Postby Quade » Fri Aug 09, 2013 3:09 pm

You could try moving some lower files to the top and see if anything changes too.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44984
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: downloading headers from large groups

Postby vortexx » Fri Aug 09, 2013 3:17 pm

Quade wrote:You could try moving some lower files to the top and see if anything changes too.


I did that but it didn't download those either.

I just noticed a error message saying "[12:36:16] HIGH Unknown PAR Repair Dll version, probably a version conflict" This error didn't make the downloads stop but perhaps it has something to do with the problem.

Perhaps I should try an earlier version? I had the same issue with nb650B13 so I installed the latest beta.
vortexx
Occasional Contributor
Occasional Contributor
 
Posts: 49
Joined: Thu Jan 12, 2006 1:55 am

Re: downloading headers from large groups

Postby dexter » Fri Aug 09, 2013 11:41 pm

Having the wrong par dll will keep the repair from working if the RAR set is not perfect and requires repair. You can try reinstalling Newsbin and see if you get the right dll's installed. When you start Newsbin, check the Logging tab and see what par dll version is getting used. If you are running an AMD machine, it may be delivering an incompatible dll.
User avatar
dexter
Site Admin
Site Admin
 
Posts: 9514
Joined: Fri May 18, 2001 3:50 pm
Location: Northern Virginia, US

Registered Newsbin User since: 10/24/97


Return to V6 Technical Support

Who is online

Users browsing this forum: Bing [Bot] and 2 guests