Version 6.50 Beta 9 Available...

This is the place to help test and discuss Version 6 Beta releases.

Version 6.50 Beta 9 Available...

Postby dexter » Sun May 26, 2013 11:58 pm

A long requested feature has been implemented with B9: Server Priorities. It supports 10 levels. Priority 10 gets used first. Multiple servers can be set at the same priority level if you want. A server at lower priority only gets used if all servers above it fail, and only for that part of a post that failed.

  • Implemented new Server Priority scheme.
  • Fixed issue with NZB Watch not using unrar path.
  • Made changes so Newsbin should keep Windows from going to sleep if its busy.
  • Moved proxy settings back to main server window
  • Now can identify zip files inside of rar files as spam
More details and the download link is on the Newsbin Beta Page.

Please direct any questions or bug reports as a reply to this thread or through our Technical Support Form.

NOTE: Eset and ClamAV are detecting false postives in the Beta 9 installer. This happens from time to time. 20 other AV scanners thought it was fine. Details here: http://virusscan.jotti.org/en/scanresul ... 175c20986c

Edit: Quade Priority 10 means use it first
User avatar
dexter
Site Admin
Site Admin
 
Posts: 9514
Joined: Fri May 18, 2001 3:50 pm
Location: Northern Virginia, US

Registered Newsbin User since: 10/24/97

Re: Version 6.50 Beta 9 Available...

Postby JanJonkman » Mon May 27, 2013 1:34 am

Download link for B9 still points to B8
JanJonkman
Active Participant
Active Participant
 
Posts: 68
Joined: Tue Jan 17, 2012 12:35 pm

Registered Newsbin User since: 12/10/10

Re: Version 6.50 Beta 9 Available...

Postby itimpi » Mon May 27, 2013 5:14 am

dexter wrote:A long requested feature has been implemented with B9: Server Priorities. It supports 10 levels. Priority 1 gets used first. Multiple servers can be set at the same priority level if you want. A server at lower priority only gets used if all servers above it fail, and only for that part of a post that failed.

I thought it was the other way around? The higher the number the more likely it is to get used?

Having said that I can see some logic in the fact that it might be more intuitive that 1 should be used ahead of 2 etc, so maybe this is the way it should work?
The Newsbin Online documentation
The Usenettools for tutorials, useful information and links
User avatar
itimpi
Elite NewsBin User
Elite NewsBin User
 
Posts: 12607
Joined: Sat Mar 16, 2002 7:11 am
Location: UK

Registered Newsbin User since: 03/28/03

Re: Version 6.50 Beta 9 Available...

Postby mimauk » Mon May 27, 2013 6:04 am

Just tried downloading headers from my providers with the server priorities set as follows
Virginmedia = 10
EasynewsUS = 4 (Fill Server)
Easynewseu = 4 (Fill Server)

The headers downloaded from Virgin ok but none from Easynews. Tried a couple of times with the same result.

Reset all the servers to 10 and the headers downloaded from both providers.
mimauk
Seasoned User
Seasoned User
 
Posts: 328
Joined: Sun Aug 20, 2006 12:35 pm

Registered Newsbin User since: 03/29/06

Re: Version 6.50 Beta 9 Available...

Postby Quade » Mon May 27, 2013 7:34 am

You're right Itimpi. 10 gets used first. If a server is active it can potentially get used. There's no "don't use" priority.

All the servers within the same priority will get used before it moves on to the next lowest priority.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44988
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Version 6.50 Beta 9 Available...

Postby Quade » Mon May 27, 2013 7:35 am

Reset all the servers to 10 and the headers downloaded from both providers.


I'll check it out, thanks.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44988
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Version 6.50 Beta 9 Available...

Postby kenr » Mon May 27, 2013 7:43 am

dexter wrote:[*]Moved proxy settings back to main server window

Still seems to be in advanced for me.
User avatar
kenr
Seasoned User
Seasoned User
 
Posts: 330
Joined: Wed Mar 27, 2002 6:14 am
Location: Galashiels

Registered Newsbin User since: 04/13/03

Re: Version 6.50 Beta 9 Available...

Postby Quade » Mon May 27, 2013 8:35 am

You sure you're running B9?
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44988
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Version 6.50 Beta 9 Available...

Postby ozzii » Mon May 27, 2013 8:58 am

The alternate link is still for B8 !!!
Didn't tried the "normal" link.
ozzii
Seasoned User
Seasoned User
 
Posts: 410
Joined: Thu Feb 23, 2006 6:10 pm
Location: France

Registered Newsbin User since: 02/23/06

Re: Version 6.50 Beta 9 Available...

Postby dexter » Mon May 27, 2013 9:28 am

ozzii wrote:The alternate link is still for B8 !!!
Didn't tried the "normal" link.


Just fixed it, thanks.
User avatar
dexter
Site Admin
Site Admin
 
Posts: 9514
Joined: Fri May 18, 2001 3:50 pm
Location: Northern Virginia, US

Registered Newsbin User since: 10/24/97

Re: Version 6.50 Beta 9 Available...

Postby kenr » Mon May 27, 2013 9:49 am

Quade wrote:You sure you're running B9?

Sure am heres the screen shot.
Image
The SSL bit doesn't appear until I click on the Really Advanced button.
User avatar
kenr
Seasoned User
Seasoned User
 
Posts: 330
Joined: Wed Mar 27, 2002 6:14 am
Location: Galashiels

Registered Newsbin User since: 04/13/03

Re: Version 6.50 Beta 9 Available...

Postby Quade » Mon May 27, 2013 1:49 pm

I see the button right there. I was in the really advanced section and I pulled it back out.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44988
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Version 6.50 Beta 9 Available...

Postby kenr » Mon May 27, 2013 2:33 pm

AGGH my bad, I was thinking of the SSL V2 bypass, not the proxy settings.
User avatar
kenr
Seasoned User
Seasoned User
 
Posts: 330
Joined: Wed Mar 27, 2002 6:14 am
Location: Galashiels

Registered Newsbin User since: 04/13/03

Re: Version 6.50 Beta 9 Available...

Postby gkar » Mon May 27, 2013 2:51 pm

Seeing a lot what look like connections opened in download list. Far more than I have setup.

I have 8 servers setup. 2 to astraweb(3 connections each) set as normal servers and lvl 10. Rest are fill and are lvl 4(2 connections each). I just disabled all but one server and set that to one connection. Seeing a lot less but is still opening/showing about 9/10 of these lines at a time.

Image

btw my connections window is showing 1 connection right now. Guess this just a change to the way its processing?

thanks for the server priority :)

edit: just rebooted NB and watched it download the first block from all the single part items in the download list!
User avatar
gkar
Seasoned User
Seasoned User
 
Posts: 306
Joined: Tue Jun 26, 2012 1:40 pm

Registered Newsbin User since: 06/27/12

Re: Version 6.50 Beta 9 Available...

Postby Quade » Mon May 27, 2013 3:01 pm

Download has been re-designed. What you're seeing is really pending downloads. They're queued up and waiting for a worker thread to start the actual download.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44988
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Version 6.50 Beta 9 Available...

Postby gkar » Mon May 27, 2013 3:07 pm

ok thx. Am seeing chunks in the chunks folder for the single part files i mentioned earlier. Is it actually downloading data?

btw i guess the concept of fill server is out the window now? and i can just set what where fill servers to normal and set a lower priority
User avatar
gkar
Seasoned User
Seasoned User
 
Posts: 306
Joined: Tue Jun 26, 2012 1:40 pm

Registered Newsbin User since: 06/27/12

Re: Version 6.50 Beta 9 Available...

Postby Quade » Mon May 27, 2013 4:04 pm

1 - If you see chunks then it has already downloaded the data. Chunks only appear after download. How many cache blocks do you have?

2 - Priority replaces fill. It's more precise and granular too. There's no concept of fill for the whole file. It's always "per chunk" now. You can simulate fill by making one server 10 and the other 9 (or 1)
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44988
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Version 6.50 Beta 9 Available...

Postby gkar » Tue May 28, 2013 4:08 am

37. Each chunk is 379kb and theres 37 files, each single part.

btw NBisnt downloading parts sequentially. So say part 5 is half way through downloading, a load of blocks of part 6 get qued then start downloading before part 5 is all downloaded. I guess this is part of the new system? If just watched it download part 22(of a 43part file) before its even got part 1 down. This would only be a problem if i wanted to sample a large file.

tried multi and single part files/combos of, and on restart NB is ignoring its download list order. It just starts downloading all files.

thx for info re fill servers
User avatar
gkar
Seasoned User
Seasoned User
 
Posts: 306
Joined: Tue Jun 26, 2012 1:40 pm

Registered Newsbin User since: 06/27/12

Re: Version 6.50 Beta 9 Available...

Postby Quade » Tue May 28, 2013 9:06 am

I see that happening if there's a problem downloading the first chunk of the file. It'll start working on the next file or even further down if a "first chunk" is still pending. The goal is to keep Newsbin using 100% bandwidth. Download order is important but, secondary to maximizing speed.


Down in the status bar how many "Cache" chunks are you showing?

It'll be possible to tweak some of this behavior eventually. I sort of need to characterize how it's downloading first to know how to change it. For example, right now it sounds like it'll get way ahead of itself queuing posts to the download engine. I might need to limit the queue depth.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44988
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Version 6.50 Beta 9 Available...

Postby gkar » Tue May 28, 2013 9:17 am

at the mo 0/200 have seen it at 30 ish
User avatar
gkar
Seasoned User
Seasoned User
 
Posts: 306
Joined: Tue Jun 26, 2012 1:40 pm

Registered Newsbin User since: 06/27/12

Re: Version 6.50 Beta 9 Available...

Postby Quade » Tue May 28, 2013 9:20 am

Ok that's good, I was wondering what the right number was. I've tested it up to 400 in the right number.

The while caching thing has been re-done done so, it's common to run them down to zero now. It it's zero for a long time it means that the disk is still probably bottlenecking. Each cache item is treated like a network packet and internally routed from functional block to functional block.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44988
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Version 6.50 Beta 9 Available...

Postby gkar » Tue May 28, 2013 10:38 am

its staying at 0/200 just saw it go 0/0 at end of file download. I guess 0/200 means the cache is always full? and my internet is only synched at 3.5mbs cant be bottlenecking drive.

btw tried setting cache to 400 at maxed out straight away to 0/400
User avatar
gkar
Seasoned User
Seasoned User
 
Posts: 306
Joined: Tue Jun 26, 2012 1:40 pm

Registered Newsbin User since: 06/27/12

Re: Version 6.50 Beta 9 Available...

Postby re838uk » Wed May 29, 2013 8:07 am

I think the server prioritisation has affected the header downloads in the following way.
If you give a lower priority to a server which also happens to be the main or only source for header downloads the downloads will just remain in queue and never start.
re838uk
Active Participant
Active Participant
 
Posts: 92
Joined: Thu Mar 19, 2009 11:14 am

Registered Newsbin User since: 03/19/09

Re: Version 6.50 Beta 9 Available...

Postby Quade » Wed May 29, 2013 8:21 am

Yes. You can't set a lower priority server and get header downloads from it in B9.

I already fixed it though. It'll be in B10.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44988
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Version 6.50 Beta 9 Available...

Postby mimauk » Thu May 30, 2013 1:39 pm

Something else I've noticed today - had some files in the Download list downloading away quite happily when I had a crash while closing a group tab too quickly after deleting the headers.

When I started NB up again the files that were in the download list went to the Failed Files tab as being duplicates - presumably because the par2 files for that set had already been downloaded and NB went to download them again when restarted??
mimauk
Seasoned User
Seasoned User
 
Posts: 328
Joined: Sun Aug 20, 2006 12:35 pm

Registered Newsbin User since: 03/29/06

Re: Version 6.50 Beta 9 Available...

Postby JanJonkman » Sat Jun 01, 2013 2:39 am

B9 still stalls one some .par2 files

When it does cpu utilization gets high an with tcpview i can see it still is getting data from the news server with about 4 Mbps.

Its not a large .par2 file after 12 hours it still is working on it with no progress at all

there is no debug logging available

Jan
JanJonkman
Active Participant
Active Participant
 
Posts: 68
Joined: Tue Jan 17, 2012 12:35 pm

Registered Newsbin User since: 12/10/10

Re: Version 6.50 Beta 9 Available...

Postby gkar » Sat Jun 01, 2013 7:14 am

Getting a lot of failed files saying ran out of retires. The same files when added back from failed list will download. Ive seen this with all types and size of file. btw have retries set to 2

update: setting retries to 10 has stopped it(download list status is saying 3 retries at mo). Easy to reproduce with a long list of jpgs.
User avatar
gkar
Seasoned User
Seasoned User
 
Posts: 306
Joined: Tue Jun 26, 2012 1:40 pm

Registered Newsbin User since: 06/27/12

Re: Version 6.50 Beta 9 Available...

Postby mkrubsack » Sun Jun 02, 2013 7:23 pm

Sometimes when I exit NB, it doesn't clear out the Chunks folder. There is still data there, and I have to manually delete it.
mkrubsack
Active Participant
Active Participant
 
Posts: 61
Joined: Sat Aug 25, 2012 5:39 pm
Location: California

Registered Newsbin User since: 08/25/12

Re: Version 6.50 Beta 9 Available...

Postby Semel » Tue Jun 04, 2013 4:52 am

something nasty is going on with my NB. just yesterday it was working fine and today no matter to what disk i try to download cache immediately drops to 0. All other usenet clients are working OK

D i need to delete one of the db3 files?

i reinstalled nod 32. but i set NB to be excluded from scans.
Semel
Seasoned User
Seasoned User
 
Posts: 317
Joined: Mon Feb 04, 2008 6:08 am

Registered Newsbin User since: 01/25/09

Re: Version 6.50 Beta 9 Available...

Postby gkar » Tue Jun 04, 2013 5:11 am

Icons in download list showing status aren't working. I have several files in list at mo, top is downloading but not showing arrow icon. Another file that isn't downloading is showing download icon(arrow). When i expand this file i see the top 3 parts showing the download icon, status column says downloading and size 375KB downloaded for each part, but no further data is being downloaded for this file.
User avatar
gkar
Seasoned User
Seasoned User
 
Posts: 306
Joined: Tue Jun 26, 2012 1:40 pm

Registered Newsbin User since: 06/27/12

Re: Version 6.50 Beta 9 Available...

Postby Quade » Tue Jun 04, 2013 6:41 am

Semel, just a guess but, it sounds like connections to the server are failing and all the work is stacking up waiting for the servers to connect and function. Either that or the chunks a leaking. I haven't seen a chunk leak recently.


G, I'm not seeing that but, I'll keep an eye open for it.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44988
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Version 6.50 Beta 9 Available...

Postby Semel » Tue Jun 04, 2013 7:11 pm

Quade wrote:Semel, just a guess but, it sounds like connections to the server are failing and all the work is stacking up waiting for the servers to connect and function. Either that or the chunks a leaking. I haven't seen a chunk leak recently.
.


if connections were failing i would see it on other clients as well,right? (i compared how they worked within a very short period of time and made several attempts afterwards)

What's a chunk leak? Any way for end user to check it out?
Semel
Seasoned User
Seasoned User
 
Posts: 317
Joined: Mon Feb 04, 2008 6:08 am

Registered Newsbin User since: 01/25/09

Re: Version 6.50 Beta 9 Available...

Postby Quade » Tue Jun 04, 2013 7:17 pm

Not at all. They could be failing in Newsbin because of a firewall or config problem and all other clients might still work fine. This is pretty easy to trouble-shoot. You look in the logging tab for any kind of errors. If you don't see any error, then my theory is wrong. If you see errors, you need to fix it. Hell, it might even be a bug in the priority stuff. Not sure I've tested the case where no server is priority 10 for example. It should work though.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44988
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Version 6.50 Beta 9 Available...

Postby anguilla » Wed Jun 05, 2013 8:13 am

Getting failure to search for additional pars - download has one bad rar, nb has list of pars but fails to process yet removes the file from the download list as if successful. If I then go back and manually enter a par from the file it will download and unrar properly. Not sure if its all downloads or intermittent at the moment but seen it 3 times since Beta 9 downloaded.
anguilla
n00b
n00b
 
Posts: 8
Joined: Thu Jan 03, 2008 2:46 am

Registered Newsbin User since: 06/28/04

Re: Version 6.50 Beta 9 Available...

Postby Quade » Wed Jun 05, 2013 8:19 am

Want to PM me a specific example? Subject and group is all I need. Password if it uses one.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44988
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97


Return to Newsbin Version 6 Beta Support

Who is online

Users browsing this forum: No registered users and 2 guests