newsbin.com

A long requested feature has been implemented with B9: Server Priorities. It supports 10 levels. Priority 10 gets used first. Multiple servers can be set at the same priority level if you want. A server at lower priority only gets used if all servers above it fail, and only for that part of a post that failed.

• Implemented new Server Priority scheme.
• Fixed issue with NZB Watch not using unrar path.
• Made changes so Newsbin should keep Windows from going to sleep if its busy.
• Moved proxy settings back to main server window
• Now can identify zip files inside of rar files as spam

More details and the download link is on the Newsbin Beta Page.

Please direct any questions or bug reports as a reply to this thread or through our Technical Support Form.

NOTE: Eset and ClamAV are detecting false postives in the Beta 9 installer. This happens from time to time. 20 other AV scanners thought it was fine. Details here: http://virusscan.jotti.org/en/scanresul ... 175c20986c

Edit: Quade Priority 10 means use it first

Download link for B9 still points to B8

dexter wrote:A long requested feature has been implemented with B9: Server Priorities. It supports 10 levels. Priority 1 gets used first. Multiple servers can be set at the same priority level if you want. A server at lower priority only gets used if all servers above it fail, and only for that part of a post that failed.

I thought it was the other way around? The higher the number the more likely it is to get used?

Having said that I can see some logic in the fact that it might be more intuitive that 1 should be used ahead of 2 etc, so maybe this is the way it should work?

Just tried downloading headers from my providers with the server priorities set as follows
Virginmedia = 10
EasynewsUS = 4 (Fill Server)
Easynewseu = 4 (Fill Server)

The headers downloaded from Virgin ok but none from Easynews. Tried a couple of times with the same result.

Reset all the servers to 10 and the headers downloaded from both providers.

You're right Itimpi. 10 gets used first. If a server is active it can potentially get used. There's no "don't use" priority.

All the servers within the same priority will get used before it moves on to the next lowest priority.

Reset all the servers to 10 and the headers downloaded from both providers.

I'll check it out, thanks.

dexter wrote:[*]Moved proxy settings back to main server window

Still seems to be in advanced for me.

You sure you're running B9?

The alternate link is still for B8 !!!
Didn't tried the "normal" link.

ozzii wrote:The alternate link is still for B8 !!!
Didn't tried the "normal" link.

Just fixed it, thanks.

Quade wrote:You sure you're running B9?

Sure am heres the screen shot.

The SSL bit doesn't appear until I click on the Really Advanced button.

I see the button right there. I was in the really advanced section and I pulled it back out.

AGGH my bad, I was thinking of the SSL V2 bypass, not the proxy settings.

Seeing a lot what look like connections opened in download list. Far more than I have setup.

I have 8 servers setup. 2 to astraweb(3 connections each) set as normal servers and lvl 10. Rest are fill and are lvl 4(2 connections each). I just disabled all but one server and set that to one connection. Seeing a lot less but is still opening/showing about 9/10 of these lines at a time.



btw my connections window is showing 1 connection right now. Guess this just a change to the way its processing?

thanks for the server priority

edit: just rebooted NB and watched it download the first block from all the single part items in the download list!

Download has been re-designed. What you're seeing is really pending downloads. They're queued up and waiting for a worker thread to start the actual download.

ok thx. Am seeing chunks in the chunks folder for the single part files i mentioned earlier. Is it actually downloading data?

btw i guess the concept of fill server is out the window now? and i can just set what where fill servers to normal and set a lower priority

1 - If you see chunks then it has already downloaded the data. Chunks only appear after download. How many cache blocks do you have?

2 - Priority replaces fill. It's more precise and granular too. There's no concept of fill for the whole file. It's always "per chunk" now. You can simulate fill by making one server 10 and the other 9 (or 1)

37. Each chunk is 379kb and theres 37 files, each single part.

btw NBisnt downloading parts sequentially. So say part 5 is half way through downloading, a load of blocks of part 6 get qued then start downloading before part 5 is all downloaded. I guess this is part of the new system? If just watched it download part 22(of a 43part file) before its even got part 1 down. This would only be a problem if i wanted to sample a large file.

tried multi and single part files/combos of, and on restart NB is ignoring its download list order. It just starts downloading all files.

thx for info re fill servers

I see that happening if there's a problem downloading the first chunk of the file. It'll start working on the next file or even further down if a "first chunk" is still pending. The goal is to keep Newsbin using 100% bandwidth. Download order is important but, secondary to maximizing speed.


Down in the status bar how many "Cache" chunks are you showing?

It'll be possible to tweak some of this behavior eventually. I sort of need to characterize how it's downloading first to know how to change it. For example, right now it sounds like it'll get way ahead of itself queuing posts to the download engine. I might need to limit the queue depth.

at the mo 0/200 have seen it at 30 ish

Ok that's good, I was wondering what the right number was. I've tested it up to 400 in the right number.

The while caching thing has been re-done done so, it's common to run them down to zero now. It it's zero for a long time it means that the disk is still probably bottlenecking. Each cache item is treated like a network packet and internally routed from functional block to functional block.

its staying at 0/200 just saw it go 0/0 at end of file download. I guess 0/200 means the cache is always full? and my internet is only synched at 3.5mbs cant be bottlenecking drive.

btw tried setting cache to 400 at maxed out straight away to 0/400

I think the server prioritisation has affected the header downloads in the following way.
If you give a lower priority to a server which also happens to be the main or only source for header downloads the downloads will just remain in queue and never start.

Yes. You can't set a lower priority server and get header downloads from it in B9.

I already fixed it though. It'll be in B10.

Something else I've noticed today - had some files in the Download list downloading away quite happily when I had a crash while closing a group tab too quickly after deleting the headers.

When I started NB up again the files that were in the download list went to the Failed Files tab as being duplicates - presumably because the par2 files for that set had already been downloaded and NB went to download them again when restarted??

B9 still stalls one some .par2 files

When it does cpu utilization gets high an with tcpview i can see it still is getting data from the news server with about 4 Mbps.

Its not a large .par2 file after 12 hours it still is working on it with no progress at all

there is no debug logging available

Jan

Getting a lot of failed files saying ran out of retires. The same files when added back from failed list will download. Ive seen this with all types and size of file. btw have retries set to 2

update: setting retries to 10 has stopped it(download list status is saying 3 retries at mo). Easy to reproduce with a long list of jpgs.

Sometimes when I exit NB, it doesn't clear out the Chunks folder. There is still data there, and I have to manually delete it.

something nasty is going on with my NB. just yesterday it was working fine and today no matter to what disk i try to download cache immediately drops to 0. All other usenet clients are working OK

D i need to delete one of the db3 files?

i reinstalled nod 32. but i set NB to be excluded from scans.

Icons in download list showing status aren't working. I have several files in list at mo, top is downloading but not showing arrow icon. Another file that isn't downloading is showing download icon(arrow). When i expand this file i see the top 3 parts showing the download icon, status column says downloading and size 375KB downloaded for each part, but no further data is being downloaded for this file.

Semel, just a guess but, it sounds like connections to the server are failing and all the work is stacking up waiting for the servers to connect and function. Either that or the chunks a leaking. I haven't seen a chunk leak recently.


G, I'm not seeing that but, I'll keep an eye open for it.

Quade wrote:Semel, just a guess but, it sounds like connections to the server are failing and all the work is stacking up waiting for the servers to connect and function. Either that or the chunks a leaking. I haven't seen a chunk leak recently.
.

if connections were failing i would see it on other clients as well,right? (i compared how they worked within a very short period of time and made several attempts afterwards)

What's a chunk leak? Any way for end user to check it out?

Not at all. They could be failing in Newsbin because of a firewall or config problem and all other clients might still work fine. This is pretty easy to trouble-shoot. You look in the logging tab for any kind of errors. If you don't see any error, then my theory is wrong. If you see errors, you need to fix it. Hell, it might even be a bug in the priority stuff. Not sure I've tested the case where no server is priority 10 for example. It should work though.

Getting failure to search for additional pars - download has one bad rar, nb has list of pars but fails to process yet removes the file from the download list as if successful. If I then go back and manually enter a par from the file it will download and unrar properly. Not sure if its all downloads or intermittent at the moment but seen it 3 times since Beta 9 downloaded.

Want to PM me a specific example? Subject and group is all I need. Password if it uses one.