640B18-3071 Option to set number of cache

[Ribble]

Please add an option to set number of cache. Now downloading and cache is 14/200 (0)

Older version during uploading was 12 using 1 upload connection.

640B18-3071 now too many to count, both uploading and downloading.

Running DSL 1000 Kbps download and 640 Kbps upload. Newsbin looking so far ahead that changing anything means long delays, such as "Read Post Body" as a new separate item.

Maybe fine on a T1 connection, but at lower connection speeds it is a mess with way too many parts being uploading or downloading at the same time. What I mean is like chunks are downloading (or uploading) from... part01.rar, part02.rar, part03.rar, part04.rar, part05.rar, part06.rar or more, and I would like to get a little closer to completing "part01.rar" first before looking ahead 5 more parts.

---
Just curious...
Downloading all headers may take a few hours. Using 2 connections for downloading.

Does "cache: 147/200 (0)" mean that 53 groups are queued for downloading headers and that I have to wait a few hours to "Read Post Body" as a new separate item or even a long wait before I can close Newsbin. I know that once a header download starts, it will continue even if I delete that header download from the Downloading Files window.

---
I see there used to be, and maybe what I am looking for...

[SETTINGS]
MemCacheLimit=0 (or some number)

---
Sorry. OK, if I am asking too many unrelated questions, please ignore everything but "Option to set number of cache"

[Quade]

How many connections are you running? They're what govern lookahead primarily.

[Ribble]

1 upload connection - This was done because it limited chunks uploading to 12 (on prior Newsbin)
2 connections for downloading - Not sure why I made this only 2, likely was to also limit number of chunks.

At DSL 1000/640 kbps download/upload speeds the number of connections makes little difference. The number of chunks in progress does not seem to make much difference either as long as it is at least 2 chunks per connection. So, I would like to try 2 chunks per connection instead of 52 chunks per connection (or whatever Build 3071 was increased to).

[Quade]

You can already set it. It's in the performance options:

[PERFORMANCE]
ChunkCacheSize = X

Don't go below 2 but, I'd probably set it to 4.

[Ribble]

[Performance]
ChunkCacheSize=4
PauseDownload=0
RepairPriority=0
RepairThreads=0
SaveChunksMode=0

ChunkCacheSize wasn't there, but it is now.

Somewhat strange with new upload of new file.

The first part "File.mkv.001" displayed and vanished. Only 4/25 chunks of that were uploaded.

Count 18 chunks being uploaded (lookahead). Could be 20 chunks, hard to count during upload.
Cache: 0/20 (0)

Aside from "File.mkv.001" screwup, this is more to my liking. Will have to ipload the missing chunks again and see what happens on the next file upload.


---
During file upload prior to changing "ChunkCacheSize", I doubleclicked the nbi file instead of opening with Wordpad. So another copy of Newsbin started. I didn't know you can do that, and maybe it should not. Could be just heavy Sunday night traffic at AW, as in my router seemed to be doing a lot of retries and finally ended up power ON/OFF the router, then resetting the computer. Problem was "Test Download Files" ran really slow.

[Ribble]

Re-uploaded "File.mkv.001" which only got 4/25 chunks. So that is fixed.

Started next file upload and that is working OK with no apparent problems.

Will later try "ChunkCacheSize=3", and work my way down to 2.

So, thanks Quade, I think I can live with the way it works now.

[Ribble]

Saga continues

## File upload number
Closed Newsbin, set "ChunkCacheSize=4", Opened Newsbin
01 - "File.mkv.001" displayed in "Downloading Files" window and vanished in less than 1 second 4/25 chunks actually uploaded
02 - Normal, no issues
Closed Newsbin, set "ChunkCacheSize=3", Opened Newsbin
03 and 04 (double size) queued as "Post to Group", "File.mkv.001" displayed and vanished. Few seconds later "File.mkv.002" vanished
___ "File.mkv.001" actually uploaded 5/25 chunks, and "File.mkv.002"actually uploaded 15/25 chunks. Uploading happened for both after they vanished.
___ Windows Task Manager showed the chunks uploading even though Newsbin looked idle.

So, either closing Newsbin and opening again or changing "ChunkCacheSize" was the setup for the fail.

Error Log
[01:46:40] ERROR Error: SSL Negotiation Failed, Host: ssl.astraweb.com Error: SSL Connection Failed: 1 Error 0 The operation completed successfully.
[01:46:40] ERROR DG - Connection Failed: ssl.astraweb.com Index:5
[01:47:11] ERROR Error: SSL Negotiation Failed, Host: ssl.astraweb.com Error: SSL Connection Failed: 1 Error 0 The operation completed successfully.
[01:47:11] ERROR DG - Connection Failed: ssl.astraweb.com Index:5
[01:53:56] ERROR Error: WSARecv Socket Error Code: 10060 A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond.

Tried again
03 and 04 (double size) queued as "Post to Group", "File.mkv.001" displayed and vanished. "File.mkv.002" uploaded normally. "File.mkv.001" actually uploaded 5/25 chunks.

[02:16:35] ERROR Error: SSL Negotiation Failed, Host: ssl.astraweb.com Error: SSL Connection Failed: 1 Error 0 The operation completed successfully.
[02:16:35] ERROR DG - Connection Failed: ssl.astraweb.com Index:5 240 <526dfb99$0$9676$c3e8da3$e408f015@news.astraweb.com> Article posted

Trying 03 and 04 again, this time with "Pause The Download" set then cleared to let the files upload.
Looks good this time. Nothing vanished. Cache: 0/20 (0) and 20 chunks lookahead. Still have "ChunkCacheSize=3"

On upload, would still like to get the lookahead chunks down to 2 (or 2 per connection), but lower limit appears to be 20. Download doesn't matter too much.

AMD 64 bit 4-core -16gb RAM (11716mb Free) - Win7 64bit Home Premium

[Quade]

Posting doesn't really use the chunk cache so, I'm not clear why there's any impact at all. Then again I never tested it. The chunk cache is used for 2 things.

1 - Sending commands to the workers.

2 - Storing data temporarily for downloading files.

I'll have to try posting with a limited chunk cache.

[Ribble]

I do notice that my "Free" RAM memory goes up by the amount of the chunk size as it is posted (uploaded). About 640kb for each chunk. So it would seem that if am posting 1,000 chunks then Newsbin grabbed 640mb of "Available" or "Free" RAM. Not that it matters, except if I am trying to find reasons for uploading errors.

Tried to explain this before. Windows Task Manager shows:

Physical Memrory (MB)
Total 16382
Cached 3514
Available 13317
Free 10472

Newsbin likes "Free" memory. But not sure if it likes "Available" memory when "Free" memory drops to zero, and "Free" memory will drop to zero if I let it.