Version 6.30 Beta 3 Available...

[dexter]

Beta 3 includes changes to better support non-English characters both in processing posts and in configurations. Also some changes how Newsbin works when AutoPAR is diabled, imore like Version 5.59 where PAR files get sent to the Wish List. This is only if you disable AutoPAR.

More details and the download link is on the Newsbin Beta Page.

Any issues with this release, please reply to this thread, contact us through our Technical Support Form or swing by our irc channel - #newsbin on irc.newsbin.com.

[b38kje2nq]

Thank you for the new beta! Two small issues:
1. the download page links to the beta 2 install file in the link pointed to by "try this one";
2. the post list displays nothing for user names with an umlaut (e.g. "ä").

[Quade]

Bunch of fixes for stuff reported in B2 as well.

5.59 mode:

If you run with Autopar disabled, Newsbin doesn't compact the download list and does stick all but, one par into the wish list, like 5.59. Next beta will have an option to let you download all the pars too if that's what you really want.

[anguilla]

I'm now getting:

PAR Repair is Disabled - Par2dll.dll missing

This error was not present in Beta 2.

The 64 bit version should be using par2dll64.dll I think (which is present) so I think this is a coding error.

[dexter]

The single core par2repair64.dll file was messed up. I've just uploaded a new build including the correct file. Please re-download B3 and give it a try.

The message saying par2dll failed to load is now wrong. It should say par2repair.dll now. Quade will fix it for the next release.

[cj1067]

I just downloaded the latest beta and it still says

PAR Repair is Disabled - Par2dll.dll missing

[Quade]

Install the 32 bit version and run it till Dex gets this straightened out.

[b38kje2nq]

@Quade: Apologies if you did see my earlier post in this thread, but I have two issues with beta 3, with the second one a bit awkward:

1. the download page links to the beta 2 install file in the link pointed to by "try this one";
2. the post list displays nothing for user names with an umlaut (e.g. "ä"), i.e. the "From:"-column seems blank for those user names.

[dexter]

@Quade: Apologies if you did see my earlier post in this thread, but I have two issues with beta 3, with the second one a bit awkward:

1. the download page links to the beta 2 install file in the link pointed to by "try this one";
2. the post list displays nothing for user names with an umlaut (e.g. "ä"), i.e. the "From:"-column seems blank for those user names.

1) Oops, forgot to update that link. I'll fix it now.
2) Quade has noted this and will fix it for the next beta.

[b38kje2nq]

@Quade: Apologies if you did see my earlier post in this thread, but I have two issues with beta 3, with the second one a bit awkward:

1. the download page links to the beta 2 install file in the link pointed to by "try this one";
2. the post list displays nothing for user names with an umlaut (e.g. "ä"), i.e. the "From:"-column seems blank for those user names.

1) Oops, forgot to update that link. I'll fix it now.
2) Quade has noted this and will fix it for the next beta.

Thank you. Sorry for posting twice, but it seemed like my original post hadn't been picked up and scrolled out of sight.

[Quade]

I noted it immediately. The first thing isn't me and the second, I know about but, forgot to fix.

Sorry for not acknowledging it earlier.

The changes to support even more foreign languages means that Newsbin is looking for UTF-8 in the from field. Older headers aren't encoded in UTF-8. That's why some froms are blank.

[dexter]

I'm now getting:

PAR Repair is Disabled - Par2dll.dll missing

This error was not present in Beta 2.

The 64 bit version should be using par2dll64.dll I think (which is present) so I think this is a coding error.

I've uploaded a modified installer. Please re-download from the beta page at http://www.newsbin.com/beta.php and let me know if it resolves this problem.

[anguilla]

Yep, that did the trick - no errors on load now

[mimauk]

Something strange has just appeared with this latest beta.

I have a GOG with 11 various tv groups and in the Groups List Tab the 'new records count' was showing zero after an update. When I expanded the GOG the last group in the list, #11, was showing as never having been updated, no filter profile and no download path. I deleted the offending group leaving 10 groups in the list and the #10 group was then showing as never been updated, no filter profile and no download path.

The tv GOG is the last in the groups list tab. I have other GOG further up the list which show everything correctly.

Previous to this beta the tv GOG was always slow to show the correct count in the 'new records column' - maybe 3 to 4 minutes after the last group was updated.

I don't know if it's because I might have some corrupt files in the database.

[Quade]

It's a cosmetic bug. If you want to work around it. Add a topic that starts with Z so it's the last item in the list. Then everything except the new fake Z topic will paint properly.

[lisle]

2. the post list displays nothing for user names with an umlaut (e.g. "ä").

The subject line is also blank if it contains the grave accent "`" (0x60), and probably for the "no-break space" (0xa0).

[Quade]

Is that search, NZB's or headers? If you PM me an example I'll check it out.

I'm not seeing it yet. Subject has been UTF8 through most of 6.

[mimauk]

It's a cosmetic bug. If you want to work around it. Add a topic that starts with Z so it's the last item in the list. Then everything except the new fake Z topic will paint properly.

thanks for the reply - nothing to worry about.

[Maelstroem]

In my GOGs (I have 2) ALL groups are disabled but in B3 some groups are showing as 'enabled' (Blue dot, white tick) then those groups become 'disabled' after a few seconds when I scroll though the list, this happens everytime I open the GOG, think it's related to what mimauk is seeing as my last group in the last GOG is permanently 'enabled'. Created a group Z as mentioned in the last GOG and made it the last group and now can 'disable' that permanently enabled group.

[Semel]

hm.. i set retries to "2"

Yet i have now 4 already and it is still counting to 5( in %)

and NB didnt start repairing it

i restarted NB, then it started downloading necessary par2 files, then started repairing while doing more than 2 retries again (see below)



status of some files are still "downloading" (kinda strange then that it started repairing)
did i get something wrong and i need to set something else in the options?

PS btw its not really clear what does % mean in terms of retries..

[mimauk]

status of some files are still "downloading" (kinda strange then that it started repairing)
did i get something wrong and i need to set something else in the options?

.

I'm getting the same thing - the top file in the download list is downloading as usual with a nice progression of the indicator bar, yet the file below it is showing various retries with nothing showing in the progress bar. When the top file has finished compiling and disappears from the list then the second file goes to the top and the progress bar shows it downloading as normal and the new second file starts showing the retries and so on as each file completes. I think it's just reporting it incorrectly something similar to the GOG problem I mentioned above.

[Quade]

The retry limit is how many times it'll retry before it starts looking to assemble incomplete files. Before, on the second retry it would assemble and repair as long as it thought it had enough blocks and pars. Now, it'll retry N times and then consider assembling the incomplete files. Some people with less than perfect servers actually need retries to get all available blocks so, they want this. If Autopar is busy doing something, nothing else can unrar/repair so, the retry counters will still tick over.

You can think of retry count as the threshold before it'll think about assembling incompletes. It still won't assemble incompletes if it doesn't think it has enough of the file to succeed.

[Semel]

Some people with less than perfect servers actually need retries to get all available blocks so, they want this

well i have nothing against the general idea. If im not mistaken i even wanted something like that =)

NB downloads articles,Nb cant get XX articles from the server, NB retries each) article specified ammount of times (in my case 2) then if still nothing can be downloaded it assembles those incomplete files files, gets spme par2 and starts repairing.
Right?

Well, for some reason until i restarted NB (though this was my first experience with the new build)it kept doing retries well beyond specified range(2) = no assembling, no repairing


PS Btw Quade, i found how they call this feature i wanted u to implement
Found it in sabnzbd

Pause Downloading During Post-Processing - pauses downloading at the start of post processing(unpacking\rapairing) and resumes when finished.

To be honest i find myself sticking more and more to sabnzbd due to the lack of this feature in NB. Disk thrashing makes my ears bleed.


PS i tried again another item. This time it worked =) Nice

[Legend]

I tried to post this, but now I can't find it anywhere, so I'm sorry, but this is likely a duplicate. I am running 6.30 B2 - 1695. Apparently since version 6 headers are being skipped when downloading headers. Whether I select New or All out of perhaps 5 groups of 100 files, 2 or 3 will be missing from the list of posts. And so I can't download a complete movie that has been posted in several parts. If I use "Search" I can find the missing posts and download them, but it's a real pain to have to do that with virtually every multiple part post that I want to download. I saw lots of reports of this issue, but it was always explained away with "just wait awhile till the database gets done updating". Even days later, the missing posts do not show up. I can reload all headers and they don't show up. If I use Search, there the missing ones are and then I can download them. I sure hope this gets fixed for real.

[Quade]

PM me an example. Don't post it here. No other reports of this at the moment. Are these sets that are posted over a week or something? Most sets of files posted to usenet are posted within a couple hours. Stuff posted over the course of multiple days might be problematic.

[Moondawgie]

With 6.30, Beta 3, Build 1718, whenever I use the Pause button to pause downloads the pause only lasts for 7 seconds.

I've verified that the checkbox for the option setting for -> Network -> Network Settings -> Use Pause Timeout is not checked.

And a review of the contents of the associated newsbin.nbi file shows (What I think are the relevant settings):

UsePauseAutoOff=0
PauseAutoOff=0
RestartPauseTime=60

Am I missing something? How can I pause downloads until I decide to continue downloads?

[dexter]

Do you have the scheduler turned on?

[egandt]

I just upgraded to 6.30B3 x64 and am seeing that even though the RAR files are clean and will decompress manually Newsbin is not decoding them instead I see a message such as "Retry: 3 Next retry: 110% Completed", yet QuickPar states "Repair not needed", which means that it should be able to decode the RAR file. As a result I'm currently forced to manually repair and extract each and every file by hand.

Even force assembly is not working for these files.

Any idea whats wrong?

[Moondawgie]

Do you have the scheduler turned on?

Yes. Disabling the scheduler resolved this issue.

I don't remember ever having intentionally enabled the scheduler. Is it enabled by default?

And, is the use of [Schedular], rather than, [Scheduler] in the Newsbin.ini file intentional? Or is that spelling a typo?

Thank you for providing the solution.

[Quade]

Even force assembly is not working for these files.

Is something else unraring already? If something is already unraring? These won't unrar until it finishes. There's only one unrar at a time.

[Quade]

And, is the use of [Schedular], rather than, [Scheduler] in the Newsbin.ini file intentional? Or is that spelling a typo?

Spelling doesn't matter in the NBI as long as it matches what I expect. I don't actually run a spelling checker on the configuration file.

It's off by default but, there's a block on the status bar you can click to enable (and watch status from). I suspect you might have just clicked it.

[egandt]

Even force assembly is not working for these files.

Is something else unraring already? If something is already unraring? These won't unrar until it finishes. There's only one unrar at a time.

Here is an example on the issue: I downloaded <something you shouldn't post>

It then continues to retry assembly of the package, but will never succeed, for instance it now says: 395.1 MB/434.9 MB | Retry 3 Next Retry: 258.0% completed
The percentage will change, but it never does anything about assembling the file.

Now if I exit newsbin and check the file with quickpar, I have 0 missing blocks. Next if I run winrar it is correctly extracted as nothing was missing. It appears to me there is something wrong with the par engine installed as part of the 6.30b2(3), is this possible?


Looking at it I had a file named par2dll64.dll dated 9/30/11 and par2repair64.dll dated 1/12/2012

So I uninstall and reinstall newbin, that removed the instance of par2dll64.dll, so I only have the single file par2repair64.dll dated 1/12/2012

So now I get a different issue, instead of the Retrying, I still see messages such as: [07:41:59] ERROR - PAR file is Damaged, Unable to Add Parfile:YYYYY.mkv.vol07+08.par2
Then at the end I have a message: [07:42:40] HIGH - CAutoPARDB::Addfile Failed

Finally the file is removed from the download list, however yet again nothing is done with it, and I'm left with the par2 files and rar files in the download directory. Again the par2 files say no repair is needed and the rar's extract without issue.

Next I tried uninstalling again and rolling back to 6.21, yet same issues as I saw initially are again present.

Thanks,
ERIC

[egandt]

A separate issue with the 6.30B3 I've seen is the last group (on the list) shows up as empty (even if it contains posts) and under Filter Profile it will always say none, I got around this by creating a folder named ZZZ so that this is never the case. This is also true of a folder it will appear as empty (zero new records) and filter profile of None, however if you expand it all but the last group will show the correct information.

[Quade]

CAutoPARDB::Addfile Failed

Re-install are seldom if ever needed in Newsbin. It's not like other windows apps. Worst case, you might have to delete some of the data files.

I think your problem is a corrupt Autopar2.db3 files. Exit Newsbin, delete this file and I'll bet everything starts working again.

Don't post what you're downloading.


The group issue is fixed in the coming B4. Thanks.

[egandt]

CAutoPARDB::Addfile Failed

I think your problem is a corrupt Autopar2.db3 files. Exit Newsbin, delete this file and I'll bet everything starts working again.

Correct that fixed the problem.

Thanks,
ERIC

[jamng]

Not sure if the Purge to Display Age or Compact Database is actually doing anything. Purge to Display Age sits there without any visual indicators then its gone. In the past I'd see a bar going left to right, etc. Compact Database, shows stuff in the window that looks like its recovering but in the bottom where it says space recovered is 0. If I run it again the files do looks smaller so it might just be showing 0 and actually doing stuff.

[Quade]

I confirmed that "Compact Database" is working. It's not displaying the final complete results though. The results listed in the list of groups is accurate.

I also confirmed that "Purge to display Age" works.

[magician1962]

In B3 I have noticed many more occasions of Not Responding, or the curor changing to the busy icon for extended periods, than previous versions.

Also When moving @100000 items from a group to a custom list, it can take a number of hours . Is that expected?
In the mean time the program can appear to be non responsive, though downloads may be working in the backgroud, there is no way to stop/interupt the program if there is need to stop the downloads. The only option is task manager

I have on two occasions now copied over 1,000,000 articles to a custom list for later sorting, which takes days, and then had the program crash resulting in only a few thousand items being displayed. This occurs even though the program has been correctly shut down in the mean time, so the last close may have had 500,000 items. And of course I have deleted the items from the main group once they have been copied,( a move option would be so nice ) so have to download it all and start again. Is there a possible casue of this or, if not, is there a way of adding some protection againt such massive loss, maybe some form of optional backup of the files at start-up, with a recovery option that the user can fall back on in these scenarios?

Win7-64
i7-920
12GB ram

[Quade]

Also When moving @100000 items from a group to a custom list, it can take a number of hours . Is that expected?

You're testing it far beyond what I did. Meaning you're in uncharted territory. That said, I tried to reproduce what you did and have to agree, it's not working well with very large number of records and/or very large records. I tried copying 30 TB worth of post information to a custom list and it got progressively slower and RAM usage creped up with each additional file set.

The design in the version you're using stages all the records in ram before writing them to the custom list. I spent a couple hours re-doing it last night to do "on the fly" insertion and also figured out what was causing the RAM use to creep up. It's at least 10 times faster now with large numbers of sets. Copied 20 TB worth of sets in under 5 minutes. Should be in B4.

Thanks.

[magician1962]

Hi Quade thanks for looking at that, it sounds a massive performance improvement, I look forward to seeing it in action

The other part of my issue may be a red herring Somehow the Display setting was reading "Display Age" instead of 'All Files' so assume it was my fault as settings may not have saved.


Just noticed what appears to be a bug in the options window. Select 'Switches' in the left pane, or any other. Then use the up/down arrows to move focus. You can move up or down 1, but then focus moves to right pane. I would assume it should stay on the left.

[jamng]

I have Delete Pars and RARs on successful UnRAR. It doesn't seem to delete the RAR files with an *.S01, *.S02 extension but everything else works correctly.