Fails to download PARs wheen needed.

This is the place to help test and discuss Version 6 Beta releases.

Fails to download PARs wheen needed.

Postby fableman » Mon Jun 20, 2011 12:21 pm

When I downloaded a bad post I need to select the PARs manually to be downloaded and then newsbinpro rebuild and fix and unrar soo its all fine.

Why don't Newsbinpro check if a download is missing files and then automatic download all PAR's ?
Image
fableman
Seasoned User
Seasoned User
 
Posts: 118
Joined: Wed Apr 18, 2007 6:28 am

Registered Newsbin User since: 12/25/06

Re: Fails to download PARs wheen needed.

Postby Quade » Mon Jun 20, 2011 12:25 pm

Not enough information to even start talking about this.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44984
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Fails to download PARs wheen needed.

Postby fableman » Mon Jun 20, 2011 12:33 pm

Humm.

I think you have.

If I manually select the PARs in the list and download them, the rebuild is starting and all fine.

The problem is that I should not need to manually select the PAR's, newsbinpro should do that instead of keeping them on pause and waiting for ever.

I always have problem with this, I delete the databases and let them rebuild, still problem.

What more do you need ?
Image
fableman
Seasoned User
Seasoned User
 
Posts: 118
Joined: Wed Apr 18, 2007 6:28 am

Registered Newsbin User since: 12/25/06

Re: Fails to download PARs wheen needed.

Postby itimpi » Mon Jun 20, 2011 1:22 pm

It works fine for me. There has to be some other factor at work as well that is affecting your system.

How old are the posts in question? Newsbin will not automatically assemble (and thus fix) files that are newer than the incomp0letes timeout period (default is 48 hours). If you manually assemble such incomplete files then the par download and repair will kick in.
The Newsbin Online documentation
The Usenettools for tutorials, useful information and links
User avatar
itimpi
Elite NewsBin User
Elite NewsBin User
 
Posts: 12607
Joined: Sat Mar 16, 2002 7:11 am
Location: UK

Registered Newsbin User since: 03/28/03

Re: Fails to download PARs wheen needed.

Postby biosteel » Tue Jun 21, 2011 1:34 am

This usually affects files which have pars named differently than the source, ie:

"somename.rar"
"A long and elaborate name with no relation to the rar files.par2"

Here is a pretty long list of feature requests, I'd love to see in some shape or form, believing they will enhance V6:

If possible, I'd love a switch to enable pars to be always downloaded, regardless of AutoPar being active or not.
Or pars being be affected by Bypass Filters download option.
It's tough to manually download needed pars at times.

Progress on restarting Newsbin with a downloadlist filled with already downloaded posts, waiting for unrar/par, progress is not always clearly shown, ie no green unrar bar, percentages also at times don't match, I think related to par operation, don't know exactly yet. In any case a short status update on par recovery being active would be nice. I'm sorry if i missed it, i did try and look out for it.

Then maybe an option to stop downloading when the chunk cache is full. enabling disk activity to catch up. Or making AutoPar do its work after the whole download list is done.

Oh and please, manual group list ordering.
Alternatrively being able to nest folders would do the trick, too. Makes local searches and group updates a lot nicer.

V6 is pretty neat now, looking forward to the final release.
Thanks Quade!
biosteel
Occasional Contributor
Occasional Contributor
 
Posts: 17
Joined: Tue Jul 08, 2003 8:01 pm

Registered Newsbin User since: 04/01/03

Re: Fails to download PARs wheen needed.

Postby billynews » Tue Jun 21, 2011 3:36 am

itimpi wrote:Newsbin will not automatically assemble (and thus fix) files that are newer than the incomp0letes timeout period (default is 48 hours).


good to know.
Is it possible to change this timeout period?
Didn't find any option, but maybe it's possible to add something to the NBI?
billynews
Seasoned User
Seasoned User
 
Posts: 139
Joined: Sat Apr 12, 2008 2:57 pm

Registered Newsbin User since: 07/15/07

Re: Fails to download PARs wheen needed.

Postby itimpi » Tue Jun 21, 2011 6:45 am

billynews wrote:Is it possible to change this timeout period?
Didn't find any option, but maybe it's possible to add something to the NBI?

It is documented in the Advanced Usage section of the User Guide.
The Newsbin Online documentation
The Usenettools for tutorials, useful information and links
User avatar
itimpi
Elite NewsBin User
Elite NewsBin User
 
Posts: 12607
Joined: Sat Mar 16, 2002 7:11 am
Location: UK

Registered Newsbin User since: 03/28/03

Re: Fails to download PARs wheen needed.

Postby fableman » Tue Jun 21, 2011 9:20 am

Newsbinpro always have problems with automatic things during all my years I been using it.

I was really hoping that V6 would end the download problems but problems still there and I got a feeling the devs don't think there is a problem and it works like it should. "If post is broken it should be a manual thing to fix it."

For me I don't care if the time stamp on the PARs are wrong or not, Newsbinpro should just try different things to fix it automatic.

Why can't we have a option [x] Download PAR's everytime files are missing. (feels even wrong to ask for this options cos that how it should be working no matter what)
Image
fableman
Seasoned User
Seasoned User
 
Posts: 118
Joined: Wed Apr 18, 2007 6:28 am

Registered Newsbin User since: 12/25/06

Re: Fails to download PARs wheen needed.

Postby Quade » Tue Jun 21, 2011 9:26 am

You seem to miss the point that it IS working automated for most people. I don't have to jerk with my downloads most of the time, I add them, they download and it repairs.

So, yeah, you've not convinced me there's a problem yet. You've not given enough information for me to figure out what's happening. Are the files incomplete, are they complete, are they old, are they new. You've come here and said "it's broke" but, that doesn't help me figure out what's happening.

For example if you'd said:

"I add files to the download list, I can see that some are incomplete or failed to download some chunks and I want it to assemble them quicker"

I'd have some ideas for you. As it is, I've got nothing to work with.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44984
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Fails to download PARs wheen needed.

Postby fableman » Tue Jun 21, 2011 10:32 am

I understand you want all input you can get, but it's kinda hard to give much input when selecting a .nzb and the download starts and thats it.
Sometimes auto downloading PAR's working other times not.

For me it feels like newsbinpro don't understant that the downloaded item have missing files/chunks and that PAR's are needed.

Next time I find a download thats not working , is there any debug I can start and send you to solve this?
Image
fableman
Seasoned User
Seasoned User
 
Posts: 118
Joined: Wed Apr 18, 2007 6:28 am

Registered Newsbin User since: 12/25/06

Re: Fails to download PARs wheen needed.

Postby fableman » Tue Jun 21, 2011 10:55 am

Another PAR (problem)

I tried a .nzb file and it started to dl the PARs first, should it do that ?
Something is strange to me.




And after all needed files are downloaded and green ( but 2 last Pars are not downloaded correct) Nothing happends.

Edit: pictures removed.
Image
fableman
Seasoned User
Seasoned User
 
Posts: 118
Joined: Wed Apr 18, 2007 6:28 am

Registered Newsbin User since: 12/25/06

Re: Fails to download PARs wheen needed.

Postby Quade » Tue Jun 21, 2011 11:28 am

When it downloads pars, it checks them. If they're invalid, it downloads the next par and so on until it finds a valid par. What it looks like is that the downloaded pars can't be parsed so, it's trying them one at a time. If no valid pars show up, it probably won't unpause the rest of the files.

I checked out that file and Quickpar and newsbin both say the pars are bad.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44984
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Fails to download PARs wheen needed.

Postby fableman » Wed Jun 22, 2011 3:48 am

But it did download all the files and I was forced to start Unrar myself and everything was correct.

Newsbinpro should atleast try unraring when all needed files are there, even if a par is wrong.

Newsbin should try more options when it run into trouble then just stop and give up.
Image
fableman
Seasoned User
Seasoned User
 
Posts: 118
Joined: Wed Apr 18, 2007 6:28 am

Registered Newsbin User since: 12/25/06

Re: Fails to download PARs wheen needed.

Postby itimpi » Wed Jun 22, 2011 4:04 am

fableman wrote:Newsbin should try more options when it run into trouble then just stop and give up.

The autopar facility relies on having at least one valid par file to chek the download before any automated attempt is made to unrar. It is possible that Quade might make this unecessary in some future release, but that is current behavior.
The Newsbin Online documentation
The Usenettools for tutorials, useful information and links
User avatar
itimpi
Elite NewsBin User
Elite NewsBin User
 
Posts: 12607
Joined: Sat Mar 16, 2002 7:11 am
Location: UK

Registered Newsbin User since: 03/28/03

Re: Fails to download PARs wheen needed.

Postby fableman » Wed Jun 22, 2011 6:52 am

itimpi wrote:
fableman wrote:Newsbin should try more options when it run into trouble then just stop and give up.

The autopar facility relies on having at least one valid par file to chek the download before any automated attempt is made to unrar. It is possible that Quade might make this unecessary in some future release, but that is current behavior.


Then something is not working with that "check". There where like 5 correct PARs and 2 broken PARS, and all other files where correct, newsbin downloaded everything but auto unrar did not start.
Image
fableman
Seasoned User
Seasoned User
 
Posts: 118
Joined: Wed Apr 18, 2007 6:28 am

Registered Newsbin User since: 12/25/06

Re: Fails to download PARs wheen needed.

Postby Quade » Wed Jun 22, 2011 8:43 am

If we're talking about your example, the pictures of which I deleted, the Pars were all bad. If you load them up in QuickPar, Quickpar says "no blocks found" on the pars and if you try to refresh, QUickpar crashes. Quickpar is the reference, if it doesn't work in Quickpar, it's not going to work in Newsbin. If you're downloading files from the same poster and his pars are corrupt like this, I'm not surprised you're having problems. They're simply posted wrong. That's why you have to handle this manually.

I did a quick survey of this posters files and most have valid PAR files so, apparently this particular set of files was just screwed up. The bad files were posted in the past day so, hopefully he's not using some new, broken posting software. Looks to me like he's re-posting other people's posts so, that's probably why the PARS were bad. Testing one of his other file sets, I'm getting incomplete files across my servers. So, to trigger Autopar on the newest files (under 48 hours old), I had to right click "Assemble incompletes" to force it to assemble. I wonder if that's your issue too?

Something interesting I noticed is, if you have a bunch of incomplete files and assemble them, it takes Newsbin awhile to scan the files and determine how complete they are. In that time, it looks like it's doing nothing and the pars remain paused. Wonder if this is what you're seeing? Once it finishes the scan, it starts to download pars.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44984
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Fails to download PARs wheen needed.

Postby billynews » Thu Jun 23, 2011 1:54 am

itimpi wrote:It is documented in the Advanced Usage section of the User Guide.


thx for the hint.
I have to admit the last time I had a look at the User Guide is some years ago.
billynews
Seasoned User
Seasoned User
 
Posts: 139
Joined: Sat Apr 12, 2008 2:57 pm

Registered Newsbin User since: 07/15/07

Re: Fails to download PARs wheen needed.

Postby fableman » Thu Jun 23, 2011 1:21 pm

Quade wrote:Something interesting I noticed is, if you have a bunch of incomplete files and assemble them, it takes Newsbin awhile to scan the files and determine how complete they are. In that time, it looks like it's doing nothing and the pars remain paused. Wonder if this is what you're seeing? Once it finishes the scan, it starts to download pars.


Sometimes I mark like 20 downloads and when I check 1 hour or 1 day after I have one that I need to download the PARs manually.


All I ask for is that newsbinpro try a few tricks before giving up soo easy.
Image
fableman
Seasoned User
Seasoned User
 
Posts: 118
Joined: Wed Apr 18, 2007 6:28 am

Registered Newsbin User since: 12/25/06

Re: Fails to download PARs wheen needed.

Postby MilesAhead » Sun Jun 26, 2011 1:46 am

I seem to notice on RC3 when I just double click an .nzb I can get either a couple of inconpletes that show as complete with another reader, or no pars being downloaded to automatically fix it. Didn't seem like this happened often at all with previous releases. Next time it happens I'll look if there's any error message or whatnot.

Just seems like if I select files from the Posts window I don't have the issue. Only if I automatically process .nzb.
Windows Seven 32 bit no SP
HP Pavilion AMD 5200+ dual core
2 GB ram
MilesAhead
Active Participant
Active Participant
 
Posts: 71
Joined: Mon Jul 31, 2006 9:16 pm

Registered Newsbin User since: 07/23/06

Re: Fails to download PARs wheen needed.

Postby Quade » Sun Jun 26, 2011 10:55 am

I seem to notice on RC3 when I just double click an .nzb I can get either a couple of inconpletes that show as complete with another reader,


So, they show up with black boxes? Or they fail to download?
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44984
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Fails to download PARs wheen needed.

Postby fableman » Sun Jun 26, 2011 3:26 pm

I allways start my downloads from a webbrowser
Image
fableman
Seasoned User
Seasoned User
 
Posts: 118
Joined: Wed Apr 18, 2007 6:28 am

Registered Newsbin User since: 12/25/06

Re: Fails to download PARs wheen needed.

Postby Quade » Sun Jun 26, 2011 3:46 pm

I was just talking to dex about a par retry time. To unpause idle par files at the top of the list. Not sure it can make 6.0 though. Thinking about it.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44984
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Fails to download PARs wheen needed.

Postby fableman » Sun Jun 26, 2011 6:09 pm

Quade wrote:I was just talking to dex about a par retry time. To unpause idle par files at the top of the list. Not sure it can make 6.0 though. Thinking about it.


great news!
Image
fableman
Seasoned User
Seasoned User
 
Posts: 118
Joined: Wed Apr 18, 2007 6:28 am

Registered Newsbin User since: 12/25/06

Re: Fails to download PARs wheen needed.

Postby Quade » Mon Jun 27, 2011 5:49 pm

You know, I just remembered that Newsbin won't unpause pars until you get at least 90% of the the file set downloaded. Because most pars only cover 10% repair. I wonder if that's what's happening here? Newsbin doesn't think it's complete enough to download pars.

Post properties right click in the download list would tell you.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44984
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Fails to download PARs wheen needed.

Postby fableman » Tue Jun 28, 2011 3:04 pm

Could be will check next time it happens, but that don't solve the problem with correct files but 2 broken PARs make unraring to pause.
Image
fableman
Seasoned User
Seasoned User
 
Posts: 118
Joined: Wed Apr 18, 2007 6:28 am

Registered Newsbin User since: 12/25/06

Re: Fails to download PARs wheen needed.

Postby Quade » Tue Jun 28, 2011 3:26 pm

but 2 broken PARs make unraring to pause.


Huh? It won't even start an unrar if the files are bad.

I think you're saying "partial PAR files that haven't assembled yet don't do anything". That's true too. Pars follow the same assembly rules as other file.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44984
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Fails to download PARs wheen needed.

Postby fableman » Tue Jun 28, 2011 7:41 pm

I tried to say

2 PAR's was broken in post, but newsbin downloaded all other files but never unrared them. when I started unrar from newsbin everything was ok.

2 Broken PAR's in a post can pause the unrar.
Image
fableman
Seasoned User
Seasoned User
 
Posts: 118
Joined: Wed Apr 18, 2007 6:28 am

Registered Newsbin User since: 12/25/06

Re: Fails to download PARs wheen needed.

Postby Quade » Tue Jun 28, 2011 9:03 pm

If the pars are bad, Newsbin's not going to touch the files so, this is perfectly normal. If you're saying "I have a set of rars and newsbin won't unrar them automatically when the pars are all bad" then I say that's normal.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44984
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Fails to download PARs wheen needed.

Postby fableman » Wed Jun 29, 2011 7:06 pm

why do PAR's have to be correct if all other files are , sorry I don't see the logic in that.
Image
fableman
Seasoned User
Seasoned User
 
Posts: 118
Joined: Wed Apr 18, 2007 6:28 am

Registered Newsbin User since: 12/25/06

Re: Fails to download PARs wheen needed.

Postby Quade » Wed Jun 29, 2011 7:28 pm

Pars are how Newsbin checks the files. It's how it knows how many files to expect in the set, how big they are and if they're any good.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44984
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Fails to download PARs wheen needed.

Postby fableman » Thu Jun 30, 2011 3:14 pm

But I guess its pritty rare thats PAR's broken but all other files correct. I only seen that happen once. Lot more times a .rar file is missing and newsbin don't download the PAR's.
Image
fableman
Seasoned User
Seasoned User
 
Posts: 118
Joined: Wed Apr 18, 2007 6:28 am

Registered Newsbin User since: 12/25/06

Re: Fails to download PARs wheen needed.

Postby itimpi » Thu Jun 30, 2011 4:49 pm

fableman wrote:. I only seen that happen once. Lot more times a .rar file is missing and newsbin don't download the PAR's.

The only time I see that behavior is when the post is fairly new, and has not yet reached the Newsbin timeout period for waiting for missing files to arrive (default of 48 hours after post date).
The Newsbin Online documentation
The Usenettools for tutorials, useful information and links
User avatar
itimpi
Elite NewsBin User
Elite NewsBin User
 
Posts: 12607
Joined: Sat Mar 16, 2002 7:11 am
Location: UK

Registered Newsbin User since: 03/28/03


Return to Newsbin Version 6 Beta Support

Who is online

Users browsing this forum: Google [Bot] and 2 guests