Corrupt headers everywhere

Technical support and discussion of Newsbin Version 6 series.

Corrupt headers everywhere

Postby mankind99uk » Mon Dec 10, 2012 9:05 pm

At the moment there is massive corruption of headers going on, everything is coming up as incomplete, but I've read that fake segments are being uploaded into the original post by another source. A clue, apparently, is when the parts have a different number of segments and you look more closely and see a duplicate (or more than one) with a later timestamp. That is why if you download a nzb file that comes with the post and load that, it will download correctly.

From what I read the newsreader, in this case Newsbin, is not correctly ignoring the fake segments.

I looked at the properties of a rar file, from an nzb, in newsbin and it had 27 records (whatever that means!), but when I looked at the same rar file after having downloaded headers, which according to newsbin was incomplete, it had 66 records.

Would somebody like to comment and if true can it be fixed or is it just a bad case of propagation issues again?
User avatar
mankind99uk
Active Participant
Active Participant
 
Posts: 63
Joined: Fri Jun 18, 2004 1:03 pm

Registered Newsbin User since: 06/18/04

Re: Corrupt headers everywhere

Postby Quade » Mon Dec 10, 2012 10:08 pm

PM me an example. I'm seeing nothing like that.

Fake posts wouldn't cause files to be incomplete, they might cause them to be too complete though.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44984
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Corrupt headers everywhere

Postby snes150 » Mon Dec 10, 2012 10:14 pm

Quade, take a look at this:

https://binsearch.info/browse.php?bg=al ... multimedia

Just try browsing any group on the indexers - insane amounts of incompletion since yesterday.

Something is going on.
snes150
Occasional Contributor
Occasional Contributor
 
Posts: 27
Joined: Sat Apr 10, 2010 9:04 pm

Registered Newsbin User since: 11/24/09

Re: Corrupt headers everywhere

Postby Lilly1 » Tue Dec 11, 2012 12:40 pm

same here!
As suggested in another post, I installed 6.41, but still the same sluggish downloading as with 6.4. Nothing is complete.
Does anybody have any other suggestions?
Lilly1
n00b
n00b
 
Posts: 4
Joined: Sun Feb 22, 2004 10:55 am

Registered Newsbin User since: 02/18/04

Re: Corrupt headers everywhere

Postby Quade » Tue Dec 11, 2012 1:03 pm

6.41 just solves the slow loading caused by spammers. If the headers are F'ed up on the server, software can't fix that.

Dex seems to think that there are two sets of files, a complete original post and incomplete spammy post.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44984
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Corrupt headers everywhere

Postby mankind99uk » Tue Dec 11, 2012 2:46 pm

Quade wrote:6.41 just solves the slow loading caused by spammers. If the headers are F'ed up on the server, software can't fix that.

Dex seems to think that there are two sets of files, a complete original post and incomplete spammy post.


If that's the case can newsbin filter out the spammy post because at the moment downloading anything is impossible.

BTW I've spoken to Giganews explaining the incompletes but they insist that there is nothing wrong and everything is complete. :?

Other people using different servers are reporting corrupt/incomplete headers while others are saying that there is nothing wrong, but won't say which servers they are using.

Something weird going on!
User avatar
mankind99uk
Active Participant
Active Participant
 
Posts: 63
Joined: Fri Jun 18, 2004 1:03 pm

Registered Newsbin User since: 06/18/04

Re: Corrupt headers everywhere

Postby voyd » Tue Dec 11, 2012 3:33 pm

I have a fix for this problem - at least for Giganews

Set your filters to only show nzb files
Set the download path to a new folder
Configure NB to watch that folder and automatically download the files from the nzb files it finds there
Configure an unrar folder

and away you go

-=V=-
voyd
n00b
n00b
 
Posts: 4
Joined: Thu Sep 28, 2006 1:19 pm

Registered Newsbin User since: 10/09/05

Re: Corrupt headers everywhere

Postby Quade » Tue Dec 11, 2012 4:17 pm

If that's the case can newsbin filter out the spammy post because at the moment downloading anything is impossible.


Sure, how do I do it?

BTW I've spoken to Giganews explaining the incompletes but they insist that there is nothing wrong and everything is complete.


Giga just moves the bytes. They don't care if the records are complete or not as long as they're not losing any data themselves.

The NZB idea is good. If posters were smart, they'd post all their NZB's to a group dedicated to only NZB's.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44984
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Corrupt headers everywhere

Postby voyd » Wed Dec 12, 2012 9:21 am

Yeah - and if they were including .nzb files for all the uploads

Unfortch my workaround only works if there is an associated nzb file for teh archive

no nzb? no luck atm - at least until this nonsense gets sorted

-=V=-
voyd
n00b
n00b
 
Posts: 4
Joined: Thu Sep 28, 2006 1:19 pm

Registered Newsbin User since: 10/09/05

Re: Corrupt headers everywhere

Postby bruce73 » Thu Dec 13, 2012 3:48 pm

I'm seeing the same, especially in the a.b.multimedia and the a.b.[xxx].x264 forums (pulling headers from Supernews). You're right, complete downloads work with the NZBs. I probably wouldn't have thought to check, so thanks for the tip.
User avatar
bruce73
Seasoned User
Seasoned User
 
Posts: 101
Joined: Sat Jun 26, 2004 10:34 am
Location: Los Angeles

Registered Newsbin User since: 06/23/04

Re: Corrupt headers everywhere

Postby Stuart264 » Thu Dec 13, 2012 6:33 pm

Is there any talk of what's causing it and when its going to be sorted, I use Giganews most of the time but to get some stuff down last night I had to add in the Virgin Media server pull the headers down from that to get stuff to download.
User avatar
Stuart264
Seasoned User
Seasoned User
 
Posts: 227
Joined: Sun Jun 13, 2004 8:25 am
Location: United Kingdom

Registered Newsbin User since: 04/10/04

Re: Corrupt headers everywhere

Postby FreddieBaby » Thu Dec 13, 2012 8:05 pm

I'm on Giganews and I have been seeing massive incompletes in the binary groups for about the last 3 or 4 days.
FreddieBaby
n00b
n00b
 
Posts: 1
Joined: Tue Feb 02, 2010 3:40 pm

Re: Corrupt headers everywhere

Postby bruce73 » Thu Dec 13, 2012 9:34 pm

Also, has anyone else been seeing extremely slow download speeds when pulling headers? For the past couple of days it's at 20% of what it normally is. Is that connected to this issue?
User avatar
bruce73
Seasoned User
Seasoned User
 
Posts: 101
Joined: Sat Jun 26, 2004 10:34 am
Location: Los Angeles

Registered Newsbin User since: 06/23/04

Re: Corrupt headers everywhere

Postby Stuart264 » Thu Dec 13, 2012 9:40 pm

Yep, switch to the Giganews Accelerator it seems to be working OK. I also checked the Giganews Usenet groups, which feature a hell of a lot of grumbling about in-completes but no response from Giganews Technical Support.
User avatar
Stuart264
Seasoned User
Seasoned User
 
Posts: 227
Joined: Sun Jun 13, 2004 8:25 am
Location: United Kingdom

Registered Newsbin User since: 04/10/04

Re: Corrupt headers everywhere

Postby Stuart264 » Thu Dec 13, 2012 10:04 pm

Does seem to have worked to some extent, posts I was seeing incomplete this morning are now showing "complete" but not all of them.
User avatar
Stuart264
Seasoned User
Seasoned User
 
Posts: 227
Joined: Sun Jun 13, 2004 8:25 am
Location: United Kingdom

Registered Newsbin User since: 04/10/04

Re: Corrupt headers everywhere

Postby shawn » Fri Dec 14, 2012 1:34 am

I can attest to this issue. I was looking at a number of posts in the teevee newsgroup that was showing up as incomplete in Newsbin Pro. I decided to download the NZB files and give them a try. Suddenly they show up as complete when using the NZB so it appears that someone has managed to post parts that appear to be part of the same set and are causing the post to appear to be incomplete. I would filter them out but they appear to be the same as the original posters so there's no way for an individual user to filter them out.

I hope that something can be added to NBP to filter out these corrupting posts.
shawn
Seasoned User
Seasoned User
 
Posts: 202
Joined: Wed May 22, 2002 7:56 pm

Registered Newsbin User since: 04/02/03

Re: Corrupt headers everywhere

Postby Stuart264 » Fri Dec 14, 2012 10:08 am

Not always, depends which NZB index site you use, because some of them index from Giganews i.e. Binsearch.
User avatar
Stuart264
Seasoned User
Seasoned User
 
Posts: 227
Joined: Sun Jun 13, 2004 8:25 am
Location: United Kingdom

Registered Newsbin User since: 04/10/04

Re: Corrupt headers everywhere

Postby Quade » Fri Dec 14, 2012 12:20 pm

I just downloaded the last 10 days of headers for a.b.teevee and it looks ok. 10% of the files are incomplete but, most look completely repairable.

You might want to set a "Download Age" of 10, then right click the group "Post Storage/Use Download Age" to re-pull the last 10 days.

If I combine AW with Giga, incompletes drops to about 2% (Dex confirmed this too).
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44984
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Corrupt headers everywhere

Postby Stuart264 » Fri Dec 14, 2012 12:48 pm

They look complete but most of them wont work if your using Giganews alone, Try last nights episode <something > Version for example if you download and do an assemble incompletes there isn't enough complete for the pars to work :( which is very frustrating and while I admit it not a Newsbin issue it is damn annoying, very tempted to take the $10 offer on Astraweb and use it as a fill server and see how it goes.
User avatar
Stuart264
Seasoned User
Seasoned User
 
Posts: 227
Joined: Sun Jun 13, 2004 8:25 am
Location: United Kingdom

Registered Newsbin User since: 04/10/04

Re: Corrupt headers everywhere

Postby Quade » Fri Dec 14, 2012 1:27 pm

Don't mention specific files here. Instead PM me.

It might be worth re-downloading the last 20 days worth of headers. I had no issue downloading the file using just giganews. It was 100% complete and the PARS said it was perfect too.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44984
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Corrupt headers everywhere

Postby Quade » Fri Dec 14, 2012 3:18 pm

Ignore what I just said. Giga is still missing the chunks. When I combined the headers from AW and Giga together, I got complete files. That's when the incompletes went from 10% to 2.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44984
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Corrupt headers everywhere

Postby Stuart264 » Sat Dec 15, 2012 8:16 am

Yeah taking the $10 AW offer for 25gb seems to have been a good move, just about everything is complete(ish) now and adding it as a fill server I have used a tiny amount of 25gb catching up on the missing parts of some downloads I was having trouble completing
User avatar
Stuart264
Seasoned User
Seasoned User
 
Posts: 227
Joined: Sun Jun 13, 2004 8:25 am
Location: United Kingdom

Registered Newsbin User since: 04/10/04

Re: Corrupt headers everywhere

Postby bruce73 » Sat Dec 22, 2012 6:22 pm

Well put.
User avatar
bruce73
Seasoned User
Seasoned User
 
Posts: 101
Joined: Sat Jun 26, 2004 10:34 am
Location: Los Angeles

Registered Newsbin User since: 06/23/04


Return to V6 Technical Support

Who is online

Users browsing this forum: No registered users and 2 guests