Duplicate detecter reason for failing different files

This is the place to help test and discuss Version 6 Beta releases.

Duplicate detecter reason for failing different files

Postby johnisme » Tue Dec 01, 2015 4:53 pm

The reason I'm getting a lot of duplicate detection with different files is that there are shows which have the exact same intro for the first minute,it never happens with shows that have different intros,any way to change the detection so it doesn't scan the first part of the files?This happens on all the 6.62 builds up to the latest version as of today.
User avatar
johnisme
Active Participant
Active Participant
 
Posts: 92
Joined: Mon Sep 24, 2007 12:00 am

Registered Newsbin User since: 09/22/07

Re: Duplicate detecter reason for failing different files

Postby Quade » Tue Dec 01, 2015 6:53 pm

Makes sense. It's just checking the first 26K of the file. I could change it to make it check the first 200k or more but that would invalidate all signature up to this point.

If you're mostly downloading large files, I'd probably just disable the dup detector.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44981
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Duplicate detecter reason for failing different files

Postby johnisme » Tue Dec 01, 2015 10:01 pm

The files are usually 700-2000MB so it would take around 14-40 mB to check the files so i'll keep an eye on the files,it's better for me just to check the dupes to see if i have the file rather than d/l real duplicates again.
User avatar
johnisme
Active Participant
Active Participant
 
Posts: 92
Joined: Mon Sep 24, 2007 12:00 am

Registered Newsbin User since: 09/22/07

Re: Duplicate detecter reason for failing different files

Postby Quade » Tue Dec 01, 2015 10:39 pm

For large files like that the dup detector is only marginally useful. The issue is that only a 100% identical repost will be dup checked out. A file for the same...thing but a different release will still download because they're not binary identical even though the content might be the same. Things like codec and res will change the binary signature.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44981
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97


Return to Newsbin Version 6 Beta Support

Who is online

Users browsing this forum: Baidu [Spider], Google [Bot] and 2 guests