Newsbin general housekeeping. (Chunks/cache cleanup)

This is the place to help test and discuss Version 6 Beta releases.

Newsbin general housekeeping. (Chunks/cache cleanup)

Postby Eurisko » Wed Apr 06, 2016 10:04 am

I have noticed with this series of betas, that my cache drops down and typically doesn't return, and my chunks folder grows to pretty massive sizes.

My settings:
I have my cache bumped to 2000 (up from the default 200).
My Chunks folder is on a cheap SSD drive.
Windows 10 x64
AutoPar options set to Automatically UnRar Complete files
Delete RARs and PARs on successful UnRar
Aggressive Assembly mode
Most downloads are all via Sonarr automation with Newsbin.

My issue:
In the morning I will check on newsbin, Chunks will always be somewhere typically under 500/2000 and won't return unless I do the "Help, About Newsbin" trick.
My chunks folder will sometimes reach massive sizes. This morning I cleared out over 10 gigs of stuff in that folder.

To me, if Newsbin doesn't have an active download going on, shouldn't the Cache return to 2000/2000, and shouldn't the chunks folder be emptied? Is there a housekeeping schedule at which it does these, or should I just keep manually cleaning it out?

Let me know if any additional information is needed.
Eurisko
Active Participant
Active Participant
 
Posts: 51
Joined: Thu Oct 11, 2007 1:19 pm

Registered Newsbin User since: 04/02/03

Re: Newsbin general housekeeping. (Chunks/cache cleanup)

Postby Quade » Wed Apr 06, 2016 10:19 am

In the morning I will check on newsbin, Chunks will always be somewhere typically under 500/2000 and won't return unless I do the "Help, About Newsbin" trick.


This doesn't mean anything. The chunks get purged out when they need to purge out. There's no mechanism to make them purge when things are idle.

To me, if Newsbin doesn't have an active download going on, shouldn't the Cache return to 2000/2000, and shouldn't the chunks folder be emptied? Is there a housekeeping schedule at which it does these, or should I just keep manually cleaning it out?


Not in my opinion. This connects to my next comment. Files that fail to download completely leave their chunks behind.

How many files end up in your failed list? Any failed files, the chunks for those failed files will remain in the the chunks folder till they get automatically purged. I think the default is two days. When the chunks get 2 days old, Newsbin will purge them.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44981
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Newsbin general housekeeping. (Chunks/cache cleanup)

Postby Eurisko » Wed Apr 06, 2016 10:41 am

Often, there are no failed files at all.

I just downloaded 4 episodes of a show. When it was down, the cache was at 238/2000, chunks folder had over 1500 files. There were zero failed files in the Failed tab.

I'm cool with it clearing out every couple of days I suppose, but shouldn't the cache still be freeing back up when it's done?
Eurisko
Active Participant
Active Participant
 
Posts: 51
Joined: Thu Oct 11, 2007 1:19 pm

Registered Newsbin User since: 04/02/03

Re: Newsbin general housekeeping. (Chunks/cache cleanup)

Postby Quade » Wed Apr 06, 2016 10:55 am

I just downloaded 4 episodes of a show. When it was down, the cache was at 238/2000, chunks folder had over 1500 files. There were zero failed files in the Failed tab.


I don't know then. I downloaded a decent amount yesterday with B10 and today have 190 chunks in the chunks folder. It keeps the "Part #1" chunks around for awhile on purpose. You might want to make any security software ignore the data folder. I don't make any extraordinary efforts to delete the chunks. One and done. If the V scanner gets in the way, they don't get deleted.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44981
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Newsbin general housekeeping. (Chunks/cache cleanup)

Postby Eurisko » Wed Apr 06, 2016 11:24 am

I just added the newsbin folder to the exclusions in both sets of security software. I'll see if that makes a difference. Thanks!
Eurisko
Active Participant
Active Participant
 
Posts: 51
Joined: Thu Oct 11, 2007 1:19 pm

Registered Newsbin User since: 04/02/03

Re: Newsbin general housekeeping. (Chunks/cache cleanup)

Postby kirm » Wed Apr 06, 2016 6:19 pm

added the newsbin folder to the exclusions in both sets of security software


I always thought one should never run more than 1 security program on any given machine, that they may conflict.
kirm
Seasoned User
Seasoned User
 
Posts: 249
Joined: Sun Aug 17, 2003 4:17 pm

Registered Newsbin User since: 05/15/03

Re: Newsbin general housekeeping. (Chunks/cache cleanup)

Postby Eurisko » Wed Apr 06, 2016 6:36 pm

One is AV, one is Anti-Malware.
Eurisko
Active Participant
Active Participant
 
Posts: 51
Joined: Thu Oct 11, 2007 1:19 pm

Registered Newsbin User since: 04/02/03

Re: Newsbin general housekeeping. (Chunks/cache cleanup)

Postby kirm » Wed Apr 06, 2016 7:41 pm

One is AV, one is Anti-Malware


Cool. Sorry guess I misunderstood your statement.
kirm
Seasoned User
Seasoned User
 
Posts: 249
Joined: Sun Aug 17, 2003 4:17 pm

Registered Newsbin User since: 05/15/03


Return to Newsbin Version 6 Beta Support

Who is online

Users browsing this forum: Majestic-12 [Bot] and 2 guests