Page 1 of 1

Newsbin general housekeeping. (Chunks/cache cleanup)

PostPosted: Wed Apr 06, 2016 10:04 am
by Eurisko
I have noticed with this series of betas, that my cache drops down and typically doesn't return, and my chunks folder grows to pretty massive sizes.

My settings:
I have my cache bumped to 2000 (up from the default 200).
My Chunks folder is on a cheap SSD drive.
Windows 10 x64
AutoPar options set to Automatically UnRar Complete files
Delete RARs and PARs on successful UnRar
Aggressive Assembly mode
Most downloads are all via Sonarr automation with Newsbin.

My issue:
In the morning I will check on newsbin, Chunks will always be somewhere typically under 500/2000 and won't return unless I do the "Help, About Newsbin" trick.
My chunks folder will sometimes reach massive sizes. This morning I cleared out over 10 gigs of stuff in that folder.

To me, if Newsbin doesn't have an active download going on, shouldn't the Cache return to 2000/2000, and shouldn't the chunks folder be emptied? Is there a housekeeping schedule at which it does these, or should I just keep manually cleaning it out?

Let me know if any additional information is needed.

Re: Newsbin general housekeeping. (Chunks/cache cleanup)

PostPosted: Wed Apr 06, 2016 10:19 am
by Quade
In the morning I will check on newsbin, Chunks will always be somewhere typically under 500/2000 and won't return unless I do the "Help, About Newsbin" trick.


This doesn't mean anything. The chunks get purged out when they need to purge out. There's no mechanism to make them purge when things are idle.

To me, if Newsbin doesn't have an active download going on, shouldn't the Cache return to 2000/2000, and shouldn't the chunks folder be emptied? Is there a housekeeping schedule at which it does these, or should I just keep manually cleaning it out?


Not in my opinion. This connects to my next comment. Files that fail to download completely leave their chunks behind.

How many files end up in your failed list? Any failed files, the chunks for those failed files will remain in the the chunks folder till they get automatically purged. I think the default is two days. When the chunks get 2 days old, Newsbin will purge them.

Re: Newsbin general housekeeping. (Chunks/cache cleanup)

PostPosted: Wed Apr 06, 2016 10:41 am
by Eurisko
Often, there are no failed files at all.

I just downloaded 4 episodes of a show. When it was down, the cache was at 238/2000, chunks folder had over 1500 files. There were zero failed files in the Failed tab.

I'm cool with it clearing out every couple of days I suppose, but shouldn't the cache still be freeing back up when it's done?

Re: Newsbin general housekeeping. (Chunks/cache cleanup)

PostPosted: Wed Apr 06, 2016 10:55 am
by Quade
I just downloaded 4 episodes of a show. When it was down, the cache was at 238/2000, chunks folder had over 1500 files. There were zero failed files in the Failed tab.


I don't know then. I downloaded a decent amount yesterday with B10 and today have 190 chunks in the chunks folder. It keeps the "Part #1" chunks around for awhile on purpose. You might want to make any security software ignore the data folder. I don't make any extraordinary efforts to delete the chunks. One and done. If the V scanner gets in the way, they don't get deleted.

Re: Newsbin general housekeeping. (Chunks/cache cleanup)

PostPosted: Wed Apr 06, 2016 11:24 am
by Eurisko
I just added the newsbin folder to the exclusions in both sets of security software. I'll see if that makes a difference. Thanks!

Re: Newsbin general housekeeping. (Chunks/cache cleanup)

PostPosted: Wed Apr 06, 2016 6:19 pm
by kirm
added the newsbin folder to the exclusions in both sets of security software


I always thought one should never run more than 1 security program on any given machine, that they may conflict.

Re: Newsbin general housekeeping. (Chunks/cache cleanup)

PostPosted: Wed Apr 06, 2016 6:36 pm
by Eurisko
One is AV, one is Anti-Malware.

Re: Newsbin general housekeeping. (Chunks/cache cleanup)

PostPosted: Wed Apr 06, 2016 7:41 pm
by kirm
One is AV, one is Anti-Malware


Cool. Sorry guess I misunderstood your statement.