Page 1 of 1
doesnt handle partial file downloads well
Posted:
Tue Jan 24, 2012 12:51 pmby spotter
If newsbin is quit with partial downloads (either due to failures or because a file is still in process), when one restarts newsbin the entire file has to be redownloaded. why isn't the data written to disk? (I think back in the day this wasnt a problem).
I'm seeing it now due to trying to experiment with astraweb and their known issue of having many 430s.
Re: doesnt handle partial file downloads well
Posted:
Tue Jan 24, 2012 1:38 pmby Quade
What version are you using? I was just testing this yesterday and 6.3 is definitely saving between runs. It might also depend on whether you have a memcache limit set in the configuration file.
Re: doesnt handle partial file downloads well
Posted:
Tue Jan 24, 2012 2:00 pmby spotter
6.30b2 and I'm definitely using mem cache (as generally files dont get written till totally downloaded), just unsure where its defined.
Re: doesnt handle partial file downloads well
Posted:
Tue Jan 24, 2012 2:45 pmby spotter
I have a memcache limit of 100 (which makes sense why my files aren't being written) but I'd expect them to be written at some point.
Re: doesnt handle partial file downloads well
Posted:
Tue Jan 24, 2012 3:21 pmby Quade
That's probably why they're not getting saved between runs. It's the downside of using the memcache. There's currently no mechanism for storing partial downloads.
I'll add an item to my todo list to look at this again.