by Quade » Wed Sep 10, 2014 10:05 pm
As usual I'm working on a new beta. Dex and I have targeted this version for periodic search. Most of the code already exists in 6.53 but, we weren't sure the server was ready for it so we re-did the search server for the future.
Big changes are coming to the download list:
1 - Internally there will only be one list. You'll still see Download Failed and Wish but, internally there's just one. It makes management easier.
2 - Huge changes are coming to RAM use and download list loading time.
I have reports from some people with TB's worth of files in the download list taking 30 minute to an hour to load the download list before download can commence. I know this is relatively rare but, it does happen. Failed download and wish also take up an extraordinary amount of RAM when full loaded. The change is to simply not load everything till it's actually needed. In that way the download list can be basically infinitely sized and it wont take a long time to load or consume a bunch of RAM. Right now, you might have 10,000 sets of files loaded up (or more) each one taking RAM and taking time to load. In 6.60, you'll probably never have more than 200 in ram at once. Even if you have a million downloads in the download list.
Another benefit is virtually instant loads and commencing downloading. I fed 25 TB into the download list and Newsbin could be restarted and ready for download in mere seconds after the restart.
One of the reasons for this change, both the single list and the ram reduction is to support Android. I haven't given up on it. I just decided I need to make some major changes internally to support a low powered, low RAM platform. Getting the lists out of RAM is one way to make that happen.
It's taken a solid month but, the download list now performs better than ever. I still have a number of fixes before beta but, hopefully it won't be too long.
The old download list isn't compatible anymore so, I need to come up with an importer. Either in Newsbin or external.