Very Slow Deletes 6.50B15

[Kairk1]

For the last few betas, I've noticed very slow deletes (shift-del not mark post old) from picture groups. This may have been going on longer, but I've recently changed to running NB when needed instead of leaving it open 24/7 since header downloads and updates are so fast anymore, there is no need to download headers every hour like I used to (combination of improved header update speed and a new, much faster computer). When I'm finished with the group, I usually close NB. I noticed that the next time I'd run NB and load the group some of the posts I had deleted were still displaying and after some testing realized that the deletes were very slow and closing NB was interrupting the deletion process.

To test, I did a Post Storage|Delete Stored Posts, exited NB and verified the associated folder for the group was gone from the SPOOL_V6 folder and then downloaded latest posts and around 170,000 headers were downloaded resulting in 54,673 items in the post list for the group. I then deleted (shift-del not mark post old) 20,000 items and NB ran my CPU at 17% (as seen in Task Manager) for almost 7 minutes. After the CPU usage returned to 0, I deleted 20,000 more and NB ran the CPU at 17% for a little over 5 minutes. While the deletion is taking place, reloading the group still shows some of the 'deleted' posts still there, and when the cpu usages goes back to zero, they no longer display. These items run from 100k to 2 meg, none of them are compacted. Windows Resource Monitor only shows NB reading or writing the spool files at the beginning and end of the deletion process.

As a check, I deleted the stored posts for the group, re-downloaded the latest posts and marked 20,000 as old. This took less than a second, I never even noticed the cpu usage increase.

Taking 5 minutes to delete 20,000 posts seems to me to be a very long time, considering marking them as old take practically no time at all. If the speed of deletes can't be improved, could you add an indicator on the status bar (similar to what is done when headers are downloaded) to indicated that deletes are occurring?

System Info :
CPU : AMD FX6300 (6 core)
Memory : 8 gig
HDD : Seagate Barracuda ST2000DM001 2TB 7200 RPM 64MB Cache SATA 6.0Gb/s 3.5" Internal Hard Drive about 50% full
OS: Win 7 pro sp1 fully updated

Files in the associate SPOOL_V6 folder

Code: Select all

09/15/2013  12:07 PM    <DIR>          .
09/15/2013  12:07 PM    <DIR>          ..
09/15/2013  11:41 AM             3,072 Range.db3
09/15/2013  11:41 AM                 0 Range.db3-journal
09/15/2013  12:07 PM        19,386,368 Storage.db3
09/15/2013  12:07 PM        17,539,072 StorageData.db3