Page 1 of 1

how can I clean up history

PostPosted: Thu Jul 12, 2012 4:04 pm
by oferlaor
SPOOL_V6 is getting quite large for me.

Is there any way I can remove history?

I have some automatic group download options (with filters), but the db3 indexes such as StorageData.db3, are 10-15GB per group.

Re: how can I clean up history

PostPosted: Thu Jul 12, 2012 4:28 pm
by Quade
1 - Set the storage age to something shorter.

2 - Update the groups.

3 - When the update is done and all records imported, select some or all of the group, right click and "PostStorage/Compact Database". This should get you some disk space back.

Compacting can take a long time. Might want to do it before you go to bed or something like that.

Re: how can I clean up history

PostPosted: Thu Jul 12, 2012 4:51 pm
by oferlaor
Will purge to display age help before the compacting?

Re: how can I clean up history

PostPosted: Thu Jul 12, 2012 5:32 pm
by Quade
That's probably a better idea than updating the groups.

Re: how can I clean up history

PostPosted: Wed Jul 25, 2012 12:18 pm
by oferlaor
OK, I did this a couple of days ago. Still way too large.

a.b.hdtv for example has (after purge to display age and compact) two large files: StorageData.db3 (16GB) and Storage.db3data.tmp (9.5GB).

Together, the directory is about 26GB in size.

I'm going to delete the group and add it again.

Re: how can I clean up history

PostPosted: Wed Jul 25, 2012 2:29 pm
by Quade
It's a large group. If you shrink the "Storage Age" more. it'll get smaller. The whole question is, how many days do you want to store? For that group, 150 days seems to be about 5 gigs. My whole spool_v6 folder is about 160 gigs. That's 1400 days for the groups I track. You have complete control over disk usage. You have to trade off storage age for disk usage. Considering how cheap disks are these days. I don't think 160 gigs is that much.

I can say that Boneless over 1400 days is about 80 gigs all by itself. That's one reason I don't track boneless (I use search for that). The data in storagedata is already compressed too.

Re: how can I clean up history

PostPosted: Wed Jul 25, 2012 2:36 pm
by oferlaor
Something strange. It is set to 15 days...

I did purge to display age and then compacted...

Re: how can I clean up history

PostPosted: Wed Jul 25, 2012 2:42 pm
by Quade
Right click "Show all Posts" and see if it really is purged. Sounds like it's not.

Re: how can I clean up history

PostPosted: Wed Jul 25, 2012 2:54 pm
by Quade
Using a "Display Age" of 60. I right click and "Purge to Display Age". Then when it was done, I right clicked and "Show all Posts". It only showed 60 day. Then I right click "Compacted" the database and it went from 5 to 1.5 gigs.

Re: how can I clean up history

PostPosted: Wed Jul 25, 2012 4:55 pm
by oferlaor
Something very wrong with compact... It leaves the original file behind and adds a Tmp file as well.
Just compacted a 10GB group and ended up with a 19GB folder...

Re: how can I clean up history

PostPosted: Wed Jul 25, 2012 5:03 pm
by Quade
The compact is failing.

How much free space do you have? You need at least twice as much and I think 3 times as much to be safe, free space as the size of the folder. So, I'm thinking you need 50ish gigs free at least.

Re: how can I clean up history

PostPosted: Wed Jul 25, 2012 6:18 pm
by oferlaor
200GB+ free...

Deleted and started redownloading the groups. Does it have to download allessages although display age is 15 days?

Something was definitely off there.

Re: how can I clean up history

PostPosted: Wed Jul 25, 2012 7:03 pm
by Quade
If you delete the group, it downloads "Download Age" worth of headers unless you tell it to "Download all".

Re: how can I clean up history

PostPosted: Thu Jul 26, 2012 2:45 am
by oferlaor
They are set as auto download with a filter.

After redownloading, the directories are less than 1GB each...