Using a symlink for the Imports folder to speed processing

This is the place to help test and discuss Version 6 Beta releases.

Using a symlink for the Imports folder to speed processing

Postby Moondawgie » Fri Aug 23, 2013 1:53 pm

With an installation of Newsbin Pro 6.50B14 to a computer with an Intel Q6600 2.40GHz processor and 8GB of RAM, running Windows 7 Ultimate 64-bit, would using a symlink linking Newsbin Pro's Imports folder to a folder located on a separate drive speed up the processing of new message headers, or disaster?

Two days ago, I initiated the download of all headers for one newsgroup, which resulted in the addition of approximately 1800 .gz files to the imports folder of my installation of Newsbin Pro. Newsbin has been processing those files for more than 47 hours, but 407 files, totalling 16.4 Gigabytes, remain to be processed.

Would there be benefit, or disaster, if I were to exit from Newsbin and then, after using the Windows task manger to verify that Newsbin is no longer running, create the second folder on a separate drive, copy the files from the existing imports folder to the second imports folder, create the symlink, and restart Newsbin,

My system partition and the installation of Newsbin Pro 64-bit are located on a 10,000 RPM drive, with the Newsbin Data folder located on a 7200 RPM drive. The new imports folder would be located on another 7200 RPM drive.

Thank you for your considerate thoughts or comments.
MS Windows 10 Pro 64-Bit I- ASUS P8Z77-V LE; Intel i7-3770K 3.5 GHz; 16.0GB DDR3; 600/20 Mbps cable internet.
User avatar
Moondawgie
Seasoned User
Seasoned User
 
Posts: 422
Joined: Mon Aug 13, 2001 5:17 pm

Registered Newsbin User since: 05/17/03

Re: Using a symlink for the Imports folder to speed processi

Postby Quade » Fri Aug 23, 2013 2:31 pm

The answer is, I don't know. I don't think the reading of the GZ files is the bottleneck though, it's the feeding them to the DB3 files that's slow. Meaning the import folder is probably not the bottleneck.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44984
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Using a symlink for the Imports folder to speed processi

Postby Moondawgie » Fri Aug 23, 2013 3:45 pm

Drat!

Thank you for your informative response.
MS Windows 10 Pro 64-Bit I- ASUS P8Z77-V LE; Intel i7-3770K 3.5 GHz; 16.0GB DDR3; 600/20 Mbps cable internet.
User avatar
Moondawgie
Seasoned User
Seasoned User
 
Posts: 422
Joined: Mon Aug 13, 2001 5:17 pm

Registered Newsbin User since: 05/17/03


Return to Newsbin Version 6 Beta Support

Who is online

Users browsing this forum: Bing [Bot] and 2 guests