Search Subscription Service: Listings Not Current :(

[chaznet]

Used to be the search subscription service was current with available Usenet content -- but with the V6 beta, it's rarely current. Most material I search for is out there, but I'm lucky if it shows up a few hours later in a search, often it takes 24 hours.

Compare the currently available data from this listing to what you can search for with the Newsbin Search service: http://www.binsearch.info/browse.php?bg ... multimedia

[dexter]

It takes a while for posts to propagate on Usenet. Your specific example was posted to a different server than the one we monitor and just showed up on our server 25 minutes ago. Our database feeder cycles every hour. In the next cycle you will see these posts show up.

Last week things were slow due to spam floods on Usenet and it was taking up to 8 hours for items to show up, not counting propagation delays. That is not the case anymore.

[chaznet]

There must be a lot of spam again... A random test finds something winding up on BinSearch approximately 8 hours ago still hasn't propagated to NewsBin's search results: http://www.binsearch.info/?q=apprentice&max=100&adv_age=1&server=

[dexter]

I'm seeing a 3 hour difference between when that post showed up on binsearch and when it showed up on our servers. Again, it was posted through a different server so I can only assume propagation delays.

I'll pick a new post off that server and track to see how long it takes to show up on our servers, just to make sure.

[chaznet]

Any chance this'll be improved at some point? The lag in posts showing up has prompted me to search for alternative newsreaders with similar search functionality. I found one, NewsLeecher. While I much prefer the Newsbin software, their search service is spot on -- posts show up immediately, just like Newsbin used to. I just searched for 4 posts via NewsLeecher, all of which showed up both in standard and hi-def versions, and none showed up in Newsbin.

[Quade]

Yes, I suspect it's going to speed if before too long. Yesterday, I was working on the tool that inserts the data in the database and the new one (based on 6) is damn fast. Now it's just a matter of testing and eventually promoting it to the production search server.

[chaznet]

I've been keeping an eye on it hoping things would speed up. So far no luck in that regards. Just cancelled a longstanding subscription but will revisit the service later in hopes speed of items showing up in a search is returned as I >much< prefer your software over anything else out there.

For now I've switched to NewsLeecher as it's search feature shows items instantaneously as they become available, however, the software itself is an abacus in comparison to Newsbin

[dexter]

Our design goal is to cycle every 30 min. Currently we are cycling every 15-20 min. I could make it every 5 minutes but didn't really see the point, it takes longer than that to completely post many items anyways.. I guess people have different expectations. What is your observation and what is your requirement?

[chaznet]

I'm sure it works fine for most -- I stopped checking exactly how long it took for headers to appear after I initially started this topic. All I can say is during the past couple months there hasn't been an instance where I've found something in Newsbin search before Newsleecher, which is what I used to grab it. After finding it in Newsleecher, I didn't keep trying Newsbin to see how much longer afterwards it showed up there.

I accidentally found that I didn't actually >need< to subscribe to anything as if I used the 'create NZB' option after searching with Binsearch.info and opening that file with Newsbin, it would start the download. Unfortunately, I didn't know about that until after purchasing the yearly option for Newsleecher.

[Quade]

Current search is near real time. I just checked search and headers on an active group and they're within a couple minutes of each other. To me that means your actual complaint is simply wrong.

You and few others complained, Dex and I did something about it.

[chaznet]

Well I guess 'simply wrong' means I've been checking a couple minutes too soon then. I've been checking Newsbin first, if it hasn't been there, I've moved on. Argumentative responses both here and via private messages aren't exactly customer service oriented.