Newsbin Beta 6.90B12 - build 5396

[Quade]

http://downloads.newsbin.com/downloads/ ... 2-5396.exe

- Posting: Doesn’t work - Been unable to test because my server doesn’t allow posting. Tested with Tweaknews. Works now.
- Display: PosterLockout working
- AutoPAR: Newest format NZB’s with embedded invisible PARS now working properly.
- AutoPAR: Fix for very rare 16K hash collisions in certain par sets.

[kenr]

I am trying to get rid of the spam messages in some of the groups.
I have a poster regex of "\w{9,}.+\w{3}" with a sample of "bZCAoBR6bmpMh7@lUn3X.MT7" as the poster.
Regex101 says it works, but NB passes it as OK.
What am I doing wrong?

[itimpi]

I am trying to get rid of the spam messages in some of the groups.
I have a poster regex of "\w{9,}.+\w{3}" with a sample of "bZCAoBR6bmpMh7@lUn3X.MT7" as the poster.
Regex101 says it works, but NB passes it as OK.
What am I doing wrong?

I think the ’@‘ character is not part of the characters matched by \w.

[kstan12]

thanks for the invisible par fix quade. no more dupes and my automation is working again.

[kenr]

http://downloads.newsbin.com/downloads/beta/nb690B12-5396.exe
- Display: PosterLockout working

Thanks.
BUT, it only works for the session you are in. I.e. it removes their posts, but close & reload and download some more headers and they are back with new posts.

[kenr]

I am trying to get rid of the spam messages in some of the groups.
I think the ’@‘ character is not part of the characters matched by \w.

As I said the checker at regex101 passes it
Match 1 0-24 bZCAoBR6bmpMh7@lUn3X.MT7

[Quade]

BUT, it only works for the session you are in. I.e. it removes their posts, but close & reload and download some more headers and they are back with new posts.

If I toggle the filters on and off and it "takes" again meaning the mechanism works and the lockouts are stored.

I agree it should apply on initial load though.

I'll check it out. Thanks.

[DogSnake]

I am still unable to post from the latest build. 6.82 works fine. It is a small thing so I will use the 6.82 build. Thanks

[Lee Thompson]

I've tested the additional download header options with more groups, old and new.

• WORKS: Download latest
• WORKS: Download All headers
• DOES NOT WORK: Download 50,000 Older Posts
• DOES NOT WORK: Download 100,000 Older Posts
• DOES NOT WORK: Download 500,000 Older Posts
• DOES NOT WORK: Download 5,000,000 Older Posts
• DOES NOT WORK: Download 10,000,000 Older Posts

By DOES NOT WORK, it shows up in the Downloading Files as Download Headers: Server - GROUP but stays at 0/0 until you delete it. I've waited up to an hour. The debug log shows two entries, repeatedly, all exactly the same. I think it's perhaps not requested the desired range or something so it just spins it's wheels.

(While you're at it, Download Special should have a "Download Custom Older Posts" where a modal asks for a count so you could specify "75000" etc.)

(EDIT: Formatting fixes, a heat wave makes for bad typing.)

[Quade]

DOES NOT WORK: Download 50,000 Older Posts
DOES NOT WORK: Download 100,000 Older Posts
DOES NOT WORK: Download 500,000 Older Posts
DOES NOT WORK: Download 5,000,000 Older Posts
DOES NOT WORK: Download 10,000,000 Older Posts

These only work at specific times and specific states of the group. I'll give it a look. For example of you already have all the headers according to range.db3, they won't do anything.

[Lee Thompson]

DOES NOT WORK: Download 50,000 Older Posts
DOES NOT WORK: Download 100,000 Older Posts
DOES NOT WORK: Download 500,000 Older Posts
DOES NOT WORK: Download 5,000,000 Older Posts
DOES NOT WORK: Download 10,000,000 Older Posts

These only work at specific times and specific states of the group. I'll give it a look. For example of you already have all the headers according to range.db3, they won't do anything.

Yeah but normally that behavior is it just quickly starts and then the download queue is empty. Now it just hangs around at 0/0 until you delete it.

[kenr]

Filters.
I seem to remember that entering a filter into the box at the bottom, without adding, would allow testing. Now it seems you have to add it to test it.

[Lee Thompson]

I got a weird error tonight, newsbin was doing it's periodic header updates when:

Code: Select all

[06/30 20:33:40]  ERROR ReadFullDatabase: No filename or the NZB Data is missing

spammed in the log for 2 seconds.

No NZBs had been given to it. Just reading headers (I don't even have NZB folders defined, I use sabnzbd for large downloads).

They seemed to occur, rather randomly, during the header downloads. I don't think it's associated with any specific groups as it occurred just during the one time. (it's updated headers since without those errors).

I have logging always on full debug, unfortunately whatever happened, the cause doesn't seem to be logged.


@Devs, I know newsbin is multithreaded, is the sqlite you're using thread safe? Just guessing what might be doing weird things.


LATER NOTE: Nothing appears to be malfunctioning, just was odd seeing those errors for no apparent reason.

[Bismark]

When I use the move command the file moves, but does not update the location in the file list tab. So when I want to look at the file via the file tab it shows,butI get a message that the file is not found. When I look at the target folder, indeed the file has been moved, but I really need to be able to find all files from the files tab. Also, when i do a a compact group, it works, but I do not see what the new size is. The good news is when a compact group is running, I can us the app for other stuff.

I have this version loaded and in the few days I have been using it, all else seems work.

[Quade]

NZB data is just a keyword for the data needed to do the actual download.

You might get that if you have an empty group in the list of groups you're loading. I'm not sure why you'd get that just loading and displaying headers. I'll have to take a look.

[Quade]

I'll look at the move thing.

I'll thinking about the compact group thing. Not sure I can pop up a summary when it's done or not.

Compacting will only reduce the size if you do a bunch of "shift-delete" or "delete all posts byposter". Marking old with delete won't shrink it because nothing is deleted.

[bertm]

My spam filters seem to be only partially effective. I notice most SPAM is incomplete and are between 500kB and 1M. Do you think a status filter (for incomplete) would be worthwhile?

The two filters I use are: [0-9a-z]{20} and ^[a-z\d]{17}

[Quade]

It could be it's setting the incomplete status before it checks the filter. Let me look at that.

[wiggins09]

Agree about the issue of 'incomplete' junk posts.
Of 3085 headers on a group update today, only 206 were actually complete & not junk.
It did make me wonder about the number of 'complete' junk headers being filtered out, how many data farms is this stuff actually filling up...?

& as an FYI I got You exceeded the maximum allowed number of login attempts. In addition to your username and password you now also have to solve the CAPTCHA below on my very first click on <login> today.
Weird or new anti-spammer policy?

[Stuart264]

Two other users must have been reading my mind. I was going to ask for the "filter incompletes" function to be brought back, probably in the properties page of a GOG as groups like a.b.ebook and a.b-e-book are coming up with thousands of incomplete posts with random strings as the subject and poster, and its a pain in the ass going through them.

Secondly I caught some very odd behaviour by Newsbin connected to Windows 11, I am signed up on the Insider "Beta" Program, Microsoft did something wrong in the preview rollout and pushed my PC onto Windows 11, moment I fired up Newsbin it started downloading everything based on the filter settings even though automatic download wasnt enabled and cause a right mess before I was able to CAD Newsbin and delete the download database, its fine now I pushed my laptop back to Windows 10 but you may want to add it to your long term "todo" list.

Apologies for not raising it sooner, but been swamped literally by a flood from apartment upstairs that fried just about everything electrical and the cable line which has only just been repaired......last 2 weeks have not been good , anyone got any junior chewable morphine? (Thats a Simpsons & true historical reference )

[Quade]

Secondly I caught some very odd behaviour by Newsbin connected to Windows 11, I am signed up on the Insider "Beta" Program, Microsoft did something wrong in the preview rollout and pushed my PC onto Windows 11, moment I fired up Newsbin it started downloading everything based on the filter settings even though automatic download wasnt enabled and cause a right mess before I was able to CAD Newsbin and delete the download database, its fine now I pushed my laptop back to Windows 10 but you may want to add it to your long term "todo" list

I'm probably going to sit Win11 out for awhile. Wait for it to stabilize. No point chasing problems that might be inherent to the OS. Typically you just have to pause Newsbin then delete the arrant downloads.

It's always possible to add filter incompletes but, I'm going to suggest that you look in the actual group where the incompletes appear and see if there's any meaningful content left. Some productive groups are now "garbage only" and need to be removed from the groups list. I've been pruning out my GOGS. I also added a header download filter which removes much of the spam before it hits the DBs.

[Quade]

& as an FYI I got You exceeded the maximum allowed number of login attempts. In addition to your username and password you now also have to solve the CAPTCHA below on my very first click on <login> today.
Weird or new anti-spammer policy?

As far as I know nothing has changed with the forum. It had been targeted from time to time with DOS attacks.

[Stuart264]

I would, 1 day with 11 was enough for me. I have no idea why it forced the upgrade as according to Microsoft upgrade utility this PC isn't capable of running Windows 11 and god help anyone that needs either a VPN or private server connection for work, what they have done with the Networking is dire and the version I had your unable to turn IPv6 off. Got a ticket filed with Microsoft about it, still waiting on a response.

[Quade]

I would, 1 day with 11 was enough for me.

If it wasn't for my gaming and programming, I'd be 100% Linux. I could probably do my programming on Linux. It just wouldn't be as convenient. I might never go Win11. Win10 already left a bad taste in my mouth. The fact they took away my ability to control my own PC was the last straw.

[TripleDad]

Two other users must have been reading my mind. I was going to ask for the "filter incompletes" function to be brought back, probably in the properties page of a GOG as groups like a.b.ebook and a.b-e-book are coming up with thousands of incomplete posts with random strings as the subject and poster, and its a pain in the ass going through them.

Secondly I caught some very odd behaviour by Newsbin connected to Windows 11, I am signed up on the Insider "Beta" Program, Microsoft did something wrong in the preview rollout and pushed my PC onto Windows 11, moment I fired up Newsbin it started downloading everything based on the filter settings even though automatic download wasnt enabled and cause a right mess before I was able to CAD Newsbin and delete the download database, its fine now I pushed my laptop back to Windows 10 but you may want to add it to your long term "todo" list.

Apologies for not raising it sooner, but been swamped literally by a flood from apartment upstairs that fried just about everything electrical and the cable line which has only just been repaired......last 2 weeks have not been good , anyone got any junior chewable morphine? (Thats a Simpsons & true historical reference )

Wow...I am popping in as a lurker and had the exact same question - Couldn't find the filter or how to deal with thousands of incompletes in the various book groups. Quade, I can confirm that the groups are still populating valid (but small) binaries posts - the *.mobi/epub/azw etcs...

Much thanks.

[kenr]

OT but

If it wasn't for my gaming and programming, I'd be 100% Linux. I could probably do my programming on Linux. It just wouldn't be as convenient. I might never go Win11. Win10 already left a bad taste in my mouth. The fact they took away my ability to control my own PC was the last straw.

Same with me, although I haven't really done any programming for several years now.
It was Vista that did me in, a new printer and scanner (separates) didn't have drivers so couldn't be used. Switched to Linux and used them for many years.

[wiggins09]

& as an FYI I got You exceeded the maximum allowed number of login attempts. In addition to your username and password you now also have to solve the CAPTCHA below on my very first click on <login> today.
Weird or new anti-spammer policy?

As far as I know nothing has changed with the forum. It had been targeted from time to time with DOS attacks.

Got me again today on first try then I posted a reply with quote, bounced me out as a login is req'd for a quote (!?), 3 tries later I'm back & my post content is deleted....
but thanks for the reply Quade

[Quade]

I'll ask Dex about it.

[kirm]

I'll ask Dex about it

Had the same happen. Dex got back to me to use captcha, but did not work. By the time I got his reply the next day, tried again and it went through. Been working fine since as I use keep logged in and it has been holding ever since.

[indobson]

Double clicking a nzb causes it to download automatically. Auto download box is unchecked. File only shows only in the downloading files window. Using the add nzb button creates a tab of a paused nzb in the group lists window. Tried in win 7 and win10

[DogSnake]

My work around for the login issue is to enable "log me in every time I visit". Now it bypasses my entering name and all.

[chimmyjim]

Just switched from 6.82 and 'Show Posts' takes about twice as long, and 10+ seconds for nearly empty groups where it was instant in 6.82.
Neither purge nor compact appear to work.
About half the time 'Mark All Old' displays an error message "ERROR Thread Died:"

Jim

[Quade]

Double clicking a nzb causes it to download automatically. Auto download box is unchecked. File only shows only in the downloading files window. Using the add nzb button creates a tab of a paused nzb in the group lists window. Tried in win 7 and win10

Obscured NZB's need to be fed directly to the download list if you want them to download properly. You can still load NZBs into a post list from the file menu.

Neither purge nor compact appear to work.

Compact and purge both happen in the background now. There's no popup windows anymore. I've not really noticed a slowdown here. I'll have to try back to back testing. Do you have many entries in your PosterLockout file?

[chimmyjim]

Do you have many entries in your PosterLockout file?

Yes, it looks like several of them have been corrupted though. I'll clean it up and retry.

[Quade]

The more posters you have in the list, the slower the load will be.

I don't use poster lockouts anymore. The random post subjects are too random. I have added some poster filters to my filter profiles where a single RE can filter out a bunch of them.

[chimmyjim]

Have a suggestion on a quick way to delete all of the poster filters, and reset the filter profiles to default?

I've been building them up for over a decade at this point and probably best to start anew.

[Quade]

Filters are in Filters.db3 Poster Lockouts are in "PosterLockout.txt". Both are in the data folder.

I'd suggest "Open Data Folder" for inside Newsbins option, then exit Newsbin. Move these files out of the data folder. Restart and see if things speed up. Doing it this way, you can always copy them back if they don't make much difference.

[chimmyjim]

Perfect, thanks for help!

[12gauge]

Please advise, Is there a 32 bit binary for this build, as the posted binary won't install properly to Crossover ChromeOS (Wine 32 bit)

Thanks

[Quade]

There's no 32 bit version. Sorry. I'll probably make one for the release.

[Bismark]

For the second time, many, more than half the files, in my files list just disappeared. It happened while files were being downloaded. Is there some variable that is set that does this? If so, how do I change it. I want the files to stay in there until I remove them. Please help.

[Quade]

The files list has always self purged when it get > I think 10,000 records in it. It'll delete 100 at a time. Still, I've seen this once but I wasn't sure if it was because I was debugging.

How much do you have files, failed, download and Wish list? I wonder if it's taking so long to save it doesn't finish saving before Newsbin exits.

[Bismark]

As to files being deleted. I only had about 3,500 files and more than half of them just disappeared. I do have a big wish list, but had not added anything in the past month. This did not happen when Newsbin was exiting, but rather when it was downloading a number of files. I'm going to reload a backup to restore the Files list.

[NewsKid222]

Just switched from 6.82 and am having massive "Not Responding" hangs in Beta 6.90B12. No other hardware or software changes. Just switching focus to NB window for resizing window or clicking speed limit button has a long hang. Ideas?

[luezuve]

I'm having a couple of problems that started after I "upgraded" to this beta..

1. My download settings won't work:
\Newsbin Download\$(GROUP)\$(NZBFILE)\
It downloads to \$(NZBFILE) but unrars in \$(GROUP)

2. I can't add passwords either manually or embedded in tge nzb.
I've been having to edit the RarPasswords.txt file to get passwords to show up.

Using latest windows 10 pro release build.

[Quade]

Just switched from 6.82 and am having massive "Not Responding" hangs in Beta 6.90B12. No other hardware or software changes. Just switching focus to NB window for resizing window or clicking speed limit button has a long hang. Ideas?

Tell me more about your setup. I have fixed some hanging like that for RC1 (upcoming version). There's a part of repair that could stall the GUI.

[Quade]

2. I can't add passwords either manually or embedded in tge nzb.
I've been having to edit the RarPasswords.txt file to get passwords to show up.

Passwords that are embedded in the NZB or in the NZB filename won't show up on the password list. They're stored with the actual download. The password list is now the "passwords of last resort". They're only checked if there's no embedded password in the NZB or NZB Filename.

The reason for the change is the password list will get slower and slower as you add entries so, being able to have per-download passwords stored in the download means there's no performance hit.

1. My download settings won't work:
\Newsbin Download\$(GROUP)\$(NZBFILE)\
It downloads to \$(NZBFILE) but unrars in \$(GROUP)

How are you feeding the NZBs?. Do you have an unrar path set? If you're using NZB Autoload (Newsbin monitoring a folder), you should add pathing to the autoload options in the NZB options section of the options.

[efgh]

Nothing big, doesn't look like it has been reported. On the taskbar for this beta, the right pointing arrow play symbol is always on. Previously this only appeared when I was actually downloading.
Just thought I mention it.

[Quade]

Thanks. I'll check it out.

[Bismark]

Relative to the number of files in the files tab,is there a parameter somewhere to set that number. It just reduced the number of files below 1,000. Can you tell me the name of the parameter and in what file that parameter is? Thanks.