Retro Guy wrote:

> On Wed, 20 Dec 2023 23:47:58 -0000 (UTC), Retro Guy wrote:

>> On Wed, 20 Dec 2023 17:41:28 -0600, SugarBug wrote:
>>
>>> On Wed, 20 Dec 2023 23:22:44 -0000 (UTC)
>>> Retro Guy <retroguy@i2pn2.org> wrote:
>>>
>>>> On Wed, 20 Dec 2023 17:06:53 -0600, SugarBug wrote:
>>>>
>>>> > On Wed, 20 Dec 2023 22:59:46 -0000 (UTC) Retro Guy
>>>> > <retroguy@i2pn2.org> wrote:
>>>> >
>>>> > <snip>
>>>> >
>>>> >> > Multiple times I deleted the entire spool, set overrides so they
>>>> >> > would pull only a few messages per run, and ran multiple times,
>>>> >> > and none of the spam is moved to spam.
>>>> >>
>>>> >> is rocksolid.spam in $config_dir/spoolnews/groups.txt ?
>>>> >
>>>> > spoolnews$ cat groups.txt rocksolid.spam
>>>> >
>>>> > spoolnews$ cat groups.txt.dist rocksolid.spam
>>>>
>>>> Not sure if it would be a problem, but is rocksolid.spam in more than
>>>> one section/groups.txt?
>>>>
>>>> I only ask because I see it on one of the sites you sent me a link to.
>>>
>>> I added it in rocksolid/groups.txt so it would be visible.
>>
>> Try taking it out of one. So it is in only one section. It shouldn't
>> matter what section.

> Also, the code for checking spam is in post.inc.php:

> if ((isset($CONFIG['spamassassin']) && ($CONFIG['spamassassin'] ==
> true))) {
> $spam_result_array = check_spam($subject, $from, $newsgroups,
> $ref, $body, $msgid);
> $res = $spam_result_array['res'];
> $spamresult = $spam_result_array['spamresult'];
> $spamcheckerversion = $spam_result_array['spamcheckerversion'];
> $spamlevel = $spam_result_array['spamlevel'];
> $spam_fail = $spam_result_array['spam_fail'];
> }

> followed by:

> if ((isset($CONFIG['spamassassin']) && ($CONFIG['spamassassin'] ==
> true))) {
> if (isset($res) && $spam_fail == 0) {
> fputs($ns, $spamcheckerversion . "rn");
> if (strpos($spamlevel, '*') !== false)
> fputs($ns, $spamlevel . "rn");
> if ($res === 1) {
> fputs($ns, "X-Rslight-Original-Group: " .
> $newsgroups . "rn");
> $newsgroups = $CONFIG['spamgroup'];
> }
> }
> }

> You might try echoing some values while testing:

> $CONFIG['spamassassin']
> $CONFIG['spamgroup']
> $res
> $spam_fail
> $newsgroups

I would try adding a line inside the first 'if' that creates a file, so you can see if it ever gets there:

touch('/path/to/some/file/i/have/privileges/to/write');

If that fails, try changing $CONFIG['spamassassin'] from '1' to true in rslight.inc.php:
'spamassassin' => true,

--
Retro Guy

On Thu, 21 Dec 2023 00:12:35 +0000
retro.guy@rocksolidbbs.com (Retro Guy) wrote:

> Retro Guy wrote:
>
> > On Wed, 20 Dec 2023 23:47:58 -0000 (UTC), Retro Guy wrote:
>
> >> On Wed, 20 Dec 2023 17:41:28 -0600, SugarBug wrote:
> >>
> >>> On Wed, 20 Dec 2023 23:22:44 -0000 (UTC)
> >>> Retro Guy <retroguy@i2pn2.org> wrote:
> >>>
> >>>> On Wed, 20 Dec 2023 17:06:53 -0600, SugarBug wrote:
> >>>>
> >>>> > On Wed, 20 Dec 2023 22:59:46 -0000 (UTC) Retro Guy
> >>>> > <retroguy@i2pn2.org> wrote:
> >>>> >
> >>>> > <snip>
> >>>> >
> >>>> >> > Multiple times I deleted the entire spool, set overrides so
> >>>> >> > they would pull only a few messages per run, and ran
> >>>> >> > multiple times, and none of the spam is moved to spam.
> >>>> >>
> >>>> >> is rocksolid.spam in $config_dir/spoolnews/groups.txt ?
> >>>> >
> >>>> > spoolnews$ cat groups.txt rocksolid.spam
> >>>> >
> >>>> > spoolnews$ cat groups.txt.dist rocksolid.spam
> >>>>
> >>>> Not sure if it would be a problem, but is rocksolid.spam in more
> >>>> than one section/groups.txt?
> >>>>
> >>>> I only ask because I see it on one of the sites you sent me a
> >>>> link to.
> >>>
> >>> I added it in rocksolid/groups.txt so it would be visible.
> >>
> >> Try taking it out of one. So it is in only one section. It
> >> shouldn't matter what section.
>
> > Also, the code for checking spam is in post.inc.php:
>
> > if ((isset($CONFIG['spamassassin']) && ($CONFIG['spamassassin']
> > == true))) {
> > $spam_result_array = check_spam($subject, $from,
> > $newsgroups, $ref, $body, $msgid);
> > $res = $spam_result_array['res'];
> > $spamresult = $spam_result_array['spamresult'];
> > $spamcheckerversion =
> > $spam_result_array['spamcheckerversion']; $spamlevel =
> > $spam_result_array['spamlevel']; $spam_fail =
> > $spam_result_array['spam_fail']; }
>
> > followed by:
>
> > if ((isset($CONFIG['spamassassin']) &&
> > ($CONFIG['spamassassin'] == true))) {
> > if (isset($res) && $spam_fail == 0) {
> > fputs($ns, $spamcheckerversion . "rn");
> > if (strpos($spamlevel, '*') !== false)
> > fputs($ns, $spamlevel . "rn");
> > if ($res === 1) {
> > fputs($ns, "X-Rslight-Original-Group: " .
> > $newsgroups . "rn");
> > $newsgroups = $CONFIG['spamgroup'];
> > }
> > }
> > }
>
> > You might try echoing some values while testing:
>
> > $CONFIG['spamassassin']
> > $CONFIG['spamgroup']
> > $res
> > $spam_fail
> > $newsgroups
>
> I would try adding a line inside the first 'if' that creates a file,
> so you can see if it ever gets there:
>
> touch('/path/to/some/file/i/have/privileges/to/write');
>
> If that fails, try changing $CONFIG['spamassassin'] from '1' to true
> in rslight.inc.php: 'spamassassin' => true,

I changed config to: 'spamassassin' => true,
I wiped out the spool and started over:

spool$ ls | grep -v nocem | while read line ; do rm -rf "$line" ; done

I ran the cron several times.

Nothing shows up in syslog. The blacklisted messages are copied to the
newsgroup.

I changed spamassassin' => true, back to spamassassin' => 1,

Then I removed the random section and put the groups in the rocksolid
section. I removed the random folder and random.inc.php. Now when I run
the cron I get:

Sending articles
Send DonePHP Fatal error: Uncaught TypeError: fgets(): Argument #1
($stream) must be of type resource, bool given in
..../rocksolid/newsportal.php:355 Stack trace: #0
..../rocksolid/newsportal.php(355): fgets() #1
..../scripts/spoolnews.php(352): testGroup() #2
..../scripts/spoolnews.php(139): get_articles() #3 {main}
thrown in ..//rocksolid/newsportal.php on line 355

And still nothing for spamc or spamd in syslog.

I wiped out the spool and tried again. Still nothing in syslog. Still
this error:

Sending articles
Send DonePHP Fatal error: Uncaught TypeError: fgets(): Argument #1
($stream) must be of type resource, bool given in
..../rocksolid/newsportal.php:355 Stack trace: #0
..../rocksolid/newsportal.php(355): fgets() #1
..../scripts/spoolnews.php(352): testGroup() #2
..../scripts/spoolnews.php(139): get_articles() #3 {main}
thrown in ..//rocksolid/newsportal.php on line 355

A few runs I changed the spamc setting to /bin/spamc. Still same
results.

<snip>

I removed all sections except the rocksolid section.

$ cat rocksolid/groups.txt
:random newsgroups...
spam
spam.spam
spam.spam.spam
alt.bible
sci.med.cardiology

Below I redacted user/pass/port data:

$ cat rslight.inc.php

<?php
return [
'remote_server' => 'news.i2pn2.org',
'remote_port' => '119',
'remote_ssl' => '563',
'socks_host' => '',
'socks_port' => '',
'remote_auth_user' => '[redacted]',
'remote_auth_pass' => '[redacted]',
'enable_nntp' => '1',
'local_server' => '127.0.0.1',
'local_port' => '[redacted]',
'local_ssl_port' => '[redacted]',
'enable_all_networks' => '1',
'server_auth_user' => '[redacted]',
'server_auth_pass' => '[redacted]',
'site_shortname' => '',
'rslight_title' => '',
'title_full' => 'rocksolid.sybershock.com',
'hide_email' => '1',
'email_tail' => '@sybershock.com',
'anonusername' => '[redacted]',
'anonuserpass' => '[redacted]',
'timezone' => '0',
'default_content' => '/rocksolid/index.php',
'readonly' => '',
'anonuser' => '',
'organization' => 'rocksolid.sybershock.com',
'postfooter' => 'rocksolid.sybershock.com',
'synchronet' => '',
'rate_limit' => '20',
'auto_create' => '',
'verify_email' => '1',
'no_verify' => '',
'auto_return' => '',
'overboard_noshow' => 'rocksolid.shared.test',
'spamassassin' => '1',
'spamc' => 'spamc',
'spamgroup' => 'rocksolid.spam',
'php_exec' => 'php',
'tac' => '/var/lib/php/sessions',
'webserver_user' => 'sybershock.com',
'enable_nocem' => '',
'nocem_groups' => 'rocksolid.spam',
'expire_days' => '0',
'pathhost' => 'rocksolid.sybershock.com',
'article_database' => '',
'open_clients' => '',
'thissitekey' => '[redacted]'
];
?>

I still get the same errors, especially line 355. Nothing shows up in
syslog. Here is the cron output from the testing code in post.inc.php:

>>>>>>>>>1 | rocksolid.spam | | | | <<<<<<<<< | Updated user count
Sending articles
Send DonePHP Fatal error: Uncaught TypeError: fgets(): Argument #1
($stream) must be of type resource, bool given in
..../rocksolid/newsportal.php:355 Stack trace: #0
..../rocksolid/newsportal.php(355): fgets() #1
..../scripts/spoolnews.php(352): testGroup() #2
..../scripts/spoolnews.php(139): get_articles() #3 {main}
thrown in
..../rocksolid/newsportal.php
on line 355

Refreshed spoolnews
Expired articles
Sending articles
Send DonePHP Fatal error: Uncaught TypeError: fputs(): supplied
resource is not a valid stream resource in
..../rocksolid/lib/thread.inc.php:237 Stack trace: #0
..../rocksolid/lib/thread.inc.php(237): fputs() #1
..../rocksolid/lib/thread.inc.php(304): thread_overview_read() #2
..../scripts/spoolnews.php(146): thread_load_newsserver() #3 {main}
thrown in .../rocksolid/lib/thread.inc.php on line 237

Refreshed spoolnews
Expired articles
Sending articles
Send Done
Refreshed spoolnews
Expired articles
RSS Feeds updated
Log files rotated
Keys rotated
Removed old files

I wiped everything out and started over with the settings above:

[run 1]

>>>>>>>>>1 | rocksolid.spam | | | | <<<<<<<<< | Updated user count
Sending articles
Send Done
Refreshed spoolnews
Expired articles
Sending articles
Send Done
Refreshed spoolnews
Expired articles
RSS Feeds updated
Rotated:
..../spool//log/cron.log
Rotated:
..../spool//log/expire.log
Rotated:
..../spool//log/nntp.log
Rotated:
..../spool//log/spoolnews.log
Log files rotated
Keys rotated
Removed old files

[run 2]

>>>>>>>>>1 | rocksolid.spam | | | | <<<<<<<<< | Updated user count
Sending articles
Send Done
Refreshed spoolnews
Expired articles
Sending articles
Send Done
Refreshed spoolnews
Expired articles
RSS Feeds updated
Log files rotated
Keys rotated
Removed old files

The errors went away. I wonder if something is getting corrupted in the
spool?

Still no incoming spam is flagged or removed. The blacklisted addresses
have no effect and spamc is not triggered.

On Thu, 21 Dec 2023 06:52:07 -0600, SugarBug wrote:

> <snip>
>
> I removed all sections except the rocksolid section.
>
> $ cat rocksolid/groups.txt :random newsgroups...
> spam spam.spam spam.spam.spam alt.bible sci.med.cardiology
>
> Below I redacted user/pass/port data:
>
> $ cat rslight.inc.php
>
> <?php return [
> 'remote_server' => 'news.i2pn2.org',
> 'remote_port' => '119',
> 'remote_ssl' => '563',
> 'socks_host' => '',
> 'socks_port' => '',
> 'remote_auth_user' => '[redacted]', 'remote_auth_pass' =>
> '[redacted]',
> 'enable_nntp' => '1',
> 'local_server' => '127.0.0.1',
> 'local_port' => '[redacted]',
> 'local_ssl_port' => '[redacted]', 'enable_all_networks' => '1',
> 'server_auth_user' => '[redacted]', 'server_auth_pass' =>
> '[redacted]',
> 'site_shortname' => '',
> 'rslight_title' => '',
> 'title_full' => 'rocksolid.sybershock.com', 'hide_email' => '1',
> 'email_tail' => '@sybershock.com',
> 'anonusername' => '[redacted]',
> 'anonuserpass' => '[redacted]',
> 'timezone' => '0',
> 'default_content' => '/rocksolid/index.php', 'readonly' => '',
> 'anonuser' => '',
> 'organization' => 'rocksolid.sybershock.com', 'postfooter' =>
> 'rocksolid.sybershock.com', 'synchronet' => '',
> 'rate_limit' => '20',
> 'auto_create' => '',
> 'verify_email' => '1',
> 'no_verify' => '',
> 'auto_return' => '',
> 'overboard_noshow' => 'rocksolid.shared.test', 'spamassassin' => '1',
> 'spamc' => 'spamc',
> 'spamgroup' => 'rocksolid.spam',
> 'php_exec' => 'php',
> 'tac' => '/var/lib/php/sessions',
> 'webserver_user' => 'sybershock.com',
> 'enable_nocem' => '',
> 'nocem_groups' => 'rocksolid.spam',
> 'expire_days' => '0',
> 'pathhost' => 'rocksolid.sybershock.com', 'article_database' => '',
> 'open_clients' => '',
> 'thissitekey' => '[redacted]'
> ];
> ?>
>
> I still get the same errors, especially line 355. Nothing shows up in
> syslog. Here is the cron output from the testing code in post.inc.php:
>
>>>>>>>>>>1 | rocksolid.spam | | | | <<<<<<<<< | Updated user count
> Sending articles Send DonePHP Fatal error: Uncaught TypeError: fgets():
> Argument #1 ($stream) must be of type resource, bool given in
> .../rocksolid/newsportal.php:355 Stack trace: #0
> .../rocksolid/newsportal.php(355): fgets() #1
> .../scripts/spoolnews.php(352): testGroup() #2
> .../scripts/spoolnews.php(139): get_articles() #3 {main}
> thrown in
> .../rocksolid/newsportal.php on line 355
>
> Refreshed spoolnews Expired articles Sending articles Send DonePHP Fatal
> error: Uncaught TypeError: fputs(): supplied resource is not a valid
> stream resource in .../rocksolid/lib/thread.inc.php:237 Stack trace: #0
> .../rocksolid/lib/thread.inc.php(237): fputs() #1
> .../rocksolid/lib/thread.inc.php(304): thread_overview_read() #2
> .../scripts/spoolnews.php(146): thread_load_newsserver() #3 {main}
> thrown in .../rocksolid/lib/thread.inc.php on line 237
>
> Refreshed spoolnews Expired articles Sending articles Send Done
> Refreshed spoolnews Expired articles RSS Feeds updated Log files rotated
> Keys rotated Removed old files
>
> I wiped everything out and started over with the settings above:
>
> [run 1]
>
>>>>>>>>>>1 | rocksolid.spam | | | | <<<<<<<<< | Updated user count
> Sending articles Send Done Refreshed spoolnews Expired articles Sending
> articles Send Done Refreshed spoolnews Expired articles RSS Feeds
> updated Rotated:
> .../spool//log/cron.log Rotated:
> .../spool//log/expire.log Rotated:
> .../spool//log/nntp.log Rotated:
> .../spool//log/spoolnews.log Log files rotated Keys rotated Removed old
> files
>
> [run 2]
>
>>>>>>>>>>1 | rocksolid.spam | | | | <<<<<<<<< | Updated user count
> Sending articles Send Done Refreshed spoolnews Expired articles Sending
> articles Send Done Refreshed spoolnews Expired articles RSS Feeds
> updated Log files rotated Keys rotated Removed old files
>
> The errors went away. I wonder if something is getting corrupted in the
> spool?
>
> Still no incoming spam is flagged or removed. The blacklisted addresses
> have no effect and spamc is not triggered.

Incoming messages are NOT checked for spam. Only locally posted messages.
It took me a while to realize what you're trying to accomplish, but now I
think I see. I thought you were trying to filter (spam check) posts from
your own site (which should work).

Adding incoming checking shouldn't be hard to do, it's already in
post.inc.php. I'm willing to do that if you like.

On Thu, 21 Dec 2023 00:12:35 +0000
retro.guy@rocksolidbbs.com (Retro Guy) wrote:

> Retro Guy wrote:
>
> > On Wed, 20 Dec 2023 23:47:58 -0000 (UTC), Retro Guy wrote:
>
> >> On Wed, 20 Dec 2023 17:41:28 -0600, SugarBug wrote:
> >>
> >>> On Wed, 20 Dec 2023 23:22:44 -0000 (UTC)
> >>> Retro Guy <retroguy@i2pn2.org> wrote:
> >>>
> >>>> On Wed, 20 Dec 2023 17:06:53 -0600, SugarBug wrote:
> >>>>
> >>>> > On Wed, 20 Dec 2023 22:59:46 -0000 (UTC) Retro Guy
> >>>> > <retroguy@i2pn2.org> wrote:
> >>>> >
> >>>> > <snip>
> >>>> >
> >>>> >> > Multiple times I deleted the entire spool, set overrides so
> >>>> >> > they would pull only a few messages per run, and ran
> >>>> >> > multiple times, and none of the spam is moved to spam.
> >>>> >>
> >>>> >> is rocksolid.spam in $config_dir/spoolnews/groups.txt ?
> >>>> >
> >>>> > spoolnews$ cat groups.txt rocksolid.spam
> >>>> >
> >>>> > spoolnews$ cat groups.txt.dist rocksolid.spam
> >>>>
> >>>> Not sure if it would be a problem, but is rocksolid.spam in more
> >>>> than one section/groups.txt?
> >>>>
> >>>> I only ask because I see it on one of the sites you sent me a
> >>>> link to.
> >>>
> >>> I added it in rocksolid/groups.txt so it would be visible.
> >>
> >> Try taking it out of one. So it is in only one section. It
> >> shouldn't matter what section.
>
> > Also, the code for checking spam is in post.inc.php:
>
> > if ((isset($CONFIG['spamassassin']) && ($CONFIG['spamassassin']
> > == true))) {
> > $spam_result_array = check_spam($subject, $from,
> > $newsgroups, $ref, $body, $msgid);
> > $res = $spam_result_array['res'];
> > $spamresult = $spam_result_array['spamresult'];
> > $spamcheckerversion =
> > $spam_result_array['spamcheckerversion']; $spamlevel =
> > $spam_result_array['spamlevel']; $spam_fail =
> > $spam_result_array['spam_fail']; }
>
> > followed by:
>
> > if ((isset($CONFIG['spamassassin']) &&
> > ($CONFIG['spamassassin'] == true))) {
> > if (isset($res) && $spam_fail == 0) {
> > fputs($ns, $spamcheckerversion . "rn");
> > if (strpos($spamlevel, '*') !== false)
> > fputs($ns, $spamlevel . "rn");
> > if ($res === 1) {
> > fputs($ns, "X-Rslight-Original-Group: " .
> > $newsgroups . "rn");
> > $newsgroups = $CONFIG['spamgroup'];
> > }
> > }
> > }
>
> > You might try echoing some values while testing:
>
> > $CONFIG['spamassassin']
> > $CONFIG['spamgroup']
> > $res
> > $spam_fail
> > $newsgroups
>
> I would try adding a line inside the first 'if' that creates a file,
> so you can see if it ever gets there:
>
> touch('/path/to/some/file/i/have/privileges/to/write');
>
> If that fails, try changing $CONFIG['spamassassin'] from '1' to true
> in rslight.inc.php: 'spamassassin' => true,

I put the code inside the if block and it was never triggered. The only
place it triggers is at the end of the file.

For some reason it appears that spamc is never invoked at all.

On Thu, 21 Dec 2023 12:54:42 +0000
Retro Guy <retroguy@novabbs.org> wrote:

> Incoming messages are NOT checked for spam. Only locally posted
> messages. It took me a while to realize what you're trying to
> accomplish, but now I think I see. I thought you were trying to
> filter (spam check) posts from your own site (which should work).

Well that explains it.

Yes, I was expecting it to filter all the incoming messages with
spamassassin client.

So does that mean there is no way for me to filter incoming spam
floods? How is that supposed to work?

On Thu, 21 Dec 2023 07:14:15 -0600, SugarBug wrote:

> On Thu, 21 Dec 2023 12:54:42 +0000 Retro Guy <retroguy@novabbs.org>
> wrote:
>
>> Incoming messages are NOT checked for spam. Only locally posted
>> messages. It took me a while to realize what you're trying to
>> accomplish, but now I think I see. I thought you were trying to filter
>> (spam check) posts from your own site (which should work).
>
> Well that explains it.
>
> Yes, I was expecting it to filter all the incoming messages with
> spamassassin client.
>
> So does that mean there is no way for me to filter incoming spam floods?
> How is that supposed to work?

Let's add filtering to spoolnews.php. I'll mess with that now and get back
to you.

On Thu, 21 Dec 2023 12:54:42 +0000
Retro Guy <retroguy@novabbs.org> wrote:

<snip>
> > Still no incoming spam is flagged or removed. The blacklisted
> > addresses have no effect and spamc is not triggered.
>
> Incoming messages are NOT checked for spam. Only locally posted
> messages. It took me a while to realize what you're trying to
> accomplish, but now I think I see. I thought you were trying to
> filter (spam check) posts from your own site (which should work).

Posting locally only half works. I posted from a blacklisted address.
The message is not in the spool, but its entry shows up in the web
portal:

https://rocksolid.sybershock.com/rocksolid/thread.php?group=spam

The message was not moved to group 'spam'. I simply created a group
named 'spam' and posted from reader to that group. rocksolid.spam is
still configured as the spam group in rslight.inc.php.

The subject line also shows up in the desktop news client via NNTP. But
the message is not accessible via NNTP.

So the subject of spam messages still pollutes the space on this
install.

> Adding incoming checking shouldn't be hard to do, it's already in
> post.inc.php. I'm willing to do that if you like.

If I post a second message from the same address, then the news reader
says there is a unspecified network error. It seems that rslight catches
it and then drops the connection. There is no feedback in the network
log, just a connection drop.

On Thu, 21 Dec 2023 13:20:37 +0000
Retro Guy <retroguy@novabbs.org> wrote:

> On Thu, 21 Dec 2023 07:14:15 -0600, SugarBug wrote:
>
> > On Thu, 21 Dec 2023 12:54:42 +0000 Retro Guy <retroguy@novabbs.org>
> > wrote:
> >
> >> Incoming messages are NOT checked for spam. Only locally posted
> >> messages. It took me a while to realize what you're trying to
> >> accomplish, but now I think I see. I thought you were trying to
> >> filter (spam check) posts from your own site (which should work).
> >
> > Well that explains it.
> >
> > Yes, I was expecting it to filter all the incoming messages with
> > spamassassin client.
> >
> > So does that mean there is no way for me to filter incoming spam
> > floods? How is that supposed to work?
>
> Let's add filtering to spoolnews.php. I'll mess with that now and get
> back to you.

In the meantime here is what I think I might be able to do as a hack.
Tell me what you think.

Use one of my hidden peers to _pull_ from other public servers that are
run by you and other sysops.

Script a change in remote so this hidden peer periodically authenticates
and _pushes_ to my public peer.

Since the hidden peer is authenticating and posting messages in reader
mode to my public peer, shouldn't post.php invoke spamc on the incoming
messages?

On Thu, 21 Dec 2023 07:32:45 -0600, SugarBug wrote:

> On Thu, 21 Dec 2023 12:54:42 +0000 Retro Guy <retroguy@novabbs.org>
> wrote:
>
> <snip>
>
>> > Still no incoming spam is flagged or removed. The blacklisted
>> > addresses have no effect and spamc is not triggered.
>>
>> Incoming messages are NOT checked for spam. Only locally posted
>> messages. It took me a while to realize what you're trying to
>> accomplish, but now I think I see. I thought you were trying to filter
>> (spam check) posts from your own site (which should work).
>
> Posting locally only half works. I posted from a blacklisted address.
> The message is not in the spool, but its entry shows up in the web
> portal:
>
> https://rocksolid.sybershock.com/rocksolid/thread.php?group=spam
>
> The message was not moved to group 'spam'. I simply created a group
> named 'spam' and posted from reader to that group. rocksolid.spam is
> still configured as the spam group in rslight.inc.php.
>
> The subject line also shows up in the desktop news client via NNTP. But
> the message is not accessible via NNTP.
>
> So the subject of spam messages still pollutes the space on this
> install.
>
>> Adding incoming checking shouldn't be hard to do, it's already in
>> post.inc.php. I'm willing to do that if you like.
>
> If I post a second message from the same address, then the news reader
> says there is a unspecified network error. It seems that rslight catches
> it and then drops the connection. There is no feedback in the network
> log, just a connection drop.

I'm working on spoolnews.php now...

When you post, is this via a newsreader or the web interface? I need to
check the differences in filtering between them and I'd like to get this
all working :)

On Thu, 21 Dec 2023 13:47:20 -0000 (UTC)
Retro Guy <retroguy@i2pn2.org> wrote:

> On Thu, 21 Dec 2023 07:32:45 -0600, SugarBug wrote:
>
> > On Thu, 21 Dec 2023 12:54:42 +0000 Retro Guy <retroguy@novabbs.org>
> > wrote:
> >
> > <snip>
> >
> >> > Still no incoming spam is flagged or removed. The blacklisted
> >> > addresses have no effect and spamc is not triggered.
> >>
> >> Incoming messages are NOT checked for spam. Only locally posted
> >> messages. It took me a while to realize what you're trying to
> >> accomplish, but now I think I see. I thought you were trying to
> >> filter (spam check) posts from your own site (which should work).
> >
> > Posting locally only half works. I posted from a blacklisted
> > address. The message is not in the spool, but its entry shows up in
> > the web portal:
> >
> > https://rocksolid.sybershock.com/rocksolid/thread.php?group=spam
> >
> > The message was not moved to group 'spam'. I simply created a group
> > named 'spam' and posted from reader to that group. rocksolid.spam is
> > still configured as the spam group in rslight.inc.php.
> >
> > The subject line also shows up in the desktop news client via NNTP.
> > But the message is not accessible via NNTP.
> >
> > So the subject of spam messages still pollutes the space on this
> > install.
> >
> >> Adding incoming checking shouldn't be hard to do, it's already in
> >> post.inc.php. I'm willing to do that if you like.
> >
> > If I post a second message from the same address, then the news
> > reader says there is a unspecified network error. It seems that
> > rslight catches it and then drops the connection. There is no
> > feedback in the network log, just a connection drop.
>
> I'm working on spoolnews.php now...
>
> When you post, is this via a newsreader or the web interface? I need
> to check the differences in filtering between them and I'd like to
> get this all working :)

I've been doing it via newsreader exclusively.

On Thu, 21 Dec 2023 07:50:18 -0600, SugarBug wrote:

> On Thu, 21 Dec 2023 13:47:20 -0000 (UTC) Retro Guy <retroguy@i2pn2.org>
> wrote:
>
>> On Thu, 21 Dec 2023 07:32:45 -0600, SugarBug wrote:
>>
>> > On Thu, 21 Dec 2023 12:54:42 +0000 Retro Guy <retroguy@novabbs.org>
>> > wrote:
>> >
>> > <snip>
>> >
>> >> > Still no incoming spam is flagged or removed. The blacklisted
>> >> > addresses have no effect and spamc is not triggered.
>> >>
>> >> Incoming messages are NOT checked for spam. Only locally posted
>> >> messages. It took me a while to realize what you're trying to
>> >> accomplish, but now I think I see. I thought you were trying to
>> >> filter (spam check) posts from your own site (which should work).
>> >
>> > Posting locally only half works. I posted from a blacklisted address.
>> > The message is not in the spool, but its entry shows up in the web
>> > portal:
>> >
>> > https://rocksolid.sybershock.com/rocksolid/thread.php?group=spam
>> >
>> > The message was not moved to group 'spam'. I simply created a group
>> > named 'spam' and posted from reader to that group. rocksolid.spam is
>> > still configured as the spam group in rslight.inc.php.
>> >
>> > The subject line also shows up in the desktop news client via NNTP.
>> > But the message is not accessible via NNTP.
>> >
>> > So the subject of spam messages still pollutes the space on this
>> > install.
>> >
>> >> Adding incoming checking shouldn't be hard to do, it's already in
>> >> post.inc.php. I'm willing to do that if you like.
>> >
>> > If I post a second message from the same address, then the news
>> > reader says there is a unspecified network error. It seems that
>> > rslight catches it and then drops the connection. There is no
>> > feedback in the network log, just a connection drop.
>>
>> I'm working on spoolnews.php now...
>>
>> When you post, is this via a newsreader or the web interface? I need to
>> check the differences in filtering between them and I'd like to get
>> this all working :)
>
> I've been doing it via newsreader exclusively.

Ok, I'm trying via web interface. It IS blocking the message, but not
allowing it to go to rocksolid.spam. Working on that...

Once that works, we apply to newsreader connections.

I already have spoolnews.php checking (but not doing anything about)
incoming messages. spoolnews part should be easy.

On Thu, 21 Dec 2023 07:32:45 -0600
SugarBug <3883@sugar.bug> wrote:

> On Thu, 21 Dec 2023 12:54:42 +0000
> Retro Guy <retroguy@novabbs.org> wrote:
>
> <snip>
>
> > > Still no incoming spam is flagged or removed. The blacklisted
> > > addresses have no effect and spamc is not triggered.
> >
> > Incoming messages are NOT checked for spam. Only locally posted
> > messages. It took me a while to realize what you're trying to
> > accomplish, but now I think I see. I thought you were trying to
> > filter (spam check) posts from your own site (which should work).
>
> Posting locally only half works. I posted from a blacklisted address.
> The message is not in the spool, but its entry shows up in the web
> portal:
>
> https://rocksolid.sybershock.com/rocksolid/thread.php?group=spam
>
> The message was not moved to group 'spam'. I simply created a group
> named 'spam' and posted from reader to that group. rocksolid.spam is
> still configured as the spam group in rslight.inc.php.
>
> The subject line also shows up in the desktop news client via NNTP.
> But the message is not accessible via NNTP.
>
> So the subject of spam messages still pollutes the space on this
> install.
>
> > Adding incoming checking shouldn't be hard to do, it's already in
> > post.inc.php. I'm willing to do that if you like.
>
> If I post a second message from the same address, then the news reader
> says there is a unspecified network error. It seems that rslight
> catches it and then drops the connection. There is no feedback in the
> network log, just a connection drop.

I can confirm this behavior replicates when posting from a newsreader
via NNTP.

https://rocksolid.sybershock.com/rocksolid/thread.php?group=spam.spam

If I post from a blacklisted address the subject shows up in the web
portal and the NNTP news reader. The second post to that group from the
same address does not show up. Instead the network connection drops,
and a blank numbered message file is placed in the article spool.

None of the blocked test messages appear to be moved to rocksolid.spam.

If you click on the links you'll see what I mean:

https://rocksolid.sybershock.com/rocksolid/index.php

I haven't tested posting from the web portal because user creation is
broken and I'm troubleshooting that too.

On Thu, 21 Dec 2023 08:00:22 -0600, SugarBug wrote:

> On Thu, 21 Dec 2023 07:32:45 -0600 SugarBug <3883@sugar.bug> wrote:
>
>> On Thu, 21 Dec 2023 12:54:42 +0000 Retro Guy <retroguy@novabbs.org>
>> wrote:
>>
>> <snip>
>>
>> > > Still no incoming spam is flagged or removed. The blacklisted
>> > > addresses have no effect and spamc is not triggered.
>> >
>> > Incoming messages are NOT checked for spam. Only locally posted
>> > messages. It took me a while to realize what you're trying to
>> > accomplish, but now I think I see. I thought you were trying to
>> > filter (spam check) posts from your own site (which should work).
>>
>> Posting locally only half works. I posted from a blacklisted address.
>> The message is not in the spool, but its entry shows up in the web
>> portal:
>>
>> https://rocksolid.sybershock.com/rocksolid/thread.php?group=spam
>>
>> The message was not moved to group 'spam'. I simply created a group
>> named 'spam' and posted from reader to that group. rocksolid.spam is
>> still configured as the spam group in rslight.inc.php.
>>
>> The subject line also shows up in the desktop news client via NNTP. But
>> the message is not accessible via NNTP.
>>
>> So the subject of spam messages still pollutes the space on this
>> install.
>>
>> > Adding incoming checking shouldn't be hard to do, it's already in
>> > post.inc.php. I'm willing to do that if you like.
>>
>> If I post a second message from the same address, then the news reader
>> says there is a unspecified network error. It seems that rslight
>> catches it and then drops the connection. There is no feedback in the
>> network log, just a connection drop.
>
> I can confirm this behavior replicates when posting from a newsreader
> via NNTP.
>
> https://rocksolid.sybershock.com/rocksolid/thread.php?group=spam.spam
>
> If I post from a blacklisted address the subject shows up in the web
> portal and the NNTP news reader. The second post to that group from the
> same address does not show up. Instead the network connection drops, and
> a blank numbered message file is placed in the article spool.

It sounds like it's in the overview, but not the article database. We'll
look at that soon...

On Thu, 21 Dec 2023 13:58:46 -0000 (UTC)
Retro Guy <retroguy@i2pn2.org> wrote:

> On Thu, 21 Dec 2023 07:50:18 -0600, SugarBug wrote:
>
> > On Thu, 21 Dec 2023 13:47:20 -0000 (UTC) Retro Guy
> > <retroguy@i2pn2.org> wrote:
> >
> >> On Thu, 21 Dec 2023 07:32:45 -0600, SugarBug wrote:
> >>
> >> > On Thu, 21 Dec 2023 12:54:42 +0000 Retro Guy
> >> > <retroguy@novabbs.org> wrote:
> >> >
> >> > <snip>
> >> >
> >> >> > Still no incoming spam is flagged or removed. The blacklisted
> >> >> > addresses have no effect and spamc is not triggered.
> >> >>
> >> >> Incoming messages are NOT checked for spam. Only locally posted
> >> >> messages. It took me a while to realize what you're trying to
> >> >> accomplish, but now I think I see. I thought you were trying to
> >> >> filter (spam check) posts from your own site (which should
> >> >> work).
> >> >
> >> > Posting locally only half works. I posted from a blacklisted
> >> > address. The message is not in the spool, but its entry shows up
> >> > in the web portal:
> >> >
> >> > https://rocksolid.sybershock.com/rocksolid/thread.php?group=spam
> >> >
> >> > The message was not moved to group 'spam'. I simply created a
> >> > group named 'spam' and posted from reader to that group.
> >> > rocksolid.spam is still configured as the spam group in
> >> > rslight.inc.php.
> >> >
> >> > The subject line also shows up in the desktop news client via
> >> > NNTP. But the message is not accessible via NNTP.
> >> >
> >> > So the subject of spam messages still pollutes the space on this
> >> > install.
> >> >
> >> >> Adding incoming checking shouldn't be hard to do, it's already
> >> >> in post.inc.php. I'm willing to do that if you like.
> >> >
> >> > If I post a second message from the same address, then the news
> >> > reader says there is a unspecified network error. It seems that
> >> > rslight catches it and then drops the connection. There is no
> >> > feedback in the network log, just a connection drop.
> >>
> >> I'm working on spoolnews.php now...
> >>
> >> When you post, is this via a newsreader or the web interface? I
> >> need to check the differences in filtering between them and I'd
> >> like to get this all working :)
> >
> > I've been doing it via newsreader exclusively.
>
> Ok, I'm trying via web interface. It IS blocking the message, but not
> allowing it to go to rocksolid.spam. Working on that...
>
> Once that works, we apply to newsreader connections.
>
> I already have spoolnews.php checking (but not doing anything about)
> incoming messages. spoolnews part should be easy.

I finally got an account registered on this install. The web interface
blocks the blacklisted address from posting on this end. It replies:

rocksolid / spam / test 1
Compose a new post in spam
The Message Server rejected the message:

On Thu, 21 Dec 2023 08:00:22 -0600, SugarBug wrote:

> On Thu, 21 Dec 2023 07:32:45 -0600 SugarBug <3883@sugar.bug> wrote:
>
>> On Thu, 21 Dec 2023 12:54:42 +0000 Retro Guy <retroguy@novabbs.org>
>> wrote:
>>
>> <snip>
>>
>> > > Still no incoming spam is flagged or removed. The blacklisted
>> > > addresses have no effect and spamc is not triggered.
>> >
>> > Incoming messages are NOT checked for spam. Only locally posted
>> > messages. It took me a while to realize what you're trying to
>> > accomplish, but now I think I see. I thought you were trying to
>> > filter (spam check) posts from your own site (which should work).
>>
>> Posting locally only half works. I posted from a blacklisted address.
>> The message is not in the spool, but its entry shows up in the web
>> portal:
>>
>> https://rocksolid.sybershock.com/rocksolid/thread.php?group=spam
>>
>> The message was not moved to group 'spam'. I simply created a group
>> named 'spam' and posted from reader to that group. rocksolid.spam is
>> still configured as the spam group in rslight.inc.php.
>>
>> The subject line also shows up in the desktop news client via NNTP. But
>> the message is not accessible via NNTP.
>>
>> So the subject of spam messages still pollutes the space on this
>> install.
>>
>> > Adding incoming checking shouldn't be hard to do, it's already in
>> > post.inc.php. I'm willing to do that if you like.
>>
>> If I post a second message from the same address, then the news reader
>> says there is a unspecified network error. It seems that rslight
>> catches it and then drops the connection. There is no feedback in the
>> network log, just a connection drop.
>
> I can confirm this behavior replicates when posting from a newsreader
> via NNTP.
>
> https://rocksolid.sybershock.com/rocksolid/thread.php?group=spam.spam
>
> If I post from a blacklisted address the subject shows up in the web
> portal and the NNTP news reader. The second post to that group from the
> same address does not show up. Instead the network connection drops, and
> a blank numbered message file is placed in the article spool.
>
> None of the blocked test messages appear to be moved to rocksolid.spam.
>
> If you click on the links you'll see what I mean:
>
> https://rocksolid.sybershock.com/rocksolid/index.php
>
> I haven't tested posting from the web portal because user creation is
> broken and I'm troubleshooting that too.

I've temporarily removed moving the message to rocksolid spam, and instead
just send a nntp reply to display:

The Message Server rejected the message:
441 Posting failed (Exceeds Spam Score)

Once I get this working properly with newsreader posts, and spoolnews.php,
we can then reconsider whether to move them or just drop them.

On Thu, 21 Dec 2023 16:00:18 -0000 (UTC)
Retro Guy <retroguy@i2pn2.org> wrote:

> On Thu, 21 Dec 2023 08:00:22 -0600, SugarBug wrote:
>
> > On Thu, 21 Dec 2023 07:32:45 -0600 SugarBug <3883@sugar.bug> wrote:
> >
> >> On Thu, 21 Dec 2023 12:54:42 +0000 Retro Guy <retroguy@novabbs.org>
> >> wrote:
> >>
> >> <snip>
> >>
> >> > > Still no incoming spam is flagged or removed. The blacklisted
> >> > > addresses have no effect and spamc is not triggered.
> >> >
> >> > Incoming messages are NOT checked for spam. Only locally posted
> >> > messages. It took me a while to realize what you're trying to
> >> > accomplish, but now I think I see. I thought you were trying to
> >> > filter (spam check) posts from your own site (which should
> >> > work).
> >>
> >> Posting locally only half works. I posted from a blacklisted
> >> address. The message is not in the spool, but its entry shows up
> >> in the web portal:
> >>
> >> https://rocksolid.sybershock.com/rocksolid/thread.php?group=spam
> >>
> >> The message was not moved to group 'spam'. I simply created a group
> >> named 'spam' and posted from reader to that group. rocksolid.spam
> >> is still configured as the spam group in rslight.inc.php.
> >>
> >> The subject line also shows up in the desktop news client via
> >> NNTP. But the message is not accessible via NNTP.
> >>
> >> So the subject of spam messages still pollutes the space on this
> >> install.
> >>
> >> > Adding incoming checking shouldn't be hard to do, it's already in
> >> > post.inc.php. I'm willing to do that if you like.
> >>
> >> If I post a second message from the same address, then the news
> >> reader says there is a unspecified network error. It seems that
> >> rslight catches it and then drops the connection. There is no
> >> feedback in the network log, just a connection drop.
> >
> > I can confirm this behavior replicates when posting from a
> > newsreader via NNTP.
> >
> > https://rocksolid.sybershock.com/rocksolid/thread.php?group=spam.spam
> >
> > If I post from a blacklisted address the subject shows up in the web
> > portal and the NNTP news reader. The second post to that group from
> > the same address does not show up. Instead the network connection
> > drops, and a blank numbered message file is placed in the article
> > spool.
> >
> > None of the blocked test messages appear to be moved to
> > rocksolid.spam.
> >
> > If you click on the links you'll see what I mean:
> >
> > https://rocksolid.sybershock.com/rocksolid/index.php
> >
> > I haven't tested posting from the web portal because user creation
> > is broken and I'm troubleshooting that too.
>
> I've temporarily removed moving the message to rocksolid spam, and
> instead just send a nntp reply to display:
>
> The Message Server rejected the message:
> 441 Posting failed (Exceeds Spam Score)
>
> Once I get this working properly with newsreader posts, and
> spoolnews.php, we can then reconsider whether to move them or just
> drop them.

Maybe move them to a local spam group and flag the spam group
(spam.local / local.spam, etc.) so it does not sync with other servers?

That way you can see what the baddies are up to and use the information
accordingly or feed some of the messages to the spamd learner.

Thanks for all the work on this.

On Thu, 21 Dec 2023 10:13:29 -0600, Sugar Bug wrote:

> On Thu, 21 Dec 2023 16:00:18 -0000 (UTC)
> Retro Guy <retroguy@i2pn2.org> wrote:
>
>> On Thu, 21 Dec 2023 08:00:22 -0600, SugarBug wrote:
>>
>> > On Thu, 21 Dec 2023 07:32:45 -0600 SugarBug <3883@sugar.bug> wrote:
>> >
>> >> On Thu, 21 Dec 2023 12:54:42 +0000 Retro Guy <retroguy@novabbs.org>
>> >> wrote:
>> >>
>> >> <snip>
>> >>
>> >> > > Still no incoming spam is flagged or removed. The blacklisted
>> >> > > addresses have no effect and spamc is not triggered.
>> >> >
>> >> > Incoming messages are NOT checked for spam. Only locally posted
>> >> > messages. It took me a while to realize what you're trying to
>> >> > accomplish, but now I think I see. I thought you were trying to
>> >> > filter (spam check) posts from your own site (which should work).
>> >>
>> >> Posting locally only half works. I posted from a blacklisted
>> >> address. The message is not in the spool, but its entry shows up in
>> >> the web portal:
>> >>
>> >> https://rocksolid.sybershock.com/rocksolid/thread.php?group=spam
>> >>
>> >> The message was not moved to group 'spam'. I simply created a group
>> >> named 'spam' and posted from reader to that group. rocksolid.spam is
>> >> still configured as the spam group in rslight.inc.php.
>> >>
>> >> The subject line also shows up in the desktop news client via NNTP.
>> >> But the message is not accessible via NNTP.
>> >>
>> >> So the subject of spam messages still pollutes the space on this
>> >> install.
>> >>
>> >> > Adding incoming checking shouldn't be hard to do, it's already in
>> >> > post.inc.php. I'm willing to do that if you like.
>> >>
>> >> If I post a second message from the same address, then the news
>> >> reader says there is a unspecified network error. It seems that
>> >> rslight catches it and then drops the connection. There is no
>> >> feedback in the network log, just a connection drop.
>> >
>> > I can confirm this behavior replicates when posting from a newsreader
>> > via NNTP.
>> >
>> > https://rocksolid.sybershock.com/rocksolid/thread.php?group=spam.spam
>> >
>> > If I post from a blacklisted address the subject shows up in the web
>> > portal and the NNTP news reader. The second post to that group from
>> > the same address does not show up. Instead the network connection
>> > drops, and a blank numbered message file is placed in the article
>> > spool.
>> >
>> > None of the blocked test messages appear to be moved to
>> > rocksolid.spam.
>> >
>> > If you click on the links you'll see what I mean:
>> >
>> > https://rocksolid.sybershock.com/rocksolid/index.php
>> >
>> > I haven't tested posting from the web portal because user creation is
>> > broken and I'm troubleshooting that too.
>>
>> I've temporarily removed moving the message to rocksolid spam, and
>> instead just send a nntp reply to display:
>>
>> The Message Server rejected the message:
>> 441 Posting failed (Exceeds Spam Score)
>>
>> Once I get this working properly with newsreader posts, and
>> spoolnews.php, we can then reconsider whether to move them or just drop
>> them.
>
> Maybe move them to a local spam group and flag the spam group
> (spam.local / local.spam, etc.) so it does not sync with other servers?
>
> That way you can see what the baddies are up to and use the information
> accordingly or feed some of the messages to the spamd learner.

Exactly. We want the messages for testing, finding false positives,
whatever. I just need to get the actual checking working properly first.

So far, so good. Both the web interface and newsreader are now rejecting
in exactly the same way. Only issue is it seems to list a time when the
post was attempted in the web interface. Not sure why that is atm...