In the /sbbs/data/sbbsecho.log file, we have statistics for the numbers of messages imported and exported from the various FTN echoes.

Are the same types of stats reported anywhere or accessible in some way for QWK network conferences, to know imported and exported message counts for DOVE-Net?

I can see them reported in the Events tab, and similarly reported in the /sbbs/data/events.log file (if I'm logging events to disk), but this file is apparently exclusively locked by Synchronet while it's running.

Asking because I'm working on a small script that reports the imported and exported totals by month for all networks configured on the system, and it would be nice to include DOVE-Net.

|15 þ ù ú codefenix ú ù ú ConstructiveChaos BBS ú ú ù þ þ
|08 þ þ ù (https/telnet/ssh)://conchaos.synchro.net ú ù þ
|07

...It is only the shallow people who do not judge by appearances.
---
þ Synchronet þ -=[ ConstructiveChaos BBS | conchaos.synchro.net ]=-

Re: Best way to collect DOVE-Net/QWK stats
By: Codefenix to All on Thu Feb 27 2025 08:14 am

In the /sbbs/data/sbbsecho.log file, we have statistics for the numbers of messages imported and exported from the various FTN echoes.

Are the same types of stats reported anywhere or accessible in some way for QWK network conferences, to know imported and exported message counts for DOVE-Net?

Not really. I could add something (another log file or stats file likely). Are you looking for total messages imported in a single call-out/QWK packet or per sub/conference, per day or ... ?
--
digital man (rob)

Synchronet "Real Fact" #12:
Synchronet was the first BBS software to ship with built-in RIPscrip support Norco, CA WX: 82.8øF, 9.0% humidity, 1 mph W wind, 0.00 inches rain/24hrs
---
þ Synchronet þ Vertrauen þ Home of Synchronet þ [vert/cvs/bbs].synchro.net

Re: Best way to collect DOVE-Net/QWK stats
By: Digital Man to Codefenix on Thu Feb 27 2025 12:26 pm

Not really. I could add something (another log file or stats file likely). Are you looking for total messages imported in a single call-out/QWK packet or per sub/conference, per day or ... ?

Something that matches the format of the sbbsecho.log would make sense, if that's possible: per poll (call-out), per sub. Using that, I could tally up the counts and report totals, like I do currently with sbbsecho.log.

|15 þ ù ú codefenix ú ù ú ConstructiveChaos BBS ú ú ù þ þ
|08 þ þ ù (https/telnet/ssh)://conchaos.synchro.net ú ù þ
|07

...There's nothing moister. Than an oyster!
---
þ Synchronet þ -=[ ConstructiveChaos BBS | conchaos.synchro.net ]=-

Re: Best way to collect DOVE-Net/QWK stats
By: Codefenix to Digital Man on Thu Feb 27 2025 04:31 pm

Re: Best way to collect DOVE-Net/QWK stats
By: Digital Man to Codefenix on Thu Feb 27 2025 12:26 pm

Not really. I could add something (another log file or stats file likely). Are you looking for total messages imported in a single call-out/QWK packet or per sub/conference, per day or ... ?

Something that matches the format of the sbbsecho.log would make sense, if that's possible: per poll (call-out), per sub.

I don't think sbbsecho.log file provides stats per sub, does it?

Would this detail (per call-out) be enough?
"Imported %lu QWK messages in %lu seconds (%lu msgs/sec)"

Using that, I could tally up
the counts and report totals, like I do currently with sbbsecho.log.

Have you seen data/echostats.ini? The idea was that file is faster and easier to parse than sbbsecho.log and never purged/rotated. I don't currently have any equivalent for QWK networking.
--
digital man (rob)

Sling Blade quote #24:
Karl: Kaiser blade. I hit my mother upside the head with it. Mmm... Killed her. Norco, CA WX: 83.0øF, 7.0% humidity, 7 mph WSW wind, 0.00 inches rain/24hrs
---
þ Synchronet þ Vertrauen þ Home of Synchronet þ [vert/cvs/bbs].synchro.net

Re: Best way to collect DOVE-Net/QWK stats
By: Digital Man to Codefenix on Thu Feb 27 2025 02:54 pm

I don't think sbbsecho.log file provides stats per sub, does it?

Sure does:

2025-02-27 14:49:41 Imported: 1 msgs fsxnet_fsx_gen <- FSX_GEN
2025-02-27 14:49:41 Imported: 1 msgs fsxnet_fsx_ads <- FSX_ADS
2025-02-27 14:49:41 Imported: 2 msgs fsxnet_fsx_dat <- FSX_DAT
2025-02-27 14:49:41 Imported: 1 msgs fsxnet_fsxretro <- FSX_RETRO
2025-02-27 14:49:41 Imported: 5 msgs total

Would this detail (per call-out) be enough? "Imported %lu QWK messages in %lu seconds (%lu msgs/sec)"

If it has a date/time stamp in front of the word "Imported" then I think that's spot-on.

Have you seen data/echostats.ini? The idea was that file is faster and easier to parse than sbbsecho.log and never purged/rotated. I don't currently have any equivalent for QWK networking.

That seems great for lifetime stats as of the last import/export, however one wouldn't have visibility to how the stats break by month (i.e.: how many imported/exported in Oct, Nov, Dec, etc). That's where the timestamps in the sbbsecho.log come in handy.

Basically trying to recreate functionality of an old FidoNet/FTN utility by Philip Brown, which xbit says used to work prior to an apparent timestamp format change in the sbbsecho.log file. Also figured why not try to include the equivalent DOVE-Net stats while at it, because why not, it's a network.

|15 þ ù ú codefenix ú ù ú ConstructiveChaos BBS ú ú ù þ þ
|08 þ þ ù (https/telnet/ssh)://conchaos.synchro.net ú ù þ
|07

...There's never a good time to score an own goal.
---
þ Synchronet þ -=[ ConstructiveChaos BBS | conchaos.synchro.net ]=-

Re: Best way to collect DOVE-Net/QWK stats
By: Codefenix to Digital Man on Fri Feb 28 2025 10:27 am

Re: Best way to collect DOVE-Net/QWK stats
By: Digital Man to Codefenix on Thu Feb 27 2025 02:54 pm

I don't think sbbsecho.log file provides stats per sub, does it?

Sure does:

2025-02-27 14:49:41 Imported: 1 msgs fsxnet_fsx_gen <- FSX_GEN
2025-02-27 14:49:41 Imported: 1 msgs fsxnet_fsx_ads <- FSX_ADS
2025-02-27 14:49:41 Imported: 2 msgs fsxnet_fsx_dat <- FSX_DAT
2025-02-27 14:49:41 Imported: 1 msgs fsxnet_fsxretro <- FSX_RETRO
2025-02-27 14:49:41 Imported: 5 msgs total

Ah, I forgot it logged that. Do/would you make use of that for statistics?

Would this detail (per call-out) be enough? "Imported %lu QWK messages in %lu seconds (%lu msgs/sec)"

If it has a date/time stamp in front of the word "Imported" then I think that's spot-on.

Yeah, with a date/time stamp. But it'd be *totals* per packet, not per sub. Is that okay? Per sub is possible, but more work, but I'd only want to add that if you were going to use the data.

Have you seen data/echostats.ini? The idea was that file is faster and easier to parse than sbbsecho.log and never purged/rotated. I don't currently have any equivalent for QWK networking.

That seems great for lifetime stats as of the last import/export, however one wouldn't have visibility to how the stats break by month (i.e.: how many imported/exported in Oct, Nov, Dec, etc). That's where the timestamps in the sbbsecho.log come in handy.

Ah.

Basically trying to recreate functionality of an old FidoNet/FTN utility by Philip Brown, which xbit says used to work prior to an apparent timestamp format change in the sbbsecho.log file. Also figured why not try to include the equivalent DOVE-Net stats while at it, because why not, it's a network.

I see. The sbbsecho.log timestamp format is configurable (e.g. for backwards compatibility with sbbsecho v2 log analysis tools), but a recreation would be cool.

I'll see what I can cook-up for QWK networking. A separate file per hub you think or a single file for all hubs?
--
digital man (rob)

Rush quote #71:
He's not concerned with yesterday, he knows constant change is here today Norco, CA WX: 60.0øF, 72.0% humidity, 5 mph WNW wind, 0.00 inches rain/24hrs ---
þ Synchronet þ Vertrauen þ Home of Synchronet þ [vert/cvs/bbs].synchro.net

Re: Best way to collect DOVE-Net/QWK stats
By: Digital Man to Codefenix on Fri Feb 28 2025 05:20 pm

Ah, I forgot it logged that. Do/would you make use of that for statistics?

Yeah, currently the script recognizes lines matching the Imported/Exported per echo, and parses the number Imported/Exported, and (for now) just reports the totals per net per month. Was considering adding options to break it down by echo (not a priority though), and limit it to the last X months rather than all available data in the sbbsecho.log file (in case the file is huge).

Yeah, with a date/time stamp. But it'd be *totals* per packet, not per sub. Is that okay? Per sub is possible, but more work, but I'd only want to add that if you were going to use the data.

I don't feel breaking it down by sub is important if it's going to mean more work. Totals per packet would be great.

I'll see what I can cook-up for QWK networking. A separate file per hub you think or a single file for all hubs? --

A single file for all configured QWK hubs would be perfect, but whichever is easier or makes more sense from a coding perspective would be great too.

Thanks for taking the time to talk shop and consider!

|15 þ ù ú codefenix ú ù ú ConstructiveChaos BBS ú ú ù þ þ
|08 þ þ ù (https/telnet/ssh)://conchaos.synchro.net ú ù þ
|07

...RCs come and RCs go, but a good NC lasts forever!
---
þ Synchronet þ -=[ ConstructiveChaos BBS | conchaos.synchro.net ]=-

Re: Best way to collect DOVE-Net/QWK stats
By: Codefenix to Digital Man on Sat Mar 01 2025 10:59 am

Re: Best way to collect DOVE-Net/QWK stats
By: Digital Man to Codefenix on Fri Feb 28 2025 05:20 pm

Ah, I forgot it logged that. Do/would you make use of that for statistics?

Yeah, currently the script recognizes lines matching the Imported/Exported per echo, and parses the number Imported/Exported, and (for now) just reports the totals per net per month. Was considering adding options to break it down by echo (not a priority though), and limit it to the last X months rather than all available data in the sbbsecho.log file (in case the file is huge).

Yeah, with a date/time stamp. But it'd be *totals* per packet, not per sub. Is that okay? Per sub is possible, but more work, but I'd only want to add that if you were going to use the data.

I don't feel breaking it down by sub is important if it's going to mean more work. Totals per packet would be great.

I'll see what I can cook-up for QWK networking. A separate file per hub you think or a single file for all hubs? --

A single file for all configured QWK hubs would be perfect, but whichever is easier or makes more sense from a coding perspective would be great too.

Thanks for taking the time to talk shop and consider!

As it turns out, the easier (and think I better change) was just to make the data/events.log file non-locked and create/write-to it for all platforms (not just Windows sbbsctrl.exe). So the format should be the same as what you see now data/events.log (except I've added the QWKnet hub-id to the total line).

I've wanted to 'tail -f' or grep through the file before while sbbsctrl was running and been stymied, and now you'll be able to. And having a single answer to "where's my event log"? for all installs will be nice.

If you can use further enhancement to the output content/format (e.g. the per sub import stats), let me know.
--
digital man (rob)

Breaking Bad quote #40:
This Bogdan character... he wrestled you into submission with his eyebrows. Norco, CA WX: 60.4øF, 69.0% humidity, 6 mph W wind, 0.00 inches rain/24hrs
---
þ Synchronet þ Vertrauen þ Home of Synchronet þ [vert/cvs/bbs].synchro.net

Re: Best way to collect DOVE-Net/QWK stats
By: Digital Man to Codefenix on Sat Mar 01 2025 02:40 pm

As it turns out, the easier (and think I better change) was just to make the data/events.log file non-locked and create/write-to it for all platforms (not just Windows sbbsctrl.exe). So the format should be the same as what you see now data/events.log (except I've added the QWKnet hub-id to the total line).

Dynamite! Cool, I'll be on the lookout for this change and try it out when I can.

If you can use further enhancement to the output content/format (e.g. the per sub import stats), let me know. --

Appreciate it lots.

|15 þ ù ú codefenix ú ù ú ConstructiveChaos BBS ú ú ù þ þ
|08 þ þ ù (https/telnet/ssh)://conchaos.synchro.net ú ù þ
|07

...A communist is one who has nothing and wishes to share it with the world. ---
þ Synchronet þ -=[ ConstructiveChaos BBS | conchaos.synchro.net ]=-