Commit Graph

185 Commits

Author SHA1 Message Date
7e0178d183 Fix routed netmails being packed for the hub, not the destination. Added some logging for idle netmails/emails 2024-05-26 20:55:39 +10:00
f8cb6ccc37 Automatically mark idle nodes HOLD/DOWN/DE-LIST. Automatically validate presented addresses.
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 38s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m43s
Create Docker Image / Final Docker Image Manifest (push) Successful in 11s
2024-05-25 22:31:42 +10:00
391e9e1e39 Fix TicProcess, save() returns a bool, not the object
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 37s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m45s
Create Docker Image / Final Docker Image Manifest (push) Successful in 10s
2024-05-25 11:09:34 +10:00
3555e5a91c Dont cache the mail:send query
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 39s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m42s
Create Docker Image / Final Docker Image Manifest (push) Successful in 10s
2024-05-25 10:33:35 +10:00
b398163cfd We need to use EncodeUTF our mail objects while passing them to the queue
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 41s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m42s
Create Docker Image / Final Docker Image Manifest (push) Successful in 10s
2024-05-22 21:37:58 +10:00
58dc090c83 Use packets domain for packet validation, not remote sytems address 2024-05-22 09:21:59 +10:00
18f5354d0c Mail validation errors is now an object, and must be tested with ->count() 2024-05-22 09:21:59 +10:00
752462d20f Update job:list, and change "subject" to "jobname" 2024-05-22 09:21:59 +10:00
ab2e288f06 More complete rework of packet parsing and packet generation with f279d85 - and testing passes 2024-05-22 09:21:59 +10:00
f279d85b08 More complete rework of packet parsing and packet generation with 29710c 2024-05-19 23:28:45 +10:00
29710c37c2 Complete rework of packet parsing and packet generation 2024-05-17 22:10:54 +10:00
6216ada5e5 Fix recording of netmails, when they contain taglines and origin lines 2024-05-13 17:50:24 +10:00
f912e81ee6 Change where processed packets are placed, if fido.packet_keep is true
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 54s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m54s
Create Docker Image / Final Docker Image Manifest (push) Successful in 10s
2024-05-12 21:56:46 +10:00
556b95c7c1 Fix when dispatching packets, and our address object has many relations already loaded, causing memory exhaustion due to recursion 2024-05-12 21:56:46 +10:00
23159d19d5 Rework address roles, making Address::role optional, rework determining uplink/downlinks/parent/children 2024-05-09 21:22:30 +10:00
7b225d8fc0 Attempt to catch dns query failures
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 36s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m37s
Create Docker Image / Final Docker Image Manifest (push) Successful in 11s
2024-04-16 22:01:09 +09:30
a2ff2df9f3 Move security evaluations for File/Echoareas back to model 2024-04-16 21:28:35 +09:30
cb09016539 Partially revert #9cf0f1e so that we create jobs by Address ID, not System ID 2024-01-10 16:58:35 +11:00
9376c6de11 We should check for subscription before checking for permissions 2023-12-20 11:20:48 +11:00
13e51724c0 Further enhancement with #9063a2a - to ensure our message addressing and content picks the right address 2023-12-18 20:43:21 +11:00
7b9ab388d8 Optimise our use of items waiting and queries used. We are now using a single consistent query for each resource. 2023-12-18 20:43:21 +11:00
0526500ff0 Integrate Mailer::class into System_Log::class, removed Zmodem Server/Client 2023-12-10 20:41:37 +11:00
5a74386f5a Optimisations to uncollected Items, which fix mail:send, which was only being triggered for mail unsent from yesterday 2023-12-08 15:16:49 +11:00
9cf0f1e2f4 Changed AddressPoll unique ID to be system_id, setup for memcached for all micrsoservices 2023-11-27 16:00:02 +11:00
27a3e3e24e Use ObjectIssetFix Trait instead of defining __isset() directly 2023-11-27 15:56:28 +11:00
1ac3583479 Implemented system heartbeat, to poll systems regularly that we havent heard from 2023-11-26 14:59:05 +11:00
6e7e09ab50 Minor changes to mail:send and job:list rendering 2023-11-26 11:32:21 +11:00
2b2482ba71 Rework crash polling, using optimised scope queries 2023-11-25 21:52:05 +11:00
6abf10ab0b TIC and PKT passwords are case insensitive, so convert them to uppercase when we are using them 2023-11-25 09:47:58 +11:00
5f11f81be3 Fixes for TICs for nodelists 2023-11-22 16:41:14 +11:00
9fd8264c3f Rework TIC processing and added test cases 2023-11-22 15:58:00 +11:00
f639e3ffab New attempt to making sure echomails have origin and senders path/seenby details (rework of #45d7823) 2023-11-22 13:59:19 +11:00
45d78233b2 Disabling adding to path - its adding to the end of the path which is not correct 2023-11-22 10:40:28 +11:00
4a870b6587 Improvements to echomail path handling, ensuring sender and pktsrc are in the path 2023-11-22 10:40:28 +11:00
df5cc8c2d4 TIC processing fixes, was unable to find TIC file 2023-10-07 21:09:00 +11:00
32c0088339 Rework nodelist import and ignoring addresses that we manage 2023-10-06 22:52:03 +11:00
b854cf9fe0 Better catch TIC file exceptions, enable moving TIC files if fido.packet_keep is defined 2023-10-04 22:22:01 +11:00
d11a2a5b8d Update nodelist import to exclude systems managed by us 2023-09-23 23:15:42 +10:00
ff04de52b5 Rework TIC processing to use Storage::disk(). Implemented handling of replaces and files that already exist 2023-09-23 22:40:17 +10:00
2ae24b9955 Move fido configuation items into fido namespace. If keeping packets move them into a date aligned subdir 2023-09-22 15:35:08 +10:00
612efda945 Process packet seenby/path/via lines when saving echomail/netmail 2023-09-20 21:37:18 +10:00
5e67be5ba1 Alert message for echomails with security violations is using wrong address 2023-09-19 11:29:08 +10:00
cc04ddd7b3 More work to ensure messages from a node are valid for the domain, and fix domain flatten to check for zone if one is supplied 2023-09-17 15:54:47 +10:00
708d9a9f67 More work to decommission rogue_path 2023-09-16 21:39:34 +10:00
a991db788e For AddressPoll, force using our file cache - seems sometimes the key doesnt release with memcached 2023-09-15 14:28:07 +10:00
096e37ef35 Removed packet cache, it wasnt used and not needed since we can queue large packets. Renamed to for consistent variable when using Packet::process() 2023-09-15 08:14:27 +10:00
2f878b6e64 Added filearea import 2023-09-14 23:42:25 +10:00
ec5c28a03e Added ignore_crc option to nodelist import 2023-09-14 23:06:02 +10:00
ff8c370d86 Move packet processing into a job 2023-09-13 20:58:22 +10:00
67c1be209d Logging changes when processing TIC files 2023-09-09 00:10:45 +10:00
6d199345ac Enable nodelist import test mode 2023-09-09 00:10:45 +10:00
6498e364fb More TIC processing fixes 2023-09-08 21:04:24 +10:00
63a9c06fb0 Fix for bug introduced in previous commit, where tic files where queued without the address prefix 2023-09-07 12:25:44 +10:00
3cd0deada0 Added subject so that it works with job:list 2023-09-05 22:46:49 +12:00
a5784de9a8 Put TIC processing on it's own queue 2023-08-15 12:25:54 +10:00
74a56d1e17 Now correctly showing packet receive time, and sending Notifications based on the packet address, not the node address 2023-08-06 13:43:10 +10:00
c59f8ee0ed Improvements to Echoarea Import, area names are now uppercase and descriptions use ucfirst() 2023-08-03 22:11:59 +10:00
f281575b15 Enable netmail forwarding for users that receive messages directed at clrghouz 2023-08-03 17:31:42 +10:00
fb2471a05b Fix our echomail sender is not the message originator 2023-07-29 17:48:09 +10:00
cd140971e2 Implemented echoarea/filearea security 2023-07-29 13:17:36 +10:00
f1ccca25ea Change public to show on echo/file areas to enable limiting whats shown in the activity graph 2023-07-28 13:22:39 +10:00
e97a106178 Add exception class when scheduled tasks fail and exception hasnt been caught 2023-07-27 21:09:57 +10:00
4e44e2e266 Added system polling 2023-07-26 19:44:07 +10:00
17fe7e910d Multiple enhancements to interactive messages, moved messages to Notifications, send netmail back when invalid packet password 2023-07-23 20:21:02 +10:00
02a3963a12 Fix netmail flags for netmails originating here 2023-07-20 23:12:26 +10:00
8d9bde9692 Fix messages to points, and fix netmail coming from systems which dont include an Origin line 2023-07-20 22:16:38 +10:00
c1ec4eff36 Optimised our sending and receiving of items 2023-07-18 23:00:13 +10:00
a3302b4012 Complete of logging received and sent packet names, and display them in the web ui for each node 2023-07-15 22:10:05 +10:00
61ab0614b6 Correctly storing netmail flags (intransit, local, recv) with senders ID and packet name 2023-07-15 10:46:19 +10:00
52055c5217 Update nodelist parsing now that we have mailer_system 2023-07-09 22:03:15 +10:00
faeec61aeb Fix for limiting AKAs, show parent PID that forked child, other minor fixes 2023-07-08 18:00:23 +10:00
ccdce6bb62 Move mailer details into a separate table 2023-07-07 23:59:04 +10:00
ad36da0bb1 Code cleanup, no functional changes 2023-07-04 11:33:28 +10:00
b1b86ca04a Implemented file sending during BINKP and EMSI sessions 2023-06-22 22:13:47 +10:00
58341db0fb Show netmails to admins, record netmail path in the DB 2023-06-18 23:33:26 +10:00
Deon George
04be81852a Save robot processed messages 2023-01-25 16:35:58 +11:00
Deon George
3dc18a3f1f Change default internal caching to off, and added test to make sure things are cached if on. More debugging with packet name for netmails 2023-01-25 16:26:10 +11:00
Deon George
63e3397aee Add packet name for incoming netmails, dont send back messages to sender for areafix messages 2023-01-24 23:16:11 +11:00
Deon George
c1ab14f2e6 Fix echoarea display with the oldest message 2023-01-01 14:33:52 +11:00
Deon George
d825f71a15 Skip messages that originate from a node in a zone we dont know. 2023-01-01 13:53:51 +11:00
Deon George
06f814395c More debugging to know more about failed echomail parsing because of no zone. 2023-01-01 13:35:56 +11:00
Deon George
91fc61e170 Fix nodelist import, when parsing regions 2022-12-19 23:34:42 +11:00
Deon George
702a4e4f37 Attempt to catch DB errors and abort the transaction, so that the queue continues to run. 2022-11-13 15:17:22 +11:00
Deon George
e7ebaa85cb Fix nodelist crc's that have 8 chars 2022-11-13 15:17:22 +11:00
Deon George
b158bb5a7d Add domain to TIC processing, for nodelists that dont have a domain 2022-11-13 15:17:22 +11:00
Deon George
9f0fa242e6 When deleting an Address change active to FALSE 2022-11-13 15:17:22 +11:00
Deon George
6284016400 Auto create FTN address for intransit netmail when the destination is not known. 2022-11-06 14:40:03 +11:00
Deon George
531654724a Enable specifying a domain for nodelist import, and throwing exceptions when errors occur 2022-11-05 15:17:11 +11:00
Deon George
9721db185b Ensure Echomail is initialised correctly 2022-11-05 10:17:14 +11:00
Deon George
b45e2c6dd8 Support processing nodelists from file repository and assume nodelists are zip fiels 2022-11-05 10:17:14 +11:00
Deon George
2790381a30 Determine if an inbound file is a nodelist 2022-11-05 10:17:14 +11:00
Deon George
34f289953d Implementation fixes for TIC processing 2022-11-05 10:17:14 +11:00
Deon George
7571a2cd7d Enable moving inbound files to s3 and logging in DB 2022-11-04 17:30:18 +11:00
Deon George
029a8a9d73 Added file areas and TIC processing 2022-11-02 22:01:45 +11:00
Deon George
da85e85774 Cast empty Collections to null, Cast strings to zstd compressed strings, add msg_src to echomails processed, fix duplicate seenbys 2022-11-02 21:20:43 +11:00
Deon George
daba4a78d3 Fix echoarea name is converted to UC, add netmail VIA lines for outgoing netmail 2022-02-17 23:55:37 +11:00
Deon George
f142284a2b Understand some gated messages, that are gated from a different zone 2022-02-12 11:35:24 +11:00
Deon George
d660d5a6df Move DomainController::NODE* to Address::NODE*, make role mandatory in the database, change logic so that mail generated by the host comes from a node address. 2022-02-03 13:23:58 +11:00
Deon George
efa7195633 Add DBID back to messages, add path/seen-by to generated messages, other minor cosmetic fixes 2022-01-22 23:08:46 +11:00
Deon George
6f1d47a6ab Fixes to message processing, now that we are using cockroachdb 2022-01-15 17:11:51 +11:00