← SSLOCSD

Clients/SSLOCSD/slack/2026/01/2026-01-02_south-county.md

slack
Source
2
Chunks
4
Entities
Doc
Type

Content

# #south-county — 2026-01-02 **13:13 [Kevin](https://slack.com/archives/C08G4KZG7D5/p1767388407996269):** @Mason Radke I see you are working on the issue Mike brought to our attention via email. **13:13 [Kevin](https://slack.com/archives/C08G4KZG7D5/p1767388439302939):** for the record, Please put a summary in this channel when you are through **13:14 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767388457424389):** Copy **13:15 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767388543895409):** Would a copy of the summary text in the email I sent work? **13:16 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767388560922639):** Or wait until we make the alarm changes **13:16 [Kevin](https://slack.com/archives/C08G4KZG7D5/p1767388593821509):** I'd like the full snapshot of the work done, so wait until you make the changes. **13:16 [Kevin](https://slack.com/archives/C08G4KZG7D5/p1767388601328879):** Remember, this is the PLC with maxed out memory **13:16 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767388613209649):** Copy **13:17 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767388635523689):** Pings timing out indicate something outside of PLC **13:17 [Kevin](https://slack.com/archives/C08G4KZG7D5/p1767388671438389):** Intermittent right? **13:18 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767388695100629):** Yes **13:18 [Kevin](https://slack.com/archives/C08G4KZG7D5/p1767388720301609):** do you have a way to make the DI's hold on comm loss? **13:21 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767388878154599):** Not from the card. I looked **13:21 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767388887508869):** But a timer on the bit swapping will help **13:21 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767388900542719):** If a drive is actually faulted it will hold longer than five or 10 seconds. Even though the dropouts are only very short. **13:21 [Kevin](https://slack.com/archives/C08G4KZG7D5/p1767388910007719):** good plan **13:21 [Kevin](https://slack.com/archives/C08G4KZG7D5/p1767388917222769):** thanks for jumping on this **15:54 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767398059469969):** ![[F0A6NEDRS12_image.png]] **15:54 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767398061593479):** hmmm **15:54 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767398076597499):** it looks like its trying. **15:54 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767398098298039):** maybe a win911 reboot is in order **15:55 [Kevin](https://slack.com/archives/C08G4KZG7D5/p1767398122521829):** give it a shot. I wonder if the grandstream needs a reboot as well **15:55 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767398127866109):** rebooting **15:57 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767398256175029):** is there anyway to reboot the grandstream remotely if we need to? **15:58 [Kevin](https://slack.com/archives/C08G4KZG7D5/p1767398294294519):** I think it has a webserver **15:59 [Kevin](https://slack.com/archives/C08G4KZG7D5/p1767398390850439):** 192.168.1.14 **16:00 [Kevin](https://slack.com/archives/C08G4KZG7D5/p1767398418081579):** that's the last IP I show **16:03 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767398591196599):** ![[F0A6GRXAH1C_image.png]] **16:03 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767398592156559):** i think the issue is with the grandstream **16:03 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767398596884909):** it looks like a call is stuck **16:03 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767398608536659):** 1 day 9 hour call **16:03 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767398614990359):** let me look for a reboot **16:04 [Kevin](https://slack.com/archives/C08G4KZG7D5/p1767398680336179):** I can have Chris power cycle it **16:04 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767398687231869):** i found a reboot button **16:04 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767398689483679):** lets see how it goew **16:06 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767398802044609):** i think that should fix it **16:06 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767398812147449):** i need to put in the chemical pump alarm delays **16:06 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767398817133409):** or its going to call them like crazy **16:07 [Kevin](https://slack.com/archives/C08G4KZG7D5/p1767398838514139):** yes they were hoping to have that toda **16:07 [Kevin](https://slack.com/archives/C08G4KZG7D5/p1767398841318459):** today **16:07 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767398853128779):** its a bandaid **16:07 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767398869895019):** but it will buy us time **16:08 [Kevin](https://slack.com/archives/C08G4KZG7D5/p1767398927994119):** did the test alarm go through? **16:09 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767398950718759):** it looks like it dialed.. and then ended **16:09 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767398955014359):** looking for acknowledgment **16:09 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767398957303529):** its lookign better **16:11 [Kevin](https://slack.com/archives/C08G4KZG7D5/p1767399064740489):** Chris says he got two calls. It is working **16:11 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767399070388219):** good **16:11 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767399075584489):** working on chemical skid now **16:11 [Kevin](https://slack.com/archives/C08G4KZG7D5/p1767399080614989):** thank you **16:18 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767399539534649):** ok **16:19 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767399548524939):** 30 second delay before drive fault will be triggered **16:19 [Kevin](https://slack.com/archives/C08G4KZG7D5/p1767399569520289):** excellent **16:29 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767400182720169):** ``` Troubleshot an issue with WIN-911 not dialing out on active alarms. Identified a hung call condition on the Grandstream dialer device, which appeared to be stuck in an active call state for approximately 33 hours. Rebooted the Grandstream device and verified that alarm callouts resumed normal dialing behavior. Implemented a 30-second delay on the normally-closed drive fault alarm input to prevent brief communication dropouts from generating nuisance alarms and unnecessary callouts. ``` **16:30 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767400258669709):** ``` Investigated reports of nuisance drive fault alarms on Pumps P-5010, P-5011, P-5030, and P-5031. Verified that no actual drive faults were present and confirmed that the drives continued to operate normally in local control. Traced the alarms to brief communication interruptions between the PLC and the remote I/O rack serving the chemical tank skid. Confirmed intermittent network timeouts via continuous ping testing and observed corresponding remote I/O communication indicators in the PLC. Reviewed PLC logic and identified that the drive fault signals are configured as normally-closed inputs, causing momentary communication dropouts to be interpreted as fault conditions. Reviewed WIN-911 alarm logs and confirmed that these transient events were being registered and triggering callout workflows. Evaluated network port diagnostics and I/O module configuration, confirming no physical Ethernet errors. Documented findings and identified recommended mitigation strategies, including communication health gating and alarm debounce logic, to prevent nuisance alarms. ``` **16:32 [Mason Radke](https://slack.com/archives/C08G4KZG7D5/p1767400345309109):** do you want to check in with them and update them? or do you want me to

Extracted Entities

TypeKeyValueConfidenceEvidence
server Grandstream device IP 192.168.1.14 90% 192.168.1.14 that's the last IP I show
site South County chemical tank skid chemical tank skid 80% communication interruptions between the PLC and the remote I/O rack serving the chemical tank skid
system WIN-911 WIN-911 95% Troubleshot an issue with WIN-911 not dialing out on active alarms
task Chemical pump alarm delay implementation Implement 30-second delay on drive fault alarm input 90% 30 second delay before drive fault will be triggered
File: Clients/SSLOCSD/slack/2026/01/2026-01-02_south-county.md
Updated: 2026-02-25 03:16:20.943145