Odd Chirpstack behavior

I have Chirpstack OS running Chirpstack Version: v4.10.2. It’s running on a Raspberry PI 4B with a RAK SX1303 LoRa Concentratior.

Randomly a few days back the UI stopped reporting received packets, even though in the events page I could see them coming in. I also am still receiving MQTT published topics on my home automation system.

I also noticed that my downlinks are no longer sending and just queuing up.

I have tried restarting the Raspberry PI and no change. Any ideas?

Some system logs:

Thu Dec 19 04:22:06 2024 user.info chirpstack-concentratord-sx1302[2927]: Frame received, uplink_id: 95780588, count_us: 1854306812, freq: 918200000, bw: 125000, mod: LoRa, dr: SF12, ftime_received: false, ftime_ns: 0
Thu Dec 19 04:22:06 2024 user.info chirpstack-mqtt-forwarder[2375]: Received uplink frame, uplink_id: 95780588
Thu Dec 19 04:22:06 2024 user.info chirpstack-mqtt-forwarder[2375]: Sending uplink event, uplink_id: 95780588, topic: au915_1/gateway/0016c001ff1dfbe5/event/up
Thu Dec 19 04:22:13 2024 user.info chirpstack-concentratord-sx1302[2927]: Publishing stats event, rx_received: 1, rx_received_ok: 1, tx_received: 0, tx_emitted: 0
Thu Dec 19 04:22:13 2024 user.info chirpstack-mqtt-forwarder[2375]: Received gateway stats
Thu Dec 19 04:22:13 2024 user.info chirpstack-mqtt-forwarder[2375]: Sending gateway stats event, topic: au915_1/gateway/0016c001ff1dfbe5/event/stats
Thu Dec 19 04:22:30 2024 user.info chirpstack-concentratord-sx1302[2927]: Enqueueing packet on pps, downlink_id: 3690189464, counter_us: 1882551611, current_counter_us: 1877880807
Thu Dec 19 04:22:30 2024 user.info chirpstack-concentratord-sx1302[2927]: Beacon enqueued, beacon_time_gps_epoch: 1420461568s
Thu Dec 19 04:22:34 2024 user.info chirpstack-concentratord-sx1302[2927]: Scheduled packet for TX, downlink_id: 3690189464, count_us: 1882551611, freq: 925700000, bw: 500000, mod: LoRa, dr: SF12
Thu Dec 19 04:22:40 2024 user.info chirpstack-concentratord-sx1302[2927]: Frame received, uplink_id: 2306992927, count_us: 1887852645, freq: 918000000, bw: 125000, mod: LoRa, dr: SF12, ftime_received: false, ftime_ns: 0
Thu Dec 19 04:22:40 2024 user.info chirpstack-mqtt-forwarder[2375]: Received uplink frame, uplink_id: 2306992927
Thu Dec 19 04:22:40 2024 user.info chirpstack-mqtt-forwarder[2375]: Sending uplink event, uplink_id: 2306992927, topic: au915_1/gateway/0016c001ff1dfbe5/event/up
Thu Dec 19 04:22:43 2024 user.info chirpstack-concentratord-sx1302[2927]: Publishing stats event, rx_received: 1, rx_received_ok: 1, tx_received: 0, tx_emitted: 1
Thu Dec 19 04:22:43 2024 user.info chirpstack-mqtt-forwarder[2375]: Received gateway stats
Thu Dec 19 04:22:43 2024 user.info chirpstack-mqtt-forwarder[2375]: Sending gateway stats event, topic: au915_1/gateway/0016c001ff1dfbe5/event/stats
Thu Dec 19 04:22:50 2024 user.info chirpstack-concentratord-sx1302[2927]: Frame received, uplink_id: 867024431, count_us: 1897904704, freq: 918200000, bw: 125000, mod: LoRa, dr: SF12, ftime_received: false, ftime_ns: 0
Thu Dec 19 04:22:50 2024 user.info chirpstack-mqtt-forwarder[2375]: Received uplink frame, uplink_id: 867024431
Thu Dec 19 04:22:50 2024 user.info chirpstack-mqtt-forwarder[2375]: Sending uplink event, uplink_id: 867024431, topic: au915_1/gateway/0016c001ff1dfbe5/event/up
Thu Dec 19 04:23:13 2024 user.info chirpstack-concentratord-sx1302[2927]: Publishing stats event, rx_received: 1, rx_received_ok: 1, tx_received: 0, tx_emitted: 0
Thu Dec 19 04:23:13 2024 user.info chirpstack-mqtt-forwarder[2375]: Received gateway stats
Thu Dec 19 04:23:13 2024 user.info chirpstack-mqtt-forwarder[2375]: Sending gateway stats event, topic: au915_1/gateway/0016c001ff1dfbe5/event/stats
Thu Dec 19 04:23:13 2024 user.info chirpstack-concentratord-sx1302[2927]: Frame received, uplink_id: 2543504559, count_us: 1921393277, freq: 917400000, bw: 125000, mod: LoRa, dr: SF12, ftime_received: false, ftime_ns: 0
Thu Dec 19 04:23:13 2024 user.info chirpstack-mqtt-forwarder[2375]: Received uplink frame, uplink_id: 2543504559
Thu Dec 19 04:23:13 2024 user.info chirpstack-mqtt-forwarder[2375]: Sending uplink event, uplink_id: 2543504559, topic: au915_1/gateway/0016c001ff1dfbe5/event/up

Very strange indeed, can you get the logs from Chirpstack? As these logs are only concentratord and the mqtt-forwarder.

Unfortunately while I was waiting for that post to get approved (was my first post) I formatted the SD card and reinstalled. Needed to get it up and running again as a few things around the farm use LoRa to function.

In case it happens again, how do I get the Chirpstack logs? All the commands I found on the forums return “file doesn’t exist” or the previously posted logs.