Hi!
I’ve been using the GCP implementation as mentioned in the Quickstart guide… it works very nicely but somtimes, the NetworkServer (which is on a Compute Engine VM) stops recieving the PubSub messages without notice… then, after a systemctl restart, it recieves all the enqueued messages and starts working normally… ther’'s no error in the logs.
Do anyone have the same problem?
Here is a log from the VM:
Nov 28 10:15:48 camuzzi-outbound-service loraserver[947]: time="2018-11-28T10:15:48-03:00" level=info msg="gateway/gcp_pub_sub: message received" gateway_id=b827ebfffe01adba type=stats
Nov 28 10:15:48 camuzzi-outbound-service loraserver[947]: time="2018-11-28T10:15:48-03:00" level=info msg="gateway updated" gateway_id=b827ebfffe01adba
Nov 28 10:16:18 camuzzi-outbound-service loraserver[947]: time="2018-11-28T10:16:18-03:00" level=info msg="gateway/gcp_pub_sub: message received" gateway_id=b827ebfffe01adba type=stats
Nov 28 10:16:18 camuzzi-outbound-service loraserver[947]: time="2018-11-28T10:16:18-03:00" level=info msg="gateway updated" gateway_id=b827ebfffe01adba
Nov 28 10:16:48 camuzzi-outbound-service loraserver[947]: time="2018-11-28T10:16:48-03:00" level=info msg="gateway/gcp_pub_sub: message received" gateway_id=b827ebfffe01adba type=stats
Nov 28 10:16:48 camuzzi-outbound-service loraserver[947]: time="2018-11-28T10:16:48-03:00" level=info msg="gateway updated" gateway_id=b827ebfffe01adba
Nov 28 10:17:18 camuzzi-outbound-service loraserver[947]: time="2018-11-28T10:17:18-03:00" level=info msg="gateway/gcp_pub_sub: message received" gateway_id=b827ebfffe01adba type=stats
Nov 28 10:17:18 camuzzi-outbound-service loraserver[947]: time="2018-11-28T10:17:18-03:00" level=info msg="gateway updated" gateway_id=b827ebfffe01adba
Nov 28 10:17:48 camuzzi-outbound-service loraserver[947]: time="2018-11-28T10:17:48-03:00" level=info msg="gateway/gcp_pub_sub: message received" gateway_id=b827ebfffe01adba type=stats
Nov 28 10:17:48 camuzzi-outbound-service loraserver[947]: time="2018-11-28T10:17:48-03:00" level=info msg="gateway updated" gateway_id=b827ebfffe01adba
Nov 28 10:18:18 camuzzi-outbound-service loraserver[947]: time="2018-11-28T10:18:18-03:00" level=info msg="gateway/gcp_pub_sub: message received" gateway_id=b827ebfffe01adba type=stats
Nov 28 10:18:18 camuzzi-outbound-service loraserver[947]: time="2018-11-28T10:18:18-03:00" level=info msg="gateway updated" gateway_id=b827ebfffe01adba
Nov 28 10:18:48 camuzzi-outbound-service loraserver[947]: time="2018-11-28T10:18:48-03:00" level=info msg="gateway/gcp_pub_sub: message received" gateway_id=b827ebfffe01adba type=stats
Nov 28 10:18:48 camuzzi-outbound-service loraserver[947]: time="2018-11-28T10:18:48-03:00" level=info msg="gateway updated" gateway_id=b827ebfffe01adba
Nov 28 10:19:18 camuzzi-outbound-service loraserver[947]: time="2018-11-28T10:19:18-03:00" level=info msg="gateway/gcp_pub_sub: message received" gateway_id=b827ebfffe01adba type=stats
Nov 28 10:19:18 camuzzi-outbound-service loraserver[947]: time="2018-11-28T10:19:18-03:00" level=info msg="gateway updated" gateway_id=b827ebfffe01adba
Nov 28 10:19:48 camuzzi-outbound-service loraserver[947]: time="2018-11-28T10:19:48-03:00" level=info msg="gateway/gcp_pub_sub: message received" gateway_id=b827ebfffe01adba type=stats
Nov 28 10:19:48 camuzzi-outbound-service loraserver[947]: time="2018-11-28T10:19:48-03:00" level=info msg="gateway updated" gateway_id=b827ebfffe01adba
Nov 28 10:20:18 camuzzi-outbound-service loraserver[947]: time="2018-11-28T10:20:18-03:00" level=info msg="gateway/gcp_pub_sub: message received" gateway_id=b827ebfffe01adba type=stats
Nov 28 10:20:18 camuzzi-outbound-service loraserver[947]: time="2018-11-28T10:20:18-03:00" level=info msg="gateway updated" gateway_id=b827ebfffe01adba
Nov 28 11:10:16 camuzzi-outbound-service loraserver[947]: time="2018-11-28T11:10:16-03:00" level=info msg="finished unary call with code OK" grpc.code=OK grpc.method=GetGatewayStats grpc.service=ns.Ne
tworkServerService grpc.start_time="2018-11-28T11:10:15-03:00" grpc.time_ms=132.394 peer.address="[::1]:45910" span.kind=server system=grpc
Nov 28 11:10:18 camuzzi-outbound-service loraserver[947]: time="2018-11-28T11:10:18-03:00" level=info msg="finished unary call with code OK" grpc.code=OK grpc.method=GetGateway grpc.service=ns.Network
ServerService grpc.start_time="2018-11-28T11:10:18-03:00" grpc.time_ms=4.548 peer.address="[::1]:45910" span.kind=server system=grpc
Nov 28 11:10:18 camuzzi-outbound-service loraserver[947]: time="2018-11-28T11:10:18-03:00" level=info msg="finished unary call with code OK" grpc.code=OK grpc.method=GetGatewayStats grpc.service=ns.Ne
tworkServerService grpc.start_time="2018-11-28T11:10:18-03:00" grpc.time_ms=7.028 peer.address="[::1]:45910" span.kind=server system=grpc
Nov 28 11:10:55 camuzzi-outbound-service loraserver[947]: time="2018-11-28T11:10:55-03:00" level=info msg="finished streaming call with code OK" grpc.code=OK grpc.method=StreamFrameLogsForGateway grpc
.service=ns.NetworkServerService grpc.start_time="2018-11-28T11:10:43-03:00" grpc.time_ms=11657.88 peer.address="[::1]:45910" span.kind=server system=grpc
Nov 28 11:10:55 camuzzi-outbound-service loraserver[947]: time="2018-11-28T11:10:55-03:00" level=info msg="finished unary call with code OK" grpc.code=OK grpc.method=GetGatewayStats grpc.service=ns.Ne
tworkServerService grpc.start_time="2018-11-28T11:10:55-03:00" grpc.time_ms=4.628 peer.address="[::1]:45910" span.kind=server system=grpc
Nov 28 11:10:59 camuzzi-outbound-service loraserver[947]: time="2018-11-28T11:10:59-03:00" level=info msg="finished unary call with code OK" grpc.code=OK grpc.method=GetGateway grpc.service=ns.Network
ServerService grpc.start_time="2018-11-28T11:10:59-03:00" grpc.time_ms=3.48 peer.address="[::1]:45910" span.kind=server system=grpc
Nov 28 11:10:59 camuzzi-outbound-service loraserver[947]: time="2018-11-28T11:10:59-03:00" level=info msg="finished unary call with code OK" grpc.code=OK grpc.method=GetGatewayStats grpc.service=ns.Ne
tworkServerService grpc.start_time="2018-11-28T11:10:59-03:00" grpc.time_ms=4.83 peer.address="[::1]:45910" span.kind=server system=grpc
Nov 28 11:16:28 camuzzi-outbound-service systemd[1]: Stopping LoRa Server...
Nov 28 11:16:28 camuzzi-outbound-service systemd[1]: Stopped LoRa Server.
Nov 28 11:16:28 camuzzi-outbound-service systemd[1]: Started LoRa Server.
Nov 28 11:16:28 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:28-03:00" level=info msg="starting LoRa Server" band=AU_915_928 docs="https://docs.loraserver.io/" net_id=000000 vers
Nov 28 11:16:28 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:28-03:00" level=info msg="starting LoRa Server" band=AU_915_928 docs="https://docs.loraserver.io/" net_id=000000 vers
ion=2.3.0
Nov 28 11:16:28 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:28-03:00" level=info msg="disabling all channels"
Nov 28 11:16:28 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:28-03:00" level=info msg="enabling channels" channels="[0 1 2 3 4 5 6 7]"
Nov 28 11:16:28 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:28-03:00" level=info msg="setup redis connection pool" url="redis://127.0.0.1:6379"
Nov 28 11:16:28 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:28-03:00" level=info msg="connecting to postgresql"
Nov 28 11:16:28 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:28-03:00" level=info msg="gateway/gcp_pub_sub: setting up client"
Nov 28 11:16:28 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:28-03:00" level=info msg="gateway/gcp_pub_sub: setup downlink topic" topic=au921-gateway-commands
Nov 28 11:16:28 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:28-03:00" level=info msg="gateway/gcp_pub_sub: setup uplink topic" topic=au921-gateway-events
Nov 28 11:16:28 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:28-03:00" level=info msg="gateway/gcp_pub_sub: check if uplink subscription exists" subscription=au921-gateway-events
-loraserver
Nov 28 11:16:28 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:28-03:00" level=info msg="no geolocation-server configured"
Nov 28 11:16:28 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:28-03:00" level=info msg="configuring join-server client" ca_cert= server="http://localhost:8003" tls_cert= tls_key=
Nov 28 11:16:28 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:28-03:00" level=info msg="no network-controller configured"
Nov 28 11:16:28 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:28-03:00" level=info msg="applying database migrations"
Nov 28 11:16:28 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:28-03:00" level=info msg="migrations applied" count=0
Nov 28 11:16:28 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:28-03:00" level=info msg="starting api server" bind="0.0.0.0:8000" ca-cert= tls-cert= tls-key=
Nov 28 11:16:28 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:28-03:00" level=info msg="starting downlink device-queue scheduler"
Nov 28 11:16:28 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:28-03:00" level=info msg="starting multicast scheduler"
Nov 28 11:16:29 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:29-03:00" level=info msg="gateway/gcp_pub_sub: message received" gateway_id=b827ebfffe01adba type=stats
Nov 28 11:16:29 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:29-03:00" level=info msg="gateway/gcp_pub_sub: message received" gateway_id=b827ebfffe01adba type=stats
Nov 28 11:16:29 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:29-03:00" level=info msg="gateway updated" gateway_id=b827ebfffe01adba
Nov 28 11:16:29 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:29-03:00" level=info msg="gateway updated" gateway_id=b827ebfffe01adba
Nov 28 11:16:29 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:29-03:00" level=info msg="gateway/gcp_pub_sub: message received" gateway_id=b827ebfffe01adba type=stats
Nov 28 11:16:29 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:29-03:00" level=info msg="gateway/gcp_pub_sub: message received" gateway_id=b827ebfffe01adba type=stats
Nov 28 11:16:29 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:29-03:00" level=info msg="gateway updated" gateway_id=b827ebfffe01adba
Nov 28 11:16:29 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:29-03:00" level=info msg="gateway updated" gateway_id=b827ebfffe01adba
Nov 28 11:16:29 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:29-03:00" level=info msg="gateway/gcp_pub_sub: message received" gateway_id=b827ebfffe01adba type=stats
Nov 28 11:16:29 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:29-03:00" level=info msg="gateway/gcp_pub_sub: message received" gateway_id=b827ebfffe01adba type=stats
Nov 28 11:16:29 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:29-03:00" level=info msg="gateway updated" gateway_id=b827ebfffe01adba
Nov 28 11:16:29 camuzzi-outbound-service loraserver[15714]: time="2018-11-28T11:16:29-03:00" level=info msg="gateway/gcp_pub_sub: message received" gateway_id=b827ebfffe01adba type=stats
There’s some logs and the I had to restart the network server, you can see a bunch of logs in the same time.
Thanks in advance!