No peers in dashboard and cli looses peers after a day even with management connected #1778

Closed
opened 2025-11-20 06:06:34 -05:00 by saavagebueno · 16 comments
Owner

Originally created by @jvanbruegge on GitHub (Apr 3, 2025).

Describe the problem

I recently updated from 0.36.6 to 0.39.2 and since then netbird stopped working properly.
If I reconnect with the client on two devices (with netbird down && netbird up), both clis will see 1 peer each. However the dashboard says that no clients are connected. After a day or so, the clis will have lost the connection to the other peer and need a reconnection again.

To Reproduce

Steps to reproduce the behavior:

  1. Update to 0.29.2
  2. Connect two peers to the network
  3. Look at the dashboard (see no peers connected)
  4. Wait a day
  5. Clients have lost connection with each other

Expected behavior

Dashboard shows the two peers and they keep the connection for longer (and try to reconnected if disconnected?)

Are you using NetBird Cloud?

Self-Hosted

NetBird version

0.39.2

Is any other VPN software installed?

No

Debug output

To help us resolve the problem, please attach the following debug output

caladan here is the peer I manually reconnected just now (netbird down && netbird up on both my laptop and caladan). vps is the server that hosts the control plane, but it also runs a client that was connected yesterday but lost the connection in the meantime. nas is a remote server that I can access only via netbird and since the update it also does not reconnect to the server automatically. hwlap0036-macs is my laptop.

nas is on netbird 0.36.6 (which I can't update at the moment because it lost connection), all others are one 0.39.2

netbird status -dA for laptop
Peers detail:
 caladan.net.anon-Tahsh.domain:
  NetBird IP: 100.107.79.138
  Public key: OyaccKy8y/+itamr2Y9EGJ/iU4PCBuQtgDxdSVGHXHE=
  Status: Connected
  -- detail --
  Connection type: P2P
  ICE candidate (Local/Remote): host/host
  ICE candidate endpoints (Local/Remote): 192.168.56.1:51820/192.168.0.1:51820
  Relay server address: 
  Last connection update: 4 minutes, 18 seconds ago
  Last WireGuard handshake: 7 seconds ago
  Transfer status (received/sent) 308 B/860 B
  Quantum resistance: false
  Networks: -
  Latency: 2.493837ms

 vps.net.anon-Tahsh.domain:
  NetBird IP: 100.107.135.146
  Public key: /X3NbBN7YCMA153QnJYohpjWD8hxMHepI/EuVs9LGVc=
  Status: Disconnected
  -- detail --
  Connection type: 
  ICE candidate (Local/Remote): -/-
  ICE candidate endpoints (Local/Remote): -/-
  Relay server address: 
  Last connection update: -
  Last WireGuard handshake: -
  Transfer status (received/sent) 0 B/0 B
  Quantum resistance: false
  Networks: -
  Latency: 0s

 nas.net.anon-Tahsh.domain:
  NetBird IP: 100.107.190.186
  Public key: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=
  Status: Disconnected
  -- detail --
  Connection type: 
  ICE candidate (Local/Remote): -/-
  ICE candidate endpoints (Local/Remote): -/-
  Relay server address: 
  Last connection update: -
  Last WireGuard handshake: -
  Transfer status (received/sent) 0 B/0 B
  Quantum resistance: false
  Networks: -
  Latency: 0s

Events:
  [INFO] SYSTEM (0f513523-451f-4975-91d5-7c512f6eb5da)
    Message: Network map updated
    Time: 1 day, 18 hours ago
  [INFO] SYSTEM (b025fe36-ae6a-4959-a265-02b31e2ac567)
    Message: Network map updated
    Time: 1 day, 18 hours ago
  [INFO] SYSTEM (6b419d2d-62e6-4eda-9468-4067b0055d60)
    Message: Network map updated
    Time: 23 hours, 40 minutes ago
  [INFO] SYSTEM (b2d4332f-fb52-4283-a53b-3916d09f530f)
    Message: Network map updated
    Time: 23 hours, 28 minutes ago
  [INFO] SYSTEM (3b94d54a-8599-4ac1-8c1e-3132867bae83)
    Message: Network map updated
    Time: 23 hours, 28 minutes ago
  [INFO] SYSTEM (6909b71d-f786-48c1-a964-22d132fa557d)
    Message: Network map updated
    Time: 4 minutes, 19 seconds ago
OS: linux/amd64
Daemon version: 0.39.2
CLI version: 0.39.2
Management: Connected to https://netbird.anon-Tahsh.domain:443
Signal: Connected to https://netbird.anon-Tahsh.domain:443
Relays: 
  [stun:netbird.anon-Tahsh.domain:3478] is Available
  [turn:netbird.anon-Tahsh.domain:3478?transport=udp] is Available
Nameservers: 
FQDN: hwlap0036-macs.net.anon-Tahsh.domain
NetBird IP: 100.107.26.184/16
Interface type: Kernel
Quantum resistance: false
Networks: -
Forwarding rules: 0
Peers count: 1/15 Connected
netbird status -dA for vps server
Peers detail:
 hwlap0036-macs.net.anon-s8o8q.domain:
  NetBird IP: 100.107.26.184
  Public key: dAxu2MPs/FsKQULsbr0GATkD8lc1zkZezQbwoc2r6jc=
  Status: Disconnected
  -- detail --
  Connection type: 
  ICE candidate (Local/Remote): -/-
  ICE candidate endpoints (Local/Remote): -/-
  Relay server address: 
  Last connection update: 22 hours, 27 minutes ago
  Last WireGuard handshake: -
  Transfer status (received/sent) 0 B/0 B
  Quantum resistance: false
  Networks: -
  Latency: 38.710019ms

 caladan.net.anon-s8o8q.domain:
  NetBird IP: 100.107.79.138
  Public key: OyaccKy8y/+itamr2Y9EGJ/iU4PCBuQtgDxdSVGHXHE=
  Status: Disconnected
  -- detail --
  Connection type: 
  ICE candidate (Local/Remote): -/-
  ICE candidate endpoints (Local/Remote): -/-
  Relay server address: 
  Last connection update: 13 hours, 7 minutes ago
  Last WireGuard handshake: -
  Transfer status (received/sent) 0 B/0 B
  Quantum resistance: false
  Networks: -
  Latency: 39.507273ms

 nas.net.anon-s8o8q.domain:
  NetBird IP: 100.107.190.186
  Public key: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=
  Status: Disconnected
  -- detail --
  Connection type: 
  ICE candidate (Local/Remote): -/-
  ICE candidate endpoints (Local/Remote): -/-
  Relay server address: 
  Last connection update: -
  Last WireGuard handshake: -
  Transfer status (received/sent) 0 B/0 B
  Quantum resistance: false
  Networks: -
  Latency: 0s

Events:
  [INFO] SYSTEM (880da02c-afcf-4b41-bd54-cc5d22ae4ee4)
    Message: Network map updated
    Time: 23 hours, 34 minutes ago
OS: linux/amd64
Daemon version: 0.39.2
CLI version: 0.39.2
Management: Connected to https://netbird.anon-s8o8q.domain:443
Signal: Connected to https://netbird.anon-s8o8q.domain:443
Relays: 
  [stun:netbird.anon-s8o8q.domain:3478] is Available
  [turn:netbird.anon-s8o8q.domain:3478?transport=udp] is Available
Nameservers: 
FQDN: vps.net.anon-s8o8q.domain
NetBird IP: 100.107.135.146/16
Interface type: Kernel
Quantum resistance: false
Networks: -
Forwarding rules: 0
Peers count: 0/15 Connected

As well as the file created by

netbird debug for 1m -AS

netbird.debug.3962987827.zip (from vps)

netbird.debug.1492648304.zip (from laptop)

Have you tried these troubleshooting steps?

  • Checked for newer NetBird versions
  • Searched for similar issues on GitHub (including closed ones)
  • Restarted the NetBird client
  • Disabled other VPN software
  • Checked firewall settings
Originally created by @jvanbruegge on GitHub (Apr 3, 2025). **Describe the problem** I recently updated from 0.36.6 to 0.39.2 and since then netbird stopped working properly. If I reconnect with the client on two devices (with `netbird down && netbird up`), both clis will see 1 peer each. However the dashboard says that no clients are connected. After a day or so, the clis will have lost the connection to the other peer and need a reconnection again. **To Reproduce** Steps to reproduce the behavior: 1. Update to 0.29.2 2. Connect two peers to the network 3. Look at the dashboard (see no peers connected) 4. Wait a day 5. Clients have lost connection with each other **Expected behavior** Dashboard shows the two peers and they keep the connection for longer (and try to reconnected if disconnected?) **Are you using NetBird Cloud?** Self-Hosted **NetBird version** 0.39.2 **Is any other VPN software installed?** No **Debug output** To help us resolve the problem, please attach the following debug output caladan here is the peer I manually reconnected just now (`netbird down && netbird up` on both my laptop and caladan). vps is the server that hosts the control plane, but it also runs a client that was connected yesterday but lost the connection in the meantime. nas is a remote server that I can access only via netbird and since the update it also does not reconnect to the server automatically. hwlap0036-macs is my laptop. nas is on netbird 0.36.6 (which I can't update at the moment because it lost connection), all others are one 0.39.2 <details><summary>netbird status -dA for laptop</summary> ``` Peers detail: caladan.net.anon-Tahsh.domain: NetBird IP: 100.107.79.138 Public key: OyaccKy8y/+itamr2Y9EGJ/iU4PCBuQtgDxdSVGHXHE= Status: Connected -- detail -- Connection type: P2P ICE candidate (Local/Remote): host/host ICE candidate endpoints (Local/Remote): 192.168.56.1:51820/192.168.0.1:51820 Relay server address: Last connection update: 4 minutes, 18 seconds ago Last WireGuard handshake: 7 seconds ago Transfer status (received/sent) 308 B/860 B Quantum resistance: false Networks: - Latency: 2.493837ms vps.net.anon-Tahsh.domain: NetBird IP: 100.107.135.146 Public key: /X3NbBN7YCMA153QnJYohpjWD8hxMHepI/EuVs9LGVc= Status: Disconnected -- detail -- Connection type: ICE candidate (Local/Remote): -/- ICE candidate endpoints (Local/Remote): -/- Relay server address: Last connection update: - Last WireGuard handshake: - Transfer status (received/sent) 0 B/0 B Quantum resistance: false Networks: - Latency: 0s nas.net.anon-Tahsh.domain: NetBird IP: 100.107.190.186 Public key: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk= Status: Disconnected -- detail -- Connection type: ICE candidate (Local/Remote): -/- ICE candidate endpoints (Local/Remote): -/- Relay server address: Last connection update: - Last WireGuard handshake: - Transfer status (received/sent) 0 B/0 B Quantum resistance: false Networks: - Latency: 0s Events: [INFO] SYSTEM (0f513523-451f-4975-91d5-7c512f6eb5da) Message: Network map updated Time: 1 day, 18 hours ago [INFO] SYSTEM (b025fe36-ae6a-4959-a265-02b31e2ac567) Message: Network map updated Time: 1 day, 18 hours ago [INFO] SYSTEM (6b419d2d-62e6-4eda-9468-4067b0055d60) Message: Network map updated Time: 23 hours, 40 minutes ago [INFO] SYSTEM (b2d4332f-fb52-4283-a53b-3916d09f530f) Message: Network map updated Time: 23 hours, 28 minutes ago [INFO] SYSTEM (3b94d54a-8599-4ac1-8c1e-3132867bae83) Message: Network map updated Time: 23 hours, 28 minutes ago [INFO] SYSTEM (6909b71d-f786-48c1-a964-22d132fa557d) Message: Network map updated Time: 4 minutes, 19 seconds ago OS: linux/amd64 Daemon version: 0.39.2 CLI version: 0.39.2 Management: Connected to https://netbird.anon-Tahsh.domain:443 Signal: Connected to https://netbird.anon-Tahsh.domain:443 Relays: [stun:netbird.anon-Tahsh.domain:3478] is Available [turn:netbird.anon-Tahsh.domain:3478?transport=udp] is Available Nameservers: FQDN: hwlap0036-macs.net.anon-Tahsh.domain NetBird IP: 100.107.26.184/16 Interface type: Kernel Quantum resistance: false Networks: - Forwarding rules: 0 Peers count: 1/15 Connected ``` </details> <details><summary>netbird status -dA for vps server</summary> ``` Peers detail: hwlap0036-macs.net.anon-s8o8q.domain: NetBird IP: 100.107.26.184 Public key: dAxu2MPs/FsKQULsbr0GATkD8lc1zkZezQbwoc2r6jc= Status: Disconnected -- detail -- Connection type: ICE candidate (Local/Remote): -/- ICE candidate endpoints (Local/Remote): -/- Relay server address: Last connection update: 22 hours, 27 minutes ago Last WireGuard handshake: - Transfer status (received/sent) 0 B/0 B Quantum resistance: false Networks: - Latency: 38.710019ms caladan.net.anon-s8o8q.domain: NetBird IP: 100.107.79.138 Public key: OyaccKy8y/+itamr2Y9EGJ/iU4PCBuQtgDxdSVGHXHE= Status: Disconnected -- detail -- Connection type: ICE candidate (Local/Remote): -/- ICE candidate endpoints (Local/Remote): -/- Relay server address: Last connection update: 13 hours, 7 minutes ago Last WireGuard handshake: - Transfer status (received/sent) 0 B/0 B Quantum resistance: false Networks: - Latency: 39.507273ms nas.net.anon-s8o8q.domain: NetBird IP: 100.107.190.186 Public key: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk= Status: Disconnected -- detail -- Connection type: ICE candidate (Local/Remote): -/- ICE candidate endpoints (Local/Remote): -/- Relay server address: Last connection update: - Last WireGuard handshake: - Transfer status (received/sent) 0 B/0 B Quantum resistance: false Networks: - Latency: 0s Events: [INFO] SYSTEM (880da02c-afcf-4b41-bd54-cc5d22ae4ee4) Message: Network map updated Time: 23 hours, 34 minutes ago OS: linux/amd64 Daemon version: 0.39.2 CLI version: 0.39.2 Management: Connected to https://netbird.anon-s8o8q.domain:443 Signal: Connected to https://netbird.anon-s8o8q.domain:443 Relays: [stun:netbird.anon-s8o8q.domain:3478] is Available [turn:netbird.anon-s8o8q.domain:3478?transport=udp] is Available Nameservers: FQDN: vps.net.anon-s8o8q.domain NetBird IP: 100.107.135.146/16 Interface type: Kernel Quantum resistance: false Networks: - Forwarding rules: 0 Peers count: 0/15 Connected ``` </details> As well as the file created by netbird debug for 1m -AS [netbird.debug.3962987827.zip (from vps)](https://github.com/user-attachments/files/19584652/netbird.debug.3962987827.zip) [netbird.debug.1492648304.zip (from laptop)](https://github.com/user-attachments/files/19584707/netbird.debug.1492648304.zip) **Have you tried these troubleshooting steps?** - [x] Checked for newer NetBird versions - [x] Searched for similar issues on GitHub (including closed ones) - [x] Restarted the NetBird client - [x] Disabled other VPN software - [x] Checked firewall settings
saavagebueno added the triage-needed label 2025-11-20 06:06:34 -05:00
Author
Owner

@jvanbruegge commented on GitHub (Apr 3, 2025):

I see this in the logs:

Apr 03 10:37:32 lighthouse netbird-mgmt[30096]: 2025-04-03T10:37:32Z INFO [context: SYSTEM] management/server/account.go:281: single account mode disabled, accounts number 3

but I do not pass the ----disable-single-account-mode flag, so this is very weird

@jvanbruegge commented on GitHub (Apr 3, 2025): I see this in the logs: ``` Apr 03 10:37:32 lighthouse netbird-mgmt[30096]: 2025-04-03T10:37:32Z INFO [context: SYSTEM] management/server/account.go:281: single account mode disabled, accounts number 3 ``` but I do not pass the `----disable-single-account-mode` flag, so this is very weird
Author
Owner

@jvanbruegge commented on GitHub (Apr 3, 2025):

I decided to nuke the netbird server and try to set it up again. This fixed the single account issue, but I still see the same behavior. The peers do not show up as connected in the dashboard and the clients to not seem to be able to connect automatically

@jvanbruegge commented on GitHub (Apr 3, 2025): I decided to nuke the netbird server and try to set it up again. This fixed the single account issue, but I still see the same behavior. The peers do not show up as connected in the dashboard and the clients to not seem to be able to connect automatically
Author
Owner

@jvanbruegge commented on GitHub (Apr 3, 2025):

This is how it looks in the dashboard now:

Image

The peers were shown as active for a short while directly after setting them up, but now they show as offline. And caladan is somehow not able to connect at all.

netbird status -dA for laptop
Peers detail:
 caladan.net.anon-fzdZb.domain:
  NetBird IP: 100.87.149.135
  Public key: OyaccKy8y/+itamr2Y9EGJ/iU4PCBuQtgDxdSVGHXHE=
  Status: Disconnected
  -- detail --
  Connection type: 
  ICE candidate (Local/Remote): -/-
  ICE candidate endpoints (Local/Remote): -/-
  Relay server address: 
  Last connection update: -
  Last WireGuard handshake: -
  Transfer status (received/sent) 0 B/0 B
  Quantum resistance: false
  Networks: -
  Latency: 0s

 lighthouse.net.anon-fzdZb.domain:
  NetBird IP: 100.87.209.95
  Public key: YdQTtZHGPxawpEUB5tLD76drQSDgIcCFUPAE1B/4lyQ=
  Status: Connected
  -- detail --
  Connection type: P2P
  ICE candidate (Local/Remote): host/host
  ICE candidate endpoints (Local/Remote): 192.168.0.134:51820/198.51.100.0:51820
  Relay server address: 
  Last connection update: 4 minutes, 41 seconds ago
  Last WireGuard handshake: 30 seconds ago
  Transfer status (received/sent) 308 B/892 B
  Quantum resistance: false
  Networks: -
  Latency: 54.550677ms

Events:
  [INFO] SYSTEM (0f513523-451f-4975-91d5-7c512f6eb5da)
    Message: Network map updated
    Time: 1 day, 19 hours ago
  [INFO] SYSTEM (b025fe36-ae6a-4959-a265-02b31e2ac567)
    Message: Network map updated
    Time: 1 day, 19 hours ago
  [INFO] SYSTEM (6b419d2d-62e6-4eda-9468-4067b0055d60)
    Message: Network map updated
    Time: 1 day ago
  [INFO] SYSTEM (b2d4332f-fb52-4283-a53b-3916d09f530f)
    Message: Network map updated
    Time: 1 day ago
  [INFO] SYSTEM (3b94d54a-8599-4ac1-8c1e-3132867bae83)
    Message: Network map updated
    Time: 1 day ago
  [INFO] SYSTEM (6909b71d-f786-48c1-a964-22d132fa557d)
    Message: Network map updated
    Time: 1 hour, 3 minutes ago
  [INFO] SYSTEM (43a02fb7-42cd-44de-8b62-64ea35b9c344)
    Message: Network map updated
    Time: 48 minutes, 55 seconds ago
  [INFO] SYSTEM (9df9084e-8243-4aab-9014-17ce2420b9d0)
    Message: Network map updated
    Time: 26 minutes, 8 seconds ago
  [INFO] SYSTEM (52f94869-a9a8-41c8-96fd-5b4de41ccf07)
    Message: Network map updated
    Time: 14 minutes, 27 seconds ago
  [INFO] SYSTEM (6da671c2-f2b0-4b9f-a952-d61dc2cdcadb)
    Message: Network map updated
    Time: 4 minutes, 41 seconds ago
OS: linux/amd64
Daemon version: 0.39.2
CLI version: 0.39.2
Management: Connected to https://netbird.anon-fzdZb.domain:443
Signal: Connected to https://netbird.anon-fzdZb.domain:443
Relays: 
  [stun:netbird.anon-fzdZb.domain:3478] is Available
  [turn:netbird.anon-fzdZb.domain:3478?transport=udp] is Available
Nameservers: 
FQDN: hwlap0036-macs.net.anon-fzdZb.domain
NetBird IP: 100.87.195.206/16
Interface type: Kernel
Quantum resistance: false
Networks: -
Forwarding rules: 0
Peers count: 1/2 Connected
netbird status -dA for caladan
Peers detail:
 hwlap0036-macs.net.anon-7tVsI.domain:
  NetBird IP: 100.87.195.206
  Public key: dAxu2MPs/FsKQULsbr0GATkD8lc1zkZezQbwoc2r6jc=
  Status: Disconnected
  -- detail --
  Connection type: 
  ICE candidate (Local/Remote): -/-
  ICE candidate endpoints (Local/Remote): -/-
  Relay server address: 
  Last connection update: -
  Last WireGuard handshake: -
  Transfer status (received/sent) 0 B/0 B
  Quantum resistance: false
  Networks: -
  Latency: 0s

 lighthouse.net.anon-7tVsI.domain:
  NetBird IP: 100.87.209.95
  Public key: YdQTtZHGPxawpEUB5tLD76drQSDgIcCFUPAE1B/4lyQ=
  Status: Disconnected
  -- detail --
  Connection type: 
  ICE candidate (Local/Remote): -/-
  ICE candidate endpoints (Local/Remote): -/-
  Relay server address: 
  Last connection update: -
  Last WireGuard handshake: -
  Transfer status (received/sent) 0 B/0 B
  Quantum resistance: false
  Networks: -
  Latency: 0s

Events:
  [INFO] SYSTEM (e16a64b5-68b6-4b45-b6a1-82061d483a95)
    Message: Network map updated
    Time: 2 days, 21 hours ago
  [INFO] SYSTEM (98a3c9fd-c285-418d-8dfd-e25a568ecbec)
    Message: Network map updated
    Time: 2 days, 21 hours ago
  [INFO] SYSTEM (6e60543f-15d7-4efb-9339-d21330806b3f)
    Message: Network map updated
    Time: 2 days, 21 hours ago
  [INFO] SYSTEM (b843ddad-45b6-4df6-95d8-1ade477ae24c)
    Message: Network map updated
    Time: 2 days, 20 hours ago
  [INFO] SYSTEM (d1c9aa81-cab0-44c7-8ca1-798e711e47c4)
    Message: Network map updated
    Time: 1 day, 19 hours ago
  [INFO] SYSTEM (a26fcacf-9139-44ed-a77a-9209df6ea03a)
    Message: Network map updated
    Time: 1 day ago
  [INFO] SYSTEM (3104e00a-70f5-47c9-8b48-af8525a5b34e)
    Message: Network map updated
    Time: 1 day ago
  [INFO] SYSTEM (2a64e001-71a3-4b9c-9851-ead5e413281d)
    Message: Network map updated
    Time: 1 hour, 5 minutes ago
  [INFO] SYSTEM (e8bef77d-7802-4733-a67d-b5c188d05887)
    Message: Network map updated
    Time: 26 minutes, 54 seconds ago
  [INFO] SYSTEM (d6b85e85-2910-4af4-b8ee-f4ba742b63e7)
    Message: Network map updated
    Time: 7 minutes, 29 seconds ago
OS: linux/amd64
Daemon version: 0.39.2
CLI version: 0.39.2
Management: Connected to https://netbird.anon-7tVsI.domain:443
Signal: Connected to https://netbird.anon-7tVsI.domain:443
Relays: 
  [stun:netbird.anon-7tVsI.domain:3478] is Available
  [turn:netbird.anon-7tVsI.domain:3478?transport=udp] is Available
Nameservers: 
FQDN: caladan.net.anon-7tVsI.domain
NetBird IP: 100.87.149.135/16
Interface type: Kernel
Quantum resistance: false
Networks: -
Forwarding rules: 0
Peers count: 0/2 Connected
netbird status -dA for vps (now named lighthouse)
Peers detail:
 caladan.net.anon-dXkuP.domain:
  NetBird IP: 100.87.149.135
  Public key: OyaccKy8y/+itamr2Y9EGJ/iU4PCBuQtgDxdSVGHXHE=
  Status: Disconnected
  -- detail --
  Connection type: 
  ICE candidate (Local/Remote): -/-
  ICE candidate endpoints (Local/Remote): -/-
  Relay server address: 
  Last connection update: -
  Last WireGuard handshake: -
  Transfer status (received/sent) 0 B/0 B
  Quantum resistance: false
  Networks: -
  Latency: 0s

 hwlap0036-macs.net.anon-dXkuP.domain:
  NetBird IP: 100.87.195.206
  Public key: dAxu2MPs/FsKQULsbr0GATkD8lc1zkZezQbwoc2r6jc=
  Status: Connected
  -- detail --
  Connection type: P2P
  ICE candidate (Local/Remote): host/prflx
  ICE candidate endpoints (Local/Remote): 198.51.100.0:51820/198.51.100.1:52125
  Relay server address: 
  Last connection update: 7 minutes, 14 seconds ago
  Last WireGuard handshake: 57 seconds ago
  Transfer status (received/sent) 1.2 KiB/548 B
  Quantum resistance: false
  Networks: -
  Latency: 40.779699ms

Events:
  [INFO] SYSTEM (3e5d42cf-25a8-47e0-8d0f-81243dc261af)
    Message: Network map updated
    Time: 14 minutes ago
  [INFO] SYSTEM (af50a3a6-09ce-4efe-be51-01ba91551e70)
    Message: Network map updated
    Time: 7 minutes, 31 seconds ago
OS: linux/amd64
Daemon version: 0.39.2
CLI version: 0.39.2
Management: Connected to https://netbird.anon-dXkuP.domain:443
Signal: Connected to https://netbird.anon-dXkuP.domain:443
Relays: 
  [stun:netbird.anon-dXkuP.domain:3478] is Available
  [turn:netbird.anon-dXkuP.domain:3478?transport=udp] is Available
Nameservers: 
FQDN: lighthouse.net.anon-dXkuP.domain
NetBird IP: 100.87.209.95/16
Interface type: Kernel
Quantum resistance: false
Networks: -
Forwarding rules: 0
Peers count: 1/2 Connected
@jvanbruegge commented on GitHub (Apr 3, 2025): This is how it looks in the dashboard now: ![Image](https://github.com/user-attachments/assets/66a5f032-87a8-416d-b60b-89fa7f7236a8) The peers were shown as active for a short while directly after setting them up, but now they show as offline. And caladan is somehow not able to connect at all. <details><summary>netbird status -dA for laptop</summary> ``` Peers detail: caladan.net.anon-fzdZb.domain: NetBird IP: 100.87.149.135 Public key: OyaccKy8y/+itamr2Y9EGJ/iU4PCBuQtgDxdSVGHXHE= Status: Disconnected -- detail -- Connection type: ICE candidate (Local/Remote): -/- ICE candidate endpoints (Local/Remote): -/- Relay server address: Last connection update: - Last WireGuard handshake: - Transfer status (received/sent) 0 B/0 B Quantum resistance: false Networks: - Latency: 0s lighthouse.net.anon-fzdZb.domain: NetBird IP: 100.87.209.95 Public key: YdQTtZHGPxawpEUB5tLD76drQSDgIcCFUPAE1B/4lyQ= Status: Connected -- detail -- Connection type: P2P ICE candidate (Local/Remote): host/host ICE candidate endpoints (Local/Remote): 192.168.0.134:51820/198.51.100.0:51820 Relay server address: Last connection update: 4 minutes, 41 seconds ago Last WireGuard handshake: 30 seconds ago Transfer status (received/sent) 308 B/892 B Quantum resistance: false Networks: - Latency: 54.550677ms Events: [INFO] SYSTEM (0f513523-451f-4975-91d5-7c512f6eb5da) Message: Network map updated Time: 1 day, 19 hours ago [INFO] SYSTEM (b025fe36-ae6a-4959-a265-02b31e2ac567) Message: Network map updated Time: 1 day, 19 hours ago [INFO] SYSTEM (6b419d2d-62e6-4eda-9468-4067b0055d60) Message: Network map updated Time: 1 day ago [INFO] SYSTEM (b2d4332f-fb52-4283-a53b-3916d09f530f) Message: Network map updated Time: 1 day ago [INFO] SYSTEM (3b94d54a-8599-4ac1-8c1e-3132867bae83) Message: Network map updated Time: 1 day ago [INFO] SYSTEM (6909b71d-f786-48c1-a964-22d132fa557d) Message: Network map updated Time: 1 hour, 3 minutes ago [INFO] SYSTEM (43a02fb7-42cd-44de-8b62-64ea35b9c344) Message: Network map updated Time: 48 minutes, 55 seconds ago [INFO] SYSTEM (9df9084e-8243-4aab-9014-17ce2420b9d0) Message: Network map updated Time: 26 minutes, 8 seconds ago [INFO] SYSTEM (52f94869-a9a8-41c8-96fd-5b4de41ccf07) Message: Network map updated Time: 14 minutes, 27 seconds ago [INFO] SYSTEM (6da671c2-f2b0-4b9f-a952-d61dc2cdcadb) Message: Network map updated Time: 4 minutes, 41 seconds ago OS: linux/amd64 Daemon version: 0.39.2 CLI version: 0.39.2 Management: Connected to https://netbird.anon-fzdZb.domain:443 Signal: Connected to https://netbird.anon-fzdZb.domain:443 Relays: [stun:netbird.anon-fzdZb.domain:3478] is Available [turn:netbird.anon-fzdZb.domain:3478?transport=udp] is Available Nameservers: FQDN: hwlap0036-macs.net.anon-fzdZb.domain NetBird IP: 100.87.195.206/16 Interface type: Kernel Quantum resistance: false Networks: - Forwarding rules: 0 Peers count: 1/2 Connected ``` </details> <details><summary>netbird status -dA for caladan</summary> ``` Peers detail: hwlap0036-macs.net.anon-7tVsI.domain: NetBird IP: 100.87.195.206 Public key: dAxu2MPs/FsKQULsbr0GATkD8lc1zkZezQbwoc2r6jc= Status: Disconnected -- detail -- Connection type: ICE candidate (Local/Remote): -/- ICE candidate endpoints (Local/Remote): -/- Relay server address: Last connection update: - Last WireGuard handshake: - Transfer status (received/sent) 0 B/0 B Quantum resistance: false Networks: - Latency: 0s lighthouse.net.anon-7tVsI.domain: NetBird IP: 100.87.209.95 Public key: YdQTtZHGPxawpEUB5tLD76drQSDgIcCFUPAE1B/4lyQ= Status: Disconnected -- detail -- Connection type: ICE candidate (Local/Remote): -/- ICE candidate endpoints (Local/Remote): -/- Relay server address: Last connection update: - Last WireGuard handshake: - Transfer status (received/sent) 0 B/0 B Quantum resistance: false Networks: - Latency: 0s Events: [INFO] SYSTEM (e16a64b5-68b6-4b45-b6a1-82061d483a95) Message: Network map updated Time: 2 days, 21 hours ago [INFO] SYSTEM (98a3c9fd-c285-418d-8dfd-e25a568ecbec) Message: Network map updated Time: 2 days, 21 hours ago [INFO] SYSTEM (6e60543f-15d7-4efb-9339-d21330806b3f) Message: Network map updated Time: 2 days, 21 hours ago [INFO] SYSTEM (b843ddad-45b6-4df6-95d8-1ade477ae24c) Message: Network map updated Time: 2 days, 20 hours ago [INFO] SYSTEM (d1c9aa81-cab0-44c7-8ca1-798e711e47c4) Message: Network map updated Time: 1 day, 19 hours ago [INFO] SYSTEM (a26fcacf-9139-44ed-a77a-9209df6ea03a) Message: Network map updated Time: 1 day ago [INFO] SYSTEM (3104e00a-70f5-47c9-8b48-af8525a5b34e) Message: Network map updated Time: 1 day ago [INFO] SYSTEM (2a64e001-71a3-4b9c-9851-ead5e413281d) Message: Network map updated Time: 1 hour, 5 minutes ago [INFO] SYSTEM (e8bef77d-7802-4733-a67d-b5c188d05887) Message: Network map updated Time: 26 minutes, 54 seconds ago [INFO] SYSTEM (d6b85e85-2910-4af4-b8ee-f4ba742b63e7) Message: Network map updated Time: 7 minutes, 29 seconds ago OS: linux/amd64 Daemon version: 0.39.2 CLI version: 0.39.2 Management: Connected to https://netbird.anon-7tVsI.domain:443 Signal: Connected to https://netbird.anon-7tVsI.domain:443 Relays: [stun:netbird.anon-7tVsI.domain:3478] is Available [turn:netbird.anon-7tVsI.domain:3478?transport=udp] is Available Nameservers: FQDN: caladan.net.anon-7tVsI.domain NetBird IP: 100.87.149.135/16 Interface type: Kernel Quantum resistance: false Networks: - Forwarding rules: 0 Peers count: 0/2 Connected ``` </details> <details><summary>netbird status -dA for vps (now named lighthouse)</summary> ``` Peers detail: caladan.net.anon-dXkuP.domain: NetBird IP: 100.87.149.135 Public key: OyaccKy8y/+itamr2Y9EGJ/iU4PCBuQtgDxdSVGHXHE= Status: Disconnected -- detail -- Connection type: ICE candidate (Local/Remote): -/- ICE candidate endpoints (Local/Remote): -/- Relay server address: Last connection update: - Last WireGuard handshake: - Transfer status (received/sent) 0 B/0 B Quantum resistance: false Networks: - Latency: 0s hwlap0036-macs.net.anon-dXkuP.domain: NetBird IP: 100.87.195.206 Public key: dAxu2MPs/FsKQULsbr0GATkD8lc1zkZezQbwoc2r6jc= Status: Connected -- detail -- Connection type: P2P ICE candidate (Local/Remote): host/prflx ICE candidate endpoints (Local/Remote): 198.51.100.0:51820/198.51.100.1:52125 Relay server address: Last connection update: 7 minutes, 14 seconds ago Last WireGuard handshake: 57 seconds ago Transfer status (received/sent) 1.2 KiB/548 B Quantum resistance: false Networks: - Latency: 40.779699ms Events: [INFO] SYSTEM (3e5d42cf-25a8-47e0-8d0f-81243dc261af) Message: Network map updated Time: 14 minutes ago [INFO] SYSTEM (af50a3a6-09ce-4efe-be51-01ba91551e70) Message: Network map updated Time: 7 minutes, 31 seconds ago OS: linux/amd64 Daemon version: 0.39.2 CLI version: 0.39.2 Management: Connected to https://netbird.anon-dXkuP.domain:443 Signal: Connected to https://netbird.anon-dXkuP.domain:443 Relays: [stun:netbird.anon-dXkuP.domain:3478] is Available [turn:netbird.anon-dXkuP.domain:3478?transport=udp] is Available Nameservers: FQDN: lighthouse.net.anon-dXkuP.domain NetBird IP: 100.87.209.95/16 Interface type: Kernel Quantum resistance: false Networks: - Forwarding rules: 0 Peers count: 1/2 Connected ``` </details>
Author
Owner

@jvanbruegge commented on GitHub (Apr 3, 2025):

After downgrading the control plane to 0.36.6, the dashboard still shows no connected clients, but at least the devices themselves see each other again and seem (so far) to renew the connection every 3min:

Image

@jvanbruegge commented on GitHub (Apr 3, 2025): After downgrading the control plane to 0.36.6, the dashboard still shows no connected clients, but at least the devices themselves see each other again and seem (so far) to renew the connection every 3min: ![Image](https://github.com/user-attachments/assets/a36749de-cf2b-400a-b1d1-f6844f418b7d)
Author
Owner

@jvanbruegge commented on GitHub (Apr 3, 2025):

Ok, that was premature celebration, neither do the clients recognize that I added a 4th peer (nas), nor did all the peers keep their connection active. E.g. the lighthouse lost the connection to my server

@jvanbruegge commented on GitHub (Apr 3, 2025): Ok, that was premature celebration, neither do the clients recognize that I added a 4th peer (nas), nor did all the peers keep their connection active. E.g. the lighthouse lost the connection to my server
Author
Owner

@jvanbruegge commented on GitHub (Apr 3, 2025):

In the logs of the management server I see several lines like this:

Apr 03 11:45:31 lighthouse netbird-mgmt[36618]: 2025-04-03T11:45:31Z WARN [requestID: 4fbe8ecb-7766-43af-91bc-7f08e0668c02, accountID: UNKNOWN, peerID: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=, context: GRPC] management/server/grpcserver.go:486: failed logging in peer rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=: no peer auth method provided, please use a setup key or interactive SSO login
Apr 03 11:48:23 lighthouse netbird-mgmt[36618]: 2025-04-03T11:48:23Z INFO [context: HTTP, requestID: 416be715-d3c9-4123-9815-bb862487fda4] management/server/account.go:923: cache invalid. Users unknown to the cache: 1

That peer is the nas, which does use a setup key. However I don't see those messages after a restart of the management server

@jvanbruegge commented on GitHub (Apr 3, 2025): In the logs of the management server I see several lines like this: ``` Apr 03 11:45:31 lighthouse netbird-mgmt[36618]: 2025-04-03T11:45:31Z WARN [requestID: 4fbe8ecb-7766-43af-91bc-7f08e0668c02, accountID: UNKNOWN, peerID: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=, context: GRPC] management/server/grpcserver.go:486: failed logging in peer rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=: no peer auth method provided, please use a setup key or interactive SSO login Apr 03 11:48:23 lighthouse netbird-mgmt[36618]: 2025-04-03T11:48:23Z INFO [context: HTTP, requestID: 416be715-d3c9-4123-9815-bb862487fda4] management/server/account.go:923: cache invalid. Users unknown to the cache: 1 ``` That peer is the nas, which *does* use a setup key. However I don't see those messages after a restart of the management server
Author
Owner

@jvanbruegge commented on GitHub (Apr 3, 2025):

The netbird client on lighthouse (so on the same machine as the control plane) is spamming this in the logs:

Apr 03 12:12:49 lighthouse netbird[40605]: 2025-04-03T12:12:49Z INFO [peer: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=] client/internal/peer/conn.go:293: OnRemoteOffer, on status ICE: Disconnected, status Relay: Disconnected
Apr 03 12:12:49 lighthouse netbird[40605]: 2025-04-03T12:12:49Z INFO [peer: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=] client/internal/peer/handshaker.go:170: sending answer
Apr 03 12:12:49 lighthouse netbird[40605]: 2025-04-03T12:12:49Z INFO [peer: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=] client/internal/peer/handshaker.go:91: received connection confirmation, running version 0.36.6 and with remote WireGuard listen port 51820
Apr 03 12:12:49 lighthouse netbird[40605]: 2025-04-03T12:12:49Z INFO [peer: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=] client/internal/peer/handshaker.go:79: wait for remote offer confirmation
Apr 03 12:12:49 lighthouse netbird[40605]: 2025-04-03T12:12:49Z INFO [peer: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=] client/internal/peer/worker_relay.go:50: Relay is not supported by remote peer

(this is now with the control plane back at 0.39.2)

@jvanbruegge commented on GitHub (Apr 3, 2025): The netbird client on lighthouse (so on the same machine as the control plane) is spamming this in the logs: ``` Apr 03 12:12:49 lighthouse netbird[40605]: 2025-04-03T12:12:49Z INFO [peer: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=] client/internal/peer/conn.go:293: OnRemoteOffer, on status ICE: Disconnected, status Relay: Disconnected Apr 03 12:12:49 lighthouse netbird[40605]: 2025-04-03T12:12:49Z INFO [peer: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=] client/internal/peer/handshaker.go:170: sending answer Apr 03 12:12:49 lighthouse netbird[40605]: 2025-04-03T12:12:49Z INFO [peer: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=] client/internal/peer/handshaker.go:91: received connection confirmation, running version 0.36.6 and with remote WireGuard listen port 51820 Apr 03 12:12:49 lighthouse netbird[40605]: 2025-04-03T12:12:49Z INFO [peer: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=] client/internal/peer/handshaker.go:79: wait for remote offer confirmation Apr 03 12:12:49 lighthouse netbird[40605]: 2025-04-03T12:12:49Z INFO [peer: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=] client/internal/peer/worker_relay.go:50: Relay is not supported by remote peer ``` (this is now with the control plane back at 0.39.2)
Author
Owner

@jvanbruegge commented on GitHub (Apr 3, 2025):

Some time later, some kind of summary:

Apr 03 12:18:26 lighthouse netbird[40605]: 2025-04-03T12:18:26Z INFO [peer: dAxu2MPs/FsKQULsbr0GATkD8lc1zkZezQbwoc2r6jc=] client/internal/peer/state_dump.go:79: Dump stat: Status: Disconnected, SentOffer: 2, RemoteOffer: 18, RemoteAnswer: 0, RemoteCandidate: 0, P2PConnected: 0, SwitchToRelay: 0, WGCheckSuccess: 0, RelayConnected: 0, LocalProxies: 0
Apr 03 12:18:26 lighthouse netbird[40605]: 2025-04-03T12:18:26Z INFO [peer: reDwTNz+GV2pO/FiPWOVM/cyyw2Z4Cz84GsY/V9X5m0=] client/internal/peer/state_dump.go:79: Dump stat: Status: Disconnected, SentOffer: 2, RemoteOffer: 19, RemoteAnswer: 0, RemoteCandidate: 0, P2PConnected: 0, SwitchToRelay: 0, WGCheckSuccess: 0, RelayConnected: 0, LocalProxies: 0
Apr 03 12:18:26 lighthouse netbird[40605]: 2025-04-03T12:18:26Z INFO [peer: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=] client/internal/peer/state_dump.go:79: Dump stat: Status: Disconnected, SentOffer: 2, RemoteOffer: 19, RemoteAnswer: 0, RemoteCandidate: 0, P2PConnected: 0, SwitchToRelay: 0, WGCheckSuccess: 0, RelayConnected: 0, LocalProxies: 0
Apr 03 12:18:26 lighthouse netbird[40605]: 2025-04-03T12:18:26Z INFO [peer: OyaccKy8y/+itamr2Y9EGJ/iU4PCBuQtgDxdSVGHXHE=] client/internal/peer/state_dump.go:79: Dump stat: Status: Disconnected, SentOffer: 25, RemoteOffer: 0, RemoteAnswer: 0, RemoteCandidate: 0, P2PConnected: 0, SwitchToRelay: 0, WGCheckSuccess: 0, RelayConnected: 0, LocalProxies: 0
@jvanbruegge commented on GitHub (Apr 3, 2025): Some time later, some kind of summary: ``` Apr 03 12:18:26 lighthouse netbird[40605]: 2025-04-03T12:18:26Z INFO [peer: dAxu2MPs/FsKQULsbr0GATkD8lc1zkZezQbwoc2r6jc=] client/internal/peer/state_dump.go:79: Dump stat: Status: Disconnected, SentOffer: 2, RemoteOffer: 18, RemoteAnswer: 0, RemoteCandidate: 0, P2PConnected: 0, SwitchToRelay: 0, WGCheckSuccess: 0, RelayConnected: 0, LocalProxies: 0 Apr 03 12:18:26 lighthouse netbird[40605]: 2025-04-03T12:18:26Z INFO [peer: reDwTNz+GV2pO/FiPWOVM/cyyw2Z4Cz84GsY/V9X5m0=] client/internal/peer/state_dump.go:79: Dump stat: Status: Disconnected, SentOffer: 2, RemoteOffer: 19, RemoteAnswer: 0, RemoteCandidate: 0, P2PConnected: 0, SwitchToRelay: 0, WGCheckSuccess: 0, RelayConnected: 0, LocalProxies: 0 Apr 03 12:18:26 lighthouse netbird[40605]: 2025-04-03T12:18:26Z INFO [peer: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=] client/internal/peer/state_dump.go:79: Dump stat: Status: Disconnected, SentOffer: 2, RemoteOffer: 19, RemoteAnswer: 0, RemoteCandidate: 0, P2PConnected: 0, SwitchToRelay: 0, WGCheckSuccess: 0, RelayConnected: 0, LocalProxies: 0 Apr 03 12:18:26 lighthouse netbird[40605]: 2025-04-03T12:18:26Z INFO [peer: OyaccKy8y/+itamr2Y9EGJ/iU4PCBuQtgDxdSVGHXHE=] client/internal/peer/state_dump.go:79: Dump stat: Status: Disconnected, SentOffer: 25, RemoteOffer: 0, RemoteAnswer: 0, RemoteCandidate: 0, P2PConnected: 0, SwitchToRelay: 0, WGCheckSuccess: 0, RelayConnected: 0, LocalProxies: 0 ```
Author
Owner

@jvanbruegge commented on GitHub (Apr 4, 2025):

Again after a day, all the peers have lost connection

@jvanbruegge commented on GitHub (Apr 4, 2025): Again after a day, all the peers have lost connection
Author
Owner

@netandreus commented on GitHub (Apr 7, 2025):

Uff, man, how are things now?

@netandreus commented on GitHub (Apr 7, 2025): Uff, man, how are things now?
Author
Owner

@jvanbruegge commented on GitHub (Apr 7, 2025):

Basically the same, dashboard shows no connections, lighthouse and caladan are connected to each other, the laptop and nas are not connected to anyone.

@jvanbruegge commented on GitHub (Apr 7, 2025): Basically the same, dashboard shows no connections, lighthouse and caladan are connected to each other, the laptop and nas are not connected to anyone.
Author
Owner

@jvanbruegge commented on GitHub (Apr 7, 2025):

I am bit lost on how to debug this or what the issue might be, it used to work so well before the update

@jvanbruegge commented on GitHub (Apr 7, 2025): I am bit lost on how to debug this or what the issue might be, it used to work so well before the update
Author
Owner

@jvanbruegge commented on GitHub (Apr 7, 2025):

On my laptop the log consists of just this (this is with one netbird down && netbird up)

Apr 07 10:32:07 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:07+01:00 INFO client/cmd/service_controller.go:24: starting Netbird service
Apr 07 10:32:07 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:07+01:00 INFO client/cmd/service_controller.go:68: started daemon server: /var/run/netbird/sock
Apr 07 10:32:07 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:07+01:00 INFO client/internal/connect.go:122: starting NetBird client version 0.39.2 on linux/amd64
Apr 07 10:32:07 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:07+01:00 INFO util/net/env_linux.go:70: system supports advanced routing
Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO client/iface/wgproxy/ebpf/proxy.go:91: local wg proxy listening on: 3128
Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO client/iface/wgproxy/factory_kernel.go:29: WireGuard Proxy Factory will produce eBPF proxy
Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO client/internal/routemanager/manager.go:193: Routing setup complete
Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO client/firewall/create_linux.go:73: creating an nftables firewall manager
Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 WARN client/firewall/nftables/router_linux.go:854: Will use nftables to manipulate the filter table because iptables is not available: exec: "iptables": executable file not found in $PATH
Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 WARN client/firewall/nftables/router_linux.go:761: Will use nftables to manipulate the filter table because iptables is not available: exec: "iptables": executable file not found in $PATH
Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO client/internal/dns/host_unix.go:54: System DNS manager discovered: systemd
Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO signal/client/grpc.go:149: connected to the Signal Service stream
Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO client/internal/engine.go:1664: Network monitor is disabled, not starting
Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO client/internal/connect.go:281: Netbird engine started, the IP is: 100.87.209.245/16
Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO management/client/grpc.go:156: connected to the Management Service stream
Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO relay/client/manager.go:223: update relay server URLs: []
Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO client/internal/acl/manager.go:66: ACL rules processed in: 1.575717ms, total rules count: 1
Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO [peer: dAxu2MPs/FsKQULsbr0GATkD8lc1zkZezQbwoc2r6jc=] client/internal/peer/handshaker.go:79: wait for remote offer confirmation
Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO [peer: YdQTtZHGPxawpEUB5tLD76drQSDgIcCFUPAE1B/4lyQ=] client/internal/peer/handshaker.go:79: wait for remote offer confirmation
Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO [peer: OyaccKy8y/+itamr2Y9EGJ/iU4PCBuQtgDxdSVGHXHE=] client/internal/peer/handshaker.go:79: wait for remote offer confirmation
Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO [peer: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=] client/internal/peer/handshaker.go:79: wait for remote offer confirmation
Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO [peer: reDwTNz+GV2pO/FiPWOVM/cyyw2Z4Cz84GsY/V9X5m0=] client/internal/peer/handshaker.go:79: wait for remote offer confirmation
Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO client/internal/dns/systemd_linux.go:149: adding 2 search domains and 0 match domains. Search list: [net.cerberus-systems.de 87.100.in-addr.arpa] , Match list: []
Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO [peer: reDwTNz+GV2pO/FiPWOVM/cyyw2Z4Cz84GsY/V9X5m0=] client/internal/peer/guard/guard.go:132: start listen for reconnect events...
Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO [peer: dAxu2MPs/FsKQULsbr0GATkD8lc1zkZezQbwoc2r6jc=] client/internal/peer/guard/guard.go:132: start listen for reconnect events...
Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO [peer: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=] client/internal/peer/guard/guard.go:132: start listen for reconnect events...
Apr 07 10:32:09 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:09+01:00 INFO [peer: YdQTtZHGPxawpEUB5tLD76drQSDgIcCFUPAE1B/4lyQ=] client/internal/peer/guard/guard.go:132: start listen for reconnect events...
Apr 07 10:32:09 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:09+01:00 INFO [peer: OyaccKy8y/+itamr2Y9EGJ/iU4PCBuQtgDxdSVGHXHE=] client/internal/peer/guard/guard.go:132: start listen for reconnect events...
Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO client/internal/engine.go:269: Network monitor: stopped
Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO client/internal/dns/systemd_linux.go:170: reverting link settings and flushing cache
Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: dAxu2MPs/FsKQULsbr0GATkD8lc1zkZezQbwoc2r6jc=] client/internal/peer/handshaker.go:84: exit from handshaker
Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: reDwTNz+GV2pO/FiPWOVM/cyyw2Z4Cz84GsY/V9X5m0=] client/internal/peer/handshaker.go:84: exit from handshaker
Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: OyaccKy8y/+itamr2Y9EGJ/iU4PCBuQtgDxdSVGHXHE=] client/internal/peer/handshaker.go:84: exit from handshaker
Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: YdQTtZHGPxawpEUB5tLD76drQSDgIcCFUPAE1B/4lyQ=] client/internal/peer/handshaker.go:84: exit from handshaker
Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=] client/internal/peer/handshaker.go:84: exit from handshaker
Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO client/internal/routemanager/manager.go:258: Routing cleanup complete
Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: dAxu2MPs/FsKQULsbr0GATkD8lc1zkZezQbwoc2r6jc=] client/internal/peer/conn.go:218: close peer connection
Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: dAxu2MPs/FsKQULsbr0GATkD8lc1zkZezQbwoc2r6jc=] client/internal/peer/conn.go:257: peer connection has been closed
Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: YdQTtZHGPxawpEUB5tLD76drQSDgIcCFUPAE1B/4lyQ=] client/internal/peer/conn.go:218: close peer connection
Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: YdQTtZHGPxawpEUB5tLD76drQSDgIcCFUPAE1B/4lyQ=] client/internal/peer/conn.go:257: peer connection has been closed
Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: OyaccKy8y/+itamr2Y9EGJ/iU4PCBuQtgDxdSVGHXHE=] client/internal/peer/conn.go:218: close peer connection
Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: OyaccKy8y/+itamr2Y9EGJ/iU4PCBuQtgDxdSVGHXHE=] client/internal/peer/conn.go:257: peer connection has been closed
Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=] client/internal/peer/conn.go:218: close peer connection
Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=] client/internal/peer/conn.go:257: peer connection has been closed
Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: reDwTNz+GV2pO/FiPWOVM/cyyw2Z4Cz84GsY/V9X5m0=] client/internal/peer/conn.go:218: close peer connection
Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: reDwTNz+GV2pO/FiPWOVM/cyyw2Z4Cz84GsY/V9X5m0=] client/internal/peer/conn.go:257: peer connection has been closed
Apr 07 10:33:20 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:20+01:00 ERRO client/iface/bind/udp_mux_universal.go:97: error while reading packet: shared socked stopped
Apr 07 10:33:20 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:20+01:00 INFO client/iface/iface.go:229: interface wt0 has been removed
Apr 07 10:33:20 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:20+01:00 WARN client/firewall/nftables/router_linux.go:854: Will use nftables to manipulate the filter table because iptables is not available: exec: "iptables": executable file not found in $PATH
Apr 07 10:33:20 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:20+01:00 INFO client/internal/engine.go:320: stopped Netbird Engine
Apr 07 10:33:20 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:20+01:00 INFO client/server/server.go:666: service is down
Apr 07 10:33:20 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:20+01:00 INFO client/internal/connect.go:305: stopped NetBird client
Apr 07 10:33:22 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:22+01:00 INFO client/internal/connect.go:122: starting NetBird client version 0.39.2 on linux/amd64
Apr 07 10:33:22 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:22+01:00 INFO util/net/env_linux.go:70: system supports advanced routing
Apr 07 10:33:22 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:22+01:00 INFO client/iface/wgproxy/ebpf/proxy.go:91: local wg proxy listening on: 3128
Apr 07 10:33:22 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:22+01:00 INFO client/iface/wgproxy/factory_kernel.go:29: WireGuard Proxy Factory will produce eBPF proxy
Apr 07 10:33:22 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:22+01:00 INFO client/internal/routemanager/manager.go:193: Routing setup complete
Apr 07 10:33:22 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:22+01:00 INFO client/firewall/create_linux.go:73: creating an nftables firewall manager
Apr 07 10:33:22 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:22+01:00 WARN client/firewall/nftables/router_linux.go:854: Will use nftables to manipulate the filter table because iptables is not available: exec: "iptables": executable file not found in $PATH
Apr 07 10:33:22 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:22+01:00 WARN client/firewall/nftables/router_linux.go:761: Will use nftables to manipulate the filter table because iptables is not available: exec: "iptables": executable file not found in $PATH
Apr 07 10:33:22 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:22+01:00 INFO client/internal/dns/host_unix.go:54: System DNS manager discovered: systemd
Apr 07 10:33:22 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:22+01:00 INFO signal/client/grpc.go:149: connected to the Signal Service stream
Apr 07 10:33:22 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:22+01:00 INFO client/internal/engine.go:1664: Network monitor is disabled, not starting
Apr 07 10:33:22 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:22+01:00 INFO client/internal/connect.go:281: Netbird engine started, the IP is: 100.87.209.245/16
Apr 07 10:33:22 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:22+01:00 INFO management/client/grpc.go:156: connected to the Management Service stream
Apr 07 10:33:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:23+01:00 INFO relay/client/manager.go:223: update relay server URLs: []
Apr 07 10:33:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:23+01:00 INFO client/internal/acl/manager.go:66: ACL rules processed in: 1.443284ms, total rules count: 1
Apr 07 10:33:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:23+01:00 INFO [peer: dAxu2MPs/FsKQULsbr0GATkD8lc1zkZezQbwoc2r6jc=] client/internal/peer/handshaker.go:79: wait for remote offer confirmation
Apr 07 10:33:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:23+01:00 INFO [peer: YdQTtZHGPxawpEUB5tLD76drQSDgIcCFUPAE1B/4lyQ=] client/internal/peer/handshaker.go:79: wait for remote offer confirmation
Apr 07 10:33:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:23+01:00 INFO [peer: OyaccKy8y/+itamr2Y9EGJ/iU4PCBuQtgDxdSVGHXHE=] client/internal/peer/handshaker.go:79: wait for remote offer confirmation
Apr 07 10:33:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:23+01:00 INFO [peer: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=] client/internal/peer/handshaker.go:79: wait for remote offer confirmation
Apr 07 10:33:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:23+01:00 INFO [peer: reDwTNz+GV2pO/FiPWOVM/cyyw2Z4Cz84GsY/V9X5m0=] client/internal/peer/handshaker.go:79: wait for remote offer confirmation
Apr 07 10:33:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:23+01:00 INFO client/internal/dns/systemd_linux.go:149: adding 2 search domains and 0 match domains. Search list: [net.cerberus-systems.de 87.100.in-addr.arpa] , Match list: []
Apr 07 10:33:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:23+01:00 INFO [peer: OyaccKy8y/+itamr2Y9EGJ/iU4PCBuQtgDxdSVGHXHE=] client/internal/peer/guard/guard.go:132: start listen for reconnect events...
Apr 07 10:33:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:23+01:00 INFO [peer: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=] client/internal/peer/guard/guard.go:132: start listen for reconnect events...
Apr 07 10:33:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:23+01:00 INFO [peer: reDwTNz+GV2pO/FiPWOVM/cyyw2Z4Cz84GsY/V9X5m0=] client/internal/peer/guard/guard.go:132: start listen for reconnect events...
Apr 07 10:33:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:23+01:00 INFO [peer: dAxu2MPs/FsKQULsbr0GATkD8lc1zkZezQbwoc2r6jc=] client/internal/peer/guard/guard.go:132: start listen for reconnect events...
Apr 07 10:33:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:23+01:00 INFO [peer: YdQTtZHGPxawpEUB5tLD76drQSDgIcCFUPAE1B/4lyQ=] client/internal/peer/guard/guard.go:132: start listen for reconnect events...
Apr 07 10:43:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:43:23+01:00 INFO [peer: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=] client/internal/peer/state_dump.go:79: Dump stat: Status: Disconnected, SentOffer: 2, RemoteOffer: 0, RemoteAnswer: 0, RemoteCandidate: 0, P2PConnected: 0, SwitchToRelay: 0, WGCheckSuccess: 0, RelayConnected: 0, LocalProxies: 0
Apr 07 10:43:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:43:23+01:00 INFO [peer: YdQTtZHGPxawpEUB5tLD76drQSDgIcCFUPAE1B/4lyQ=] client/internal/peer/state_dump.go:79: Dump stat: Status: Disconnected, SentOffer: 2, RemoteOffer: 0, RemoteAnswer: 0, RemoteCandidate: 0, P2PConnected: 0, SwitchToRelay: 0, WGCheckSuccess: 0, RelayConnected: 0, LocalProxies: 0
Apr 07 10:43:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:43:23+01:00 INFO [peer: dAxu2MPs/FsKQULsbr0GATkD8lc1zkZezQbwoc2r6jc=] client/internal/peer/state_dump.go:79: Dump stat: Status: Disconnected, SentOffer: 2, RemoteOffer: 0, RemoteAnswer: 0, RemoteCandidate: 0, P2PConnected: 0, SwitchToRelay: 0, WGCheckSuccess: 0, RelayConnected: 0, LocalProxies: 0
Apr 07 10:43:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:43:23+01:00 INFO [peer: reDwTNz+GV2pO/FiPWOVM/cyyw2Z4Cz84GsY/V9X5m0=] client/internal/peer/state_dump.go:79: Dump stat: Status: Disconnected, SentOffer: 2, RemoteOffer: 0, RemoteAnswer: 0, RemoteCandidate: 0, P2PConnected: 0, SwitchToRelay: 0, WGCheckSuccess: 0, RelayConnected: 0, LocalProxies: 0
Apr 07 10:43:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:43:23+01:00 INFO [peer: OyaccKy8y/+itamr2Y9EGJ/iU4PCBuQtgDxdSVGHXHE=] client/internal/peer/state_dump.go:79: Dump stat: Status: Disconnected, SentOffer: 2, RemoteOffer: 0, RemoteAnswer: 0, RemoteCandidate: 0, P2PConnected: 0, SwitchToRelay: 0, WGCheckSuccess: 0, RelayConnected: 0, LocalProxies: 0

Is it a problem that I do not have the new netbird relay deployed but only coturn?

@jvanbruegge commented on GitHub (Apr 7, 2025): On my laptop the log consists of just this (this is with one `netbird down && netbird up`) ``` Apr 07 10:32:07 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:07+01:00 INFO client/cmd/service_controller.go:24: starting Netbird service Apr 07 10:32:07 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:07+01:00 INFO client/cmd/service_controller.go:68: started daemon server: /var/run/netbird/sock Apr 07 10:32:07 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:07+01:00 INFO client/internal/connect.go:122: starting NetBird client version 0.39.2 on linux/amd64 Apr 07 10:32:07 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:07+01:00 INFO util/net/env_linux.go:70: system supports advanced routing Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO client/iface/wgproxy/ebpf/proxy.go:91: local wg proxy listening on: 3128 Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO client/iface/wgproxy/factory_kernel.go:29: WireGuard Proxy Factory will produce eBPF proxy Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO client/internal/routemanager/manager.go:193: Routing setup complete Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO client/firewall/create_linux.go:73: creating an nftables firewall manager Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 WARN client/firewall/nftables/router_linux.go:854: Will use nftables to manipulate the filter table because iptables is not available: exec: "iptables": executable file not found in $PATH Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 WARN client/firewall/nftables/router_linux.go:761: Will use nftables to manipulate the filter table because iptables is not available: exec: "iptables": executable file not found in $PATH Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO client/internal/dns/host_unix.go:54: System DNS manager discovered: systemd Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO signal/client/grpc.go:149: connected to the Signal Service stream Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO client/internal/engine.go:1664: Network monitor is disabled, not starting Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO client/internal/connect.go:281: Netbird engine started, the IP is: 100.87.209.245/16 Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO management/client/grpc.go:156: connected to the Management Service stream Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO relay/client/manager.go:223: update relay server URLs: [] Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO client/internal/acl/manager.go:66: ACL rules processed in: 1.575717ms, total rules count: 1 Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO [peer: dAxu2MPs/FsKQULsbr0GATkD8lc1zkZezQbwoc2r6jc=] client/internal/peer/handshaker.go:79: wait for remote offer confirmation Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO [peer: YdQTtZHGPxawpEUB5tLD76drQSDgIcCFUPAE1B/4lyQ=] client/internal/peer/handshaker.go:79: wait for remote offer confirmation Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO [peer: OyaccKy8y/+itamr2Y9EGJ/iU4PCBuQtgDxdSVGHXHE=] client/internal/peer/handshaker.go:79: wait for remote offer confirmation Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO [peer: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=] client/internal/peer/handshaker.go:79: wait for remote offer confirmation Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO [peer: reDwTNz+GV2pO/FiPWOVM/cyyw2Z4Cz84GsY/V9X5m0=] client/internal/peer/handshaker.go:79: wait for remote offer confirmation Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO client/internal/dns/systemd_linux.go:149: adding 2 search domains and 0 match domains. Search list: [net.cerberus-systems.de 87.100.in-addr.arpa] , Match list: [] Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO [peer: reDwTNz+GV2pO/FiPWOVM/cyyw2Z4Cz84GsY/V9X5m0=] client/internal/peer/guard/guard.go:132: start listen for reconnect events... Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO [peer: dAxu2MPs/FsKQULsbr0GATkD8lc1zkZezQbwoc2r6jc=] client/internal/peer/guard/guard.go:132: start listen for reconnect events... Apr 07 10:32:08 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:08+01:00 INFO [peer: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=] client/internal/peer/guard/guard.go:132: start listen for reconnect events... Apr 07 10:32:09 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:09+01:00 INFO [peer: YdQTtZHGPxawpEUB5tLD76drQSDgIcCFUPAE1B/4lyQ=] client/internal/peer/guard/guard.go:132: start listen for reconnect events... Apr 07 10:32:09 hwlap0036-macs netbird[4741]: 2025-04-07T10:32:09+01:00 INFO [peer: OyaccKy8y/+itamr2Y9EGJ/iU4PCBuQtgDxdSVGHXHE=] client/internal/peer/guard/guard.go:132: start listen for reconnect events... Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO client/internal/engine.go:269: Network monitor: stopped Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO client/internal/dns/systemd_linux.go:170: reverting link settings and flushing cache Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: dAxu2MPs/FsKQULsbr0GATkD8lc1zkZezQbwoc2r6jc=] client/internal/peer/handshaker.go:84: exit from handshaker Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: reDwTNz+GV2pO/FiPWOVM/cyyw2Z4Cz84GsY/V9X5m0=] client/internal/peer/handshaker.go:84: exit from handshaker Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: OyaccKy8y/+itamr2Y9EGJ/iU4PCBuQtgDxdSVGHXHE=] client/internal/peer/handshaker.go:84: exit from handshaker Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: YdQTtZHGPxawpEUB5tLD76drQSDgIcCFUPAE1B/4lyQ=] client/internal/peer/handshaker.go:84: exit from handshaker Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=] client/internal/peer/handshaker.go:84: exit from handshaker Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO client/internal/routemanager/manager.go:258: Routing cleanup complete Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: dAxu2MPs/FsKQULsbr0GATkD8lc1zkZezQbwoc2r6jc=] client/internal/peer/conn.go:218: close peer connection Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: dAxu2MPs/FsKQULsbr0GATkD8lc1zkZezQbwoc2r6jc=] client/internal/peer/conn.go:257: peer connection has been closed Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: YdQTtZHGPxawpEUB5tLD76drQSDgIcCFUPAE1B/4lyQ=] client/internal/peer/conn.go:218: close peer connection Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: YdQTtZHGPxawpEUB5tLD76drQSDgIcCFUPAE1B/4lyQ=] client/internal/peer/conn.go:257: peer connection has been closed Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: OyaccKy8y/+itamr2Y9EGJ/iU4PCBuQtgDxdSVGHXHE=] client/internal/peer/conn.go:218: close peer connection Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: OyaccKy8y/+itamr2Y9EGJ/iU4PCBuQtgDxdSVGHXHE=] client/internal/peer/conn.go:257: peer connection has been closed Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=] client/internal/peer/conn.go:218: close peer connection Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=] client/internal/peer/conn.go:257: peer connection has been closed Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: reDwTNz+GV2pO/FiPWOVM/cyyw2Z4Cz84GsY/V9X5m0=] client/internal/peer/conn.go:218: close peer connection Apr 07 10:33:19 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:19+01:00 INFO [peer: reDwTNz+GV2pO/FiPWOVM/cyyw2Z4Cz84GsY/V9X5m0=] client/internal/peer/conn.go:257: peer connection has been closed Apr 07 10:33:20 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:20+01:00 ERRO client/iface/bind/udp_mux_universal.go:97: error while reading packet: shared socked stopped Apr 07 10:33:20 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:20+01:00 INFO client/iface/iface.go:229: interface wt0 has been removed Apr 07 10:33:20 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:20+01:00 WARN client/firewall/nftables/router_linux.go:854: Will use nftables to manipulate the filter table because iptables is not available: exec: "iptables": executable file not found in $PATH Apr 07 10:33:20 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:20+01:00 INFO client/internal/engine.go:320: stopped Netbird Engine Apr 07 10:33:20 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:20+01:00 INFO client/server/server.go:666: service is down Apr 07 10:33:20 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:20+01:00 INFO client/internal/connect.go:305: stopped NetBird client Apr 07 10:33:22 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:22+01:00 INFO client/internal/connect.go:122: starting NetBird client version 0.39.2 on linux/amd64 Apr 07 10:33:22 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:22+01:00 INFO util/net/env_linux.go:70: system supports advanced routing Apr 07 10:33:22 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:22+01:00 INFO client/iface/wgproxy/ebpf/proxy.go:91: local wg proxy listening on: 3128 Apr 07 10:33:22 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:22+01:00 INFO client/iface/wgproxy/factory_kernel.go:29: WireGuard Proxy Factory will produce eBPF proxy Apr 07 10:33:22 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:22+01:00 INFO client/internal/routemanager/manager.go:193: Routing setup complete Apr 07 10:33:22 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:22+01:00 INFO client/firewall/create_linux.go:73: creating an nftables firewall manager Apr 07 10:33:22 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:22+01:00 WARN client/firewall/nftables/router_linux.go:854: Will use nftables to manipulate the filter table because iptables is not available: exec: "iptables": executable file not found in $PATH Apr 07 10:33:22 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:22+01:00 WARN client/firewall/nftables/router_linux.go:761: Will use nftables to manipulate the filter table because iptables is not available: exec: "iptables": executable file not found in $PATH Apr 07 10:33:22 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:22+01:00 INFO client/internal/dns/host_unix.go:54: System DNS manager discovered: systemd Apr 07 10:33:22 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:22+01:00 INFO signal/client/grpc.go:149: connected to the Signal Service stream Apr 07 10:33:22 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:22+01:00 INFO client/internal/engine.go:1664: Network monitor is disabled, not starting Apr 07 10:33:22 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:22+01:00 INFO client/internal/connect.go:281: Netbird engine started, the IP is: 100.87.209.245/16 Apr 07 10:33:22 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:22+01:00 INFO management/client/grpc.go:156: connected to the Management Service stream Apr 07 10:33:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:23+01:00 INFO relay/client/manager.go:223: update relay server URLs: [] Apr 07 10:33:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:23+01:00 INFO client/internal/acl/manager.go:66: ACL rules processed in: 1.443284ms, total rules count: 1 Apr 07 10:33:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:23+01:00 INFO [peer: dAxu2MPs/FsKQULsbr0GATkD8lc1zkZezQbwoc2r6jc=] client/internal/peer/handshaker.go:79: wait for remote offer confirmation Apr 07 10:33:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:23+01:00 INFO [peer: YdQTtZHGPxawpEUB5tLD76drQSDgIcCFUPAE1B/4lyQ=] client/internal/peer/handshaker.go:79: wait for remote offer confirmation Apr 07 10:33:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:23+01:00 INFO [peer: OyaccKy8y/+itamr2Y9EGJ/iU4PCBuQtgDxdSVGHXHE=] client/internal/peer/handshaker.go:79: wait for remote offer confirmation Apr 07 10:33:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:23+01:00 INFO [peer: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=] client/internal/peer/handshaker.go:79: wait for remote offer confirmation Apr 07 10:33:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:23+01:00 INFO [peer: reDwTNz+GV2pO/FiPWOVM/cyyw2Z4Cz84GsY/V9X5m0=] client/internal/peer/handshaker.go:79: wait for remote offer confirmation Apr 07 10:33:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:23+01:00 INFO client/internal/dns/systemd_linux.go:149: adding 2 search domains and 0 match domains. Search list: [net.cerberus-systems.de 87.100.in-addr.arpa] , Match list: [] Apr 07 10:33:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:23+01:00 INFO [peer: OyaccKy8y/+itamr2Y9EGJ/iU4PCBuQtgDxdSVGHXHE=] client/internal/peer/guard/guard.go:132: start listen for reconnect events... Apr 07 10:33:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:23+01:00 INFO [peer: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=] client/internal/peer/guard/guard.go:132: start listen for reconnect events... Apr 07 10:33:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:23+01:00 INFO [peer: reDwTNz+GV2pO/FiPWOVM/cyyw2Z4Cz84GsY/V9X5m0=] client/internal/peer/guard/guard.go:132: start listen for reconnect events... Apr 07 10:33:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:23+01:00 INFO [peer: dAxu2MPs/FsKQULsbr0GATkD8lc1zkZezQbwoc2r6jc=] client/internal/peer/guard/guard.go:132: start listen for reconnect events... Apr 07 10:33:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:33:23+01:00 INFO [peer: YdQTtZHGPxawpEUB5tLD76drQSDgIcCFUPAE1B/4lyQ=] client/internal/peer/guard/guard.go:132: start listen for reconnect events... Apr 07 10:43:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:43:23+01:00 INFO [peer: rW2aDGhEim1Aw9jM4nYhmEBY7DCJL2QwH8+fxkO0Ilk=] client/internal/peer/state_dump.go:79: Dump stat: Status: Disconnected, SentOffer: 2, RemoteOffer: 0, RemoteAnswer: 0, RemoteCandidate: 0, P2PConnected: 0, SwitchToRelay: 0, WGCheckSuccess: 0, RelayConnected: 0, LocalProxies: 0 Apr 07 10:43:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:43:23+01:00 INFO [peer: YdQTtZHGPxawpEUB5tLD76drQSDgIcCFUPAE1B/4lyQ=] client/internal/peer/state_dump.go:79: Dump stat: Status: Disconnected, SentOffer: 2, RemoteOffer: 0, RemoteAnswer: 0, RemoteCandidate: 0, P2PConnected: 0, SwitchToRelay: 0, WGCheckSuccess: 0, RelayConnected: 0, LocalProxies: 0 Apr 07 10:43:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:43:23+01:00 INFO [peer: dAxu2MPs/FsKQULsbr0GATkD8lc1zkZezQbwoc2r6jc=] client/internal/peer/state_dump.go:79: Dump stat: Status: Disconnected, SentOffer: 2, RemoteOffer: 0, RemoteAnswer: 0, RemoteCandidate: 0, P2PConnected: 0, SwitchToRelay: 0, WGCheckSuccess: 0, RelayConnected: 0, LocalProxies: 0 Apr 07 10:43:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:43:23+01:00 INFO [peer: reDwTNz+GV2pO/FiPWOVM/cyyw2Z4Cz84GsY/V9X5m0=] client/internal/peer/state_dump.go:79: Dump stat: Status: Disconnected, SentOffer: 2, RemoteOffer: 0, RemoteAnswer: 0, RemoteCandidate: 0, P2PConnected: 0, SwitchToRelay: 0, WGCheckSuccess: 0, RelayConnected: 0, LocalProxies: 0 Apr 07 10:43:23 hwlap0036-macs netbird[4741]: 2025-04-07T10:43:23+01:00 INFO [peer: OyaccKy8y/+itamr2Y9EGJ/iU4PCBuQtgDxdSVGHXHE=] client/internal/peer/state_dump.go:79: Dump stat: Status: Disconnected, SentOffer: 2, RemoteOffer: 0, RemoteAnswer: 0, RemoteCandidate: 0, P2PConnected: 0, SwitchToRelay: 0, WGCheckSuccess: 0, RelayConnected: 0, LocalProxies: 0 ``` Is it a problem that I do not have the new netbird relay deployed but only coturn?
Author
Owner

@jvanbruegge commented on GitHub (Apr 7, 2025):

Looks like for some reason the peers are not responding to the offer, but I don't know what the reason might be

@jvanbruegge commented on GitHub (Apr 7, 2025): Looks like for some reason the peers are not responding to the offer, but I don't know what the reason might be
Author
Owner

@jvanbruegge commented on GitHub (Apr 9, 2025):

Even weirder, the wireguard connection (at least to lighthouse from my laptop) is up and running:

$ sudo wg
interface: wt0
  public key: EwaPVWEt/GzXZtvN9iRnEUDTPLxKkuRtDYqLoRZOTCc=
  private key: (hidden)
  listening port: 51820
  fwmark: 0x1bd00

peer: YdQTtZHGPxawpEUB5tLD76drQSDgIcCFUPAE1B/4lyQ=
  endpoint: 5.189.142.109:51820
  allowed ips: 100.87.209.95/32
  latest handshake: 1 minute, 48 seconds ago
  transfer: 22.77 KiB received, 43.62 KiB sent
  persistent keepalive: every 25 seconds

peer: WmtoAp7Gk4BOTLwNxfbhA51VlreDvbdGhPUB0QBSuSc=
  endpoint: 127.0.0.1:1
  allowed ips: 100.87.250.6/32
  latest handshake: 1 day, 18 hours, 49 minutes, 22 seconds ago
  transfer: 700 B received, 411.29 KiB sent
  persistent keepalive: every 25 seconds

however, netbird does not see lighthouse as connected:

lighthouse.net.cerberus-systems.de:
  NetBird IP: 100.87.209.95
  Public key: YdQTtZHGPxawpEUB5tLD76drQSDgIcCFUPAE1B/4lyQ=
  Status: Disconnected
  -- detail --
  Connection type: 
  ICE candidate (Local/Remote): -/-
  ICE candidate endpoints (Local/Remote): -/-
  Relay server address: 
  Last connection update: 1 day, 3 hours ago
  Last WireGuard handshake: -
  Transfer status (received/sent) 0 B/0 B
  Quantum resistance: false
  Networks: -
  Latency: 20.994703ms
@jvanbruegge commented on GitHub (Apr 9, 2025): Even weirder, the wireguard connection (at least to lighthouse from my laptop) is up and running: ``` $ sudo wg interface: wt0 public key: EwaPVWEt/GzXZtvN9iRnEUDTPLxKkuRtDYqLoRZOTCc= private key: (hidden) listening port: 51820 fwmark: 0x1bd00 peer: YdQTtZHGPxawpEUB5tLD76drQSDgIcCFUPAE1B/4lyQ= endpoint: 5.189.142.109:51820 allowed ips: 100.87.209.95/32 latest handshake: 1 minute, 48 seconds ago transfer: 22.77 KiB received, 43.62 KiB sent persistent keepalive: every 25 seconds peer: WmtoAp7Gk4BOTLwNxfbhA51VlreDvbdGhPUB0QBSuSc= endpoint: 127.0.0.1:1 allowed ips: 100.87.250.6/32 latest handshake: 1 day, 18 hours, 49 minutes, 22 seconds ago transfer: 700 B received, 411.29 KiB sent persistent keepalive: every 25 seconds ``` however, netbird does not see lighthouse as connected: ``` lighthouse.net.cerberus-systems.de: NetBird IP: 100.87.209.95 Public key: YdQTtZHGPxawpEUB5tLD76drQSDgIcCFUPAE1B/4lyQ= Status: Disconnected -- detail -- Connection type: ICE candidate (Local/Remote): -/- ICE candidate endpoints (Local/Remote): -/- Relay server address: Last connection update: 1 day, 3 hours ago Last WireGuard handshake: - Transfer status (received/sent) 0 B/0 B Quantum resistance: false Networks: - Latency: 20.994703ms ```
Author
Owner

@jvanbruegge commented on GitHub (May 8, 2025):

Ok, after updating to 0.4.3.1 this issue has disappeared, at least the nodes do not loose their connection any more and the dashboard shows all clients

@jvanbruegge commented on GitHub (May 8, 2025): Ok, after updating to 0.4.3.1 this issue has disappeared, at least the nodes do not loose their connection any more and the dashboard shows all clients
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: SVI/netbird#1778