[GH-ISSUE #3224] Routes/DNS entries missing after client updates #6623

Open
opened 2026-08-05 01:09:16 -04:00 by saavagebueno · 9 comments
Owner

Originally created by @roberthase on GitHub (Jan 22, 2025).
Original GitHub issue: https://github.com/netbirdio/netbird/issues/3224

Problem after updating windows clients to 0.35.2 and the following versions up to 0.36.3:

Clients can connect to the controller but routes and dns entries in the local regristry get deleted right after creation.

Restarting or disconnecting/connecting or updating/reinstalling the client do not help.

To resolve this issue, clients have to be deleted in the controller and readded.
Other reports from my colleagues indicate that deleting and readding the group of the peer in the controller can also help resolve this.

Self hosted controller version 0.36.3
Clients are added with setup-keys.

We have about 500 devices running netbird and so far 1-2% of all devices seems to be affected, when we roll out updates.

Originally created by @roberthase on GitHub (Jan 22, 2025). Original GitHub issue: https://github.com/netbirdio/netbird/issues/3224 Problem after updating windows clients to 0.35.2 and the following versions up to 0.36.3: Clients can connect to the controller but routes and dns entries in the local regristry get deleted right after creation. Restarting or disconnecting/connecting or updating/reinstalling the client do not help. To resolve this issue, clients have to be deleted in the controller and readded. Other reports from my colleagues indicate that deleting and readding the group of the peer in the controller can also help resolve this. Self hosted controller version 0.36.3 Clients are added with setup-keys. We have about 500 devices running netbird and so far 1-2% of all devices seems to be affected, when we roll out updates.
saavagebueno added the triage-needed label 2026-08-05 01:09:16 -04:00
Author
Owner

@lixmal commented on GitHub (Jan 23, 2025):

Hi @roberthase,

what does netbird status -dA look like on an affected device? The debug bundle would also be helpful, at least the network_map.json from the archive.

netbird debug for 1m -AS
<!-- gh-comment-id:2609631017 --> @lixmal commented on GitHub (Jan 23, 2025): Hi @roberthase, what does `netbird status -dA` look like on an affected device? The debug bundle would also be helpful, at least the `network_map.json` from the archive. ``` netbird debug for 1m -AS ```
Author
Owner

@roberthase commented on GitHub (Jan 24, 2025):

Hi @lixmal

here is the netbird status -dA output. The ip-adress of the local interface seems off. Is netbird using the wrong interface/route for the wireguard tunnel?

After fixing it, it show the correct local-ip of our branch network.

C:\Users\Administrator>netbird status -dA
Peers detail:
svvi-netbird02.anon-MlAgN.domain:
NetBird IP: 100.103.156.130
Public key: EwQvkLLAbpizZkvLRYUR3b2Xl52l4HKXfIOb0Lz5jCA=
Status: Connected
-- detail --
Connection type: P2P
ICE candidate (Local/Remote): host/prflx
ICE candidate endpoints (Local/Remote): 127.0.0.1:51820/10.201.0.187:58976
Relay server address:
Last connection update: 2 minutes, 15 seconds ago
Last WireGuard handshake: -
Transfer status (received/sent) 0 B/3.9 KiB
Quantum resistance: false
Routes: 10.1.0.0/24, 10.10.31.201/32, 10.10.31.202/32, 10.201.0.0/24, 10.5.0.0/24
Networks: 10.1.0.0/24, 10.10.31.201/32, 10.10.31.202/32, 10.201.0.0/24, 10.5.0.0/24
Latency: 4.6836ms

svvi-netbird03.anon-MlAgN.domain:
NetBird IP: 100.103.193.163
Public key: G6R0dIowqLql+rJ2+RUHcALi4kfpgoKYsOTO+RsmuyI=
Status: Connected
-- detail --
Connection type: Relayed
ICE candidate (Local/Remote): host/relay
ICE candidate endpoints (Local/Remote): 127.0.0.1:51820/198.51.100.0:58030
Relay server address:
Last connection update: 2 minutes, 13 seconds ago
Last WireGuard handshake: 13 seconds ago
Transfer status (received/sent) 4.6 KiB/680 B
Quantum resistance: false
Routes: -
Networks: -
Latency: 6.8562ms

OS: windows/amd64
Daemon version: 0.36.3
CLI version: 0.36.3
Management: Connected to https://netbird.anon-c1NgS.domain:33073
Signal: Connected to http://netbird.anon-c1NgS.domain:10000
Relays:
[stun:netbird.anon-c1NgS.domain:3478] is Available
[turn:netbird.anon-c1NgS.domain:3478?transport=udp] is Available
Nameservers:
[10.201.0.10:53, 10.201.0.11:53] for [anon-MlAgN.domain, anon-ru7CX.domain, anon-h7sUo.domain, wiki.anon-c1NgS.domain, vault.anon-c1NgS.domain] is Unavailable, reason: read udp 100.103.240.253:63630->10.201.0.11:53: i/o timeout
FQDN: nb120-09.anon-MlAgN.domain
NetBird IP: 100.103.240.253/16
Interface type: Userspace
Quantum resistance: false
Routes: -
Networks: -
Peers count: 2/2 Connected

the network-map is kinda large, so i excluded custom zones:

{
"Serial": "822",
"peerConfig": {
"address": "100.103.240.253/16",
"dns": "",
"sshConfig": {
"sshEnabled": false,
"sshPubKey": ""
},
"fqdn": "nb120-09.anon-Eq3hK.domain",
"RoutingPeerDnsResolutionEnabled": false
},
"remotePeers": [
{
"wgPubKey": "EwQvkLLAbpizZkvLRYUR3b2Xl52l4HKXfIOb0Lz5jCA=",
"allowedIps": [
"100.103.156.130/32"
],
"sshConfig": {
"sshEnabled": false,
"sshPubKey": "c3NoLXBsYWNlaG9sZGVyLWtleQ=="
},
"fqdn": "svvi-netbird02.anon-Eq3hK.domain"
},
{
"wgPubKey": "G6R0dIowqLql+rJ2+RUHcALi4kfpgoKYsOTO+RsmuyI=",
"allowedIps": [
"100.103.193.163/32"
],
"sshConfig": {
"sshEnabled": false,
"sshPubKey": "c3NoLXBsYWNlaG9sZGVyLWtleQ=="
},
"fqdn": "svvi-netbird03.anon-Eq3hK.domain"
}
],
"remotePeersIsEmpty": false,
"Routes": [
{
"ID": "cqc2meo9eivs73d80rig",
"Network": "10.1.0.0/24",
"NetworkType": "1",
"Peer": "EwQvkLLAbpizZkvLRYUR3b2Xl52l4HKXfIOb0Lz5jCA=",
"Metric": "9999",
"Masquerade": true,
"NetID": "only anon-7VJPJ.domain vlan1",
"Domains": [],
"keepRoute": false
},
{
"ID": "cq63bm09eivs73d80rg0",
"Network": "10.201.0.0/24",
"NetworkType": "1",
"Peer": "EwQvkLLAbpizZkvLRYUR3b2Xl52l4HKXfIOb0Lz5jCA=",
"Metric": "9999",
"Masquerade": true,
"NetID": "only verbund",
"Domains": [],
"keepRoute": false
},
{
"ID": "cqc30eg9eivs73d80rj0",
"Network": "10.5.0.0/24",
"NetworkType": "1",
"Peer": "EwQvkLLAbpizZkvLRYUR3b2Xl52l4HKXfIOb0Lz5jCA=",
"Metric": "9999",
"Masquerade": true,
"NetID": "only 10.5.0.0/24",
"Domains": [],
"keepRoute": false
},
{
"ID": "crumclo9eivs73fen59g",
"Network": "10.10.31.201/32",
"NetworkType": "1",
"Peer": "EwQvkLLAbpizZkvLRYUR3b2Xl52l4HKXfIOb0Lz5jCA=",
"Metric": "9999",
"Masquerade": true,
"NetID": "nashv.anon-Eq3hK.domain",
"Domains": [],
"keepRoute": false
},
{
"ID": "cu0f9m09eivs738amfcg:cp4daohd612c738e2oc0",
"Network": "10.10.31.202/32",
"NetworkType": "1",
"Peer": "EwQvkLLAbpizZkvLRYUR3b2Xl52l4HKXfIOb0Lz5jCA=",
"Metric": "9999",
"Masquerade": true,
"NetID": "only nas-uk.anon-Eq3hK.domain",
"Domains": [],
"keepRoute": false
},
{
"ID": "cu0f9m09eivs738amfcg:cs3dp109eivs73ben250",
"Network": "10.10.31.202/32",
"NetworkType": "1",
"Peer": "G6R0dIowqLql+rJ2+RUHcALi4kfpgoKYsOTO+RsmuyI=",
"Metric": "9999",
"Masquerade": true,
"NetID": "only nas-uk.anon-Eq3hK.domain",
"Domains": [],
"keepRoute": false
},
{
"ID": "cs3dqq09eivs73ben26g",
"Network": "10.1.0.0/24",
"NetworkType": "1",
"Peer": "G6R0dIowqLql+rJ2+RUHcALi4kfpgoKYsOTO+RsmuyI=",
"Metric": "9999",
"Masquerade": true,
"NetID": "only anon-7VJPJ.domain vlan1",
"Domains": [],
"keepRoute": false
},
{
"ID": "cs3dr289eivs73ben27g",
"Network": "10.10.31.201/32",
"NetworkType": "1",
"Peer": "G6R0dIowqLql+rJ2+RUHcALi4kfpgoKYsOTO+RsmuyI=",
"Metric": "9999",
"Masquerade": true,
"NetID": "nashv.anon-Eq3hK.domain",
"Domains": [],
"keepRoute": false
},
{
"ID": "cs3dqj09eivs73ben260",
"Network": "10.201.0.0/24",
"NetworkType": "1",
"Peer": "G6R0dIowqLql+rJ2+RUHcALi4kfpgoKYsOTO+RsmuyI=",
"Metric": "9999",
"Masquerade": true,
"NetID": "only verbund",
"Domains": [],
"keepRoute": false
},
{
"ID": "cs3dqug9eivs73ben270",
"Network": "10.5.0.0/24",
"NetworkType": "1",
"Peer": "G6R0dIowqLql+rJ2+RUHcALi4kfpgoKYsOTO+RsmuyI=",
"Metric": "9999",
"Masquerade": true,
"NetID": "only 10.5.0.0/24",
"Domains": [],
"keepRoute": false
}
],
"DNSConfig": {
"ServiceEnable": true,
"NameServerGroups": [
{
"NameServers": [
{
"IP": "10.201.0.10",
"NSType": "1",
"Port": "53"
},
{
"IP": "10.201.0.11",
"NSType": "1",
"Port": "53"
}
],
"Primary": false,
"Domains": [
"anon-Eq3hK.domain",
"anon-7VJPJ.domain",
"anon-qX3Zb.domain",
"wiki.anon-txtgr.domain",
"vault.anon-txtgr.domain"
],
"SearchDomainsEnabled": true
}
],
"CustomZones": [

      }
    ]
  }
]

},
"offlinePeers": [],
"FirewallRules": [
{
"PeerIP": "100.103.156.130",
"Direction": "IN",
"Action": "ACCEPT",
"Protocol": "ALL",
"Port": ""
},
{
"PeerIP": "100.103.193.163",
"Direction": "IN",
"Action": "ACCEPT",
"Protocol": "ALL",
"Port": ""
},
{
"PeerIP": "100.103.156.130",
"Direction": "OUT",
"Action": "ACCEPT",
"Protocol": "ALL",
"Port": ""
},
{
"PeerIP": "100.103.193.163",
"Direction": "OUT",
"Action": "ACCEPT",
"Protocol": "ALL",
"Port": ""
}
],
"firewallRulesIsEmpty": false,
"routesFirewallRules": [],
"routesFirewallRulesIsEmpty": true
}

<!-- gh-comment-id:2611904165 --> @roberthase commented on GitHub (Jan 24, 2025): Hi @lixmal here is the netbird status -dA output. The ip-adress of the local interface seems off. Is netbird using the wrong interface/route for the wireguard tunnel? After fixing it, it show the correct local-ip of our branch network. C:\Users\Administrator>netbird status -dA Peers detail: svvi-netbird02.anon-MlAgN.domain: NetBird IP: 100.103.156.130 Public key: EwQvkLLAbpizZkvLRYUR3b2Xl52l4HKXfIOb0Lz5jCA= Status: Connected -- detail -- Connection type: P2P ICE candidate (Local/Remote): host/prflx **ICE candidate endpoints (Local/Remote): 127.0.0.1:51820/10.201.0.187:58976** Relay server address: Last connection update: 2 minutes, 15 seconds ago Last WireGuard handshake: - Transfer status (received/sent) 0 B/3.9 KiB Quantum resistance: false Routes: 10.1.0.0/24, 10.10.31.201/32, 10.10.31.202/32, 10.201.0.0/24, 10.5.0.0/24 Networks: 10.1.0.0/24, 10.10.31.201/32, 10.10.31.202/32, 10.201.0.0/24, 10.5.0.0/24 Latency: 4.6836ms svvi-netbird03.anon-MlAgN.domain: NetBird IP: 100.103.193.163 Public key: G6R0dIowqLql+rJ2+RUHcALi4kfpgoKYsOTO+RsmuyI= Status: Connected -- detail -- Connection type: Relayed ICE candidate (Local/Remote): host/relay ICE candidate endpoints (Local/Remote): 127.0.0.1:51820/198.51.100.0:58030 Relay server address: Last connection update: 2 minutes, 13 seconds ago Last WireGuard handshake: 13 seconds ago Transfer status (received/sent) 4.6 KiB/680 B Quantum resistance: false Routes: - Networks: - Latency: 6.8562ms OS: windows/amd64 Daemon version: 0.36.3 CLI version: 0.36.3 Management: Connected to https://netbird.anon-c1NgS.domain:33073 Signal: Connected to http://netbird.anon-c1NgS.domain:10000 Relays: [stun:netbird.anon-c1NgS.domain:3478] is Available [turn:netbird.anon-c1NgS.domain:3478?transport=udp] is Available Nameservers: [10.201.0.10:53, 10.201.0.11:53] for [anon-MlAgN.domain, anon-ru7CX.domain, anon-h7sUo.domain, wiki.anon-c1NgS.domain, vault.anon-c1NgS.domain] is Unavailable, reason: read udp 100.103.240.253:63630->10.201.0.11:53: i/o timeout FQDN: nb120-09.anon-MlAgN.domain NetBird IP: 100.103.240.253/16 Interface type: Userspace Quantum resistance: false Routes: - Networks: - Peers count: 2/2 Connected the network-map is kinda large, so i excluded custom zones: { "Serial": "822", "peerConfig": { "address": "100.103.240.253/16", "dns": "", "sshConfig": { "sshEnabled": false, "sshPubKey": "" }, "fqdn": "nb120-09.anon-Eq3hK.domain", "RoutingPeerDnsResolutionEnabled": false }, "remotePeers": [ { "wgPubKey": "EwQvkLLAbpizZkvLRYUR3b2Xl52l4HKXfIOb0Lz5jCA=", "allowedIps": [ "100.103.156.130/32" ], "sshConfig": { "sshEnabled": false, "sshPubKey": "c3NoLXBsYWNlaG9sZGVyLWtleQ==" }, "fqdn": "svvi-netbird02.anon-Eq3hK.domain" }, { "wgPubKey": "G6R0dIowqLql+rJ2+RUHcALi4kfpgoKYsOTO+RsmuyI=", "allowedIps": [ "100.103.193.163/32" ], "sshConfig": { "sshEnabled": false, "sshPubKey": "c3NoLXBsYWNlaG9sZGVyLWtleQ==" }, "fqdn": "svvi-netbird03.anon-Eq3hK.domain" } ], "remotePeersIsEmpty": false, "Routes": [ { "ID": "cqc2meo9eivs73d80rig", "Network": "10.1.0.0/24", "NetworkType": "1", "Peer": "EwQvkLLAbpizZkvLRYUR3b2Xl52l4HKXfIOb0Lz5jCA=", "Metric": "9999", "Masquerade": true, "NetID": "only anon-7VJPJ.domain vlan1", "Domains": [], "keepRoute": false }, { "ID": "cq63bm09eivs73d80rg0", "Network": "10.201.0.0/24", "NetworkType": "1", "Peer": "EwQvkLLAbpizZkvLRYUR3b2Xl52l4HKXfIOb0Lz5jCA=", "Metric": "9999", "Masquerade": true, "NetID": "only verbund", "Domains": [], "keepRoute": false }, { "ID": "cqc30eg9eivs73d80rj0", "Network": "10.5.0.0/24", "NetworkType": "1", "Peer": "EwQvkLLAbpizZkvLRYUR3b2Xl52l4HKXfIOb0Lz5jCA=", "Metric": "9999", "Masquerade": true, "NetID": "only 10.5.0.0/24", "Domains": [], "keepRoute": false }, { "ID": "crumclo9eivs73fen59g", "Network": "10.10.31.201/32", "NetworkType": "1", "Peer": "EwQvkLLAbpizZkvLRYUR3b2Xl52l4HKXfIOb0Lz5jCA=", "Metric": "9999", "Masquerade": true, "NetID": "nashv.anon-Eq3hK.domain", "Domains": [], "keepRoute": false }, { "ID": "cu0f9m09eivs738amfcg:cp4daohd612c738e2oc0", "Network": "10.10.31.202/32", "NetworkType": "1", "Peer": "EwQvkLLAbpizZkvLRYUR3b2Xl52l4HKXfIOb0Lz5jCA=", "Metric": "9999", "Masquerade": true, "NetID": "only nas-uk.anon-Eq3hK.domain", "Domains": [], "keepRoute": false }, { "ID": "cu0f9m09eivs738amfcg:cs3dp109eivs73ben250", "Network": "10.10.31.202/32", "NetworkType": "1", "Peer": "G6R0dIowqLql+rJ2+RUHcALi4kfpgoKYsOTO+RsmuyI=", "Metric": "9999", "Masquerade": true, "NetID": "only nas-uk.anon-Eq3hK.domain", "Domains": [], "keepRoute": false }, { "ID": "cs3dqq09eivs73ben26g", "Network": "10.1.0.0/24", "NetworkType": "1", "Peer": "G6R0dIowqLql+rJ2+RUHcALi4kfpgoKYsOTO+RsmuyI=", "Metric": "9999", "Masquerade": true, "NetID": "only anon-7VJPJ.domain vlan1", "Domains": [], "keepRoute": false }, { "ID": "cs3dr289eivs73ben27g", "Network": "10.10.31.201/32", "NetworkType": "1", "Peer": "G6R0dIowqLql+rJ2+RUHcALi4kfpgoKYsOTO+RsmuyI=", "Metric": "9999", "Masquerade": true, "NetID": "nashv.anon-Eq3hK.domain", "Domains": [], "keepRoute": false }, { "ID": "cs3dqj09eivs73ben260", "Network": "10.201.0.0/24", "NetworkType": "1", "Peer": "G6R0dIowqLql+rJ2+RUHcALi4kfpgoKYsOTO+RsmuyI=", "Metric": "9999", "Masquerade": true, "NetID": "only verbund", "Domains": [], "keepRoute": false }, { "ID": "cs3dqug9eivs73ben270", "Network": "10.5.0.0/24", "NetworkType": "1", "Peer": "G6R0dIowqLql+rJ2+RUHcALi4kfpgoKYsOTO+RsmuyI=", "Metric": "9999", "Masquerade": true, "NetID": "only 10.5.0.0/24", "Domains": [], "keepRoute": false } ], "DNSConfig": { "ServiceEnable": true, "NameServerGroups": [ { "NameServers": [ { "IP": "10.201.0.10", "NSType": "1", "Port": "53" }, { "IP": "10.201.0.11", "NSType": "1", "Port": "53" } ], "Primary": false, "Domains": [ "anon-Eq3hK.domain", "anon-7VJPJ.domain", "anon-qX3Zb.domain", "wiki.anon-txtgr.domain", "vault.anon-txtgr.domain" ], "SearchDomainsEnabled": true } ], "CustomZones": [ } ] } ] }, "offlinePeers": [], "FirewallRules": [ { "PeerIP": "100.103.156.130", "Direction": "IN", "Action": "ACCEPT", "Protocol": "ALL", "Port": "" }, { "PeerIP": "100.103.193.163", "Direction": "IN", "Action": "ACCEPT", "Protocol": "ALL", "Port": "" }, { "PeerIP": "100.103.156.130", "Direction": "OUT", "Action": "ACCEPT", "Protocol": "ALL", "Port": "" }, { "PeerIP": "100.103.193.163", "Direction": "OUT", "Action": "ACCEPT", "Protocol": "ALL", "Port": "" } ], "firewallRulesIsEmpty": false, "routesFirewallRules": [], "routesFirewallRulesIsEmpty": true }
Author
Owner

@roberthase commented on GitHub (Feb 4, 2025):

To follow up on the issue, which is still affecting multiple devices a day:

When running netbird status --detail on a broken device - ice candidate endpoints local is the same ip as my controller.
When running netbird status --detail on a working device - ice candidate endpoints local is the ip of the local lan/wlan interface.

Moving a peer out of the group and into the group fixes this issue immidiatly.

<!-- gh-comment-id:2634361365 --> @roberthase commented on GitHub (Feb 4, 2025): To follow up on the issue, which is still affecting multiple devices a day: When running netbird status --detail on a broken device - ice candidate endpoints local is the same ip as my controller. When running netbird status --detail on a working device - ice candidate endpoints local is the ip of the local lan/wlan interface. Moving a peer out of the group and into the group fixes this issue immidiatly.
Author
Owner

@roberthase commented on GitHub (Feb 4, 2025):

Seems to be the same as #3121

<!-- gh-comment-id:2634884330 --> @roberthase commented on GitHub (Feb 4, 2025): Seems to be the same as #3121
Author
Owner

@lixmal commented on GitHub (Feb 6, 2025):

https://github.com/netbirdio/netbird/issues/3121 should be relay-only. From your description, it doesn't seem to be relayed in your case.

Could you provide the debug bundle so we can debug this further? The network map is fine

<!-- gh-comment-id:2640578339 --> @lixmal commented on GitHub (Feb 6, 2025): https://github.com/netbirdio/netbird/issues/3121 should be relay-only. From your description, it doesn't seem to be relayed in your case. Could you provide the debug bundle so we can debug this further? The network map is fine
Author
Owner

@roberthase commented on GitHub (Feb 6, 2025):

are you sure, even though the last wireguard handshake is not available in netbird status -dA output?

edit: specifically: the handshake is established with a routing peer b, while routes are added to routing peer a with no handshake.

<!-- gh-comment-id:2640585054 --> @roberthase commented on GitHub (Feb 6, 2025): are you sure, even though the last wireguard handshake is not available in netbird status -dA output? edit: specifically: the handshake is established with a routing peer b, while routes are added to routing peer a with no handshake.
Author
Owner

@lixmal commented on GitHub (Feb 6, 2025):

It's most likely something else. The relay issue manifests after a longer time, not ~2 minutes.
Although of course you're free to test once we have located the relay related issue.

<!-- gh-comment-id:2640593315 --> @lixmal commented on GitHub (Feb 6, 2025): It's most likely something else. The relay issue manifests after a longer time, not ~2 minutes. Although of course you're free to test once we have located the relay related issue.
Author
Owner

@roberthase commented on GitHub (Feb 10, 2025):

Hi lixmal,

took a while to get my hands on a debug bundle, as the folder can only be accessed with admin account.

I remoted into the machine with the netbird ip. So the connection between my peer and other one was fine.

Routing over routing-peers was still stuck at this moment.

In the management-controller: can networks and network routes co-exist in 0.36.3?

netbird.debug.3262389208.zip

<!-- gh-comment-id:2648398286 --> @roberthase commented on GitHub (Feb 10, 2025): Hi lixmal, took a while to get my hands on a debug bundle, as the folder can only be accessed with admin account. I remoted into the machine with the netbird ip. So the connection between my peer and other one was fine. Routing over routing-peers was still stuck at this moment. In the management-controller: can networks and network routes co-exist in 0.36.3? [netbird.debug.3262389208.zip](https://github.com/user-attachments/files/18736316/netbird.debug.3262389208.zip)
Author
Owner

@roberthase commented on GitHub (Feb 13, 2025):

Hi again,

Updated to 0.36.6 yesterday.

As of now this bug always seems to happen when our windows 11 devices go into standby.
When waking up from standby and the access of our network over the routing peers does not work, while the client is connected we have four potential fixes.

wait serveral minutes (this fixes the issue sometimes)
disconnecting and then connecting the client again (this fixes the issue sometimes)
moving the peer out and into the group (this fixes the issue most of the time)
removing the peer and adding it again with the setup-key (this fixes the issue everytime)

As of now there seems to be a chance of 5% of the problem happing again after waking up from standby.
We also have clients that never seem to be affected, while all have the same gpo applied to them.

Here is the netbird status -dA from a device from today:

svvi-netbird02 and svvi-netbird03 are our routing-peers
byod-test is my windows-machine. the connection between my device the problematic client was fine.

svvi-netbird02.anon-7kZGa.domain:
NetBird IP: 100.103.156.130
Public key: EwQvkLLAbpizZkvLRYUR3b2Xl52l4HKXfIOb0Lz5jCA=
Status: Connected
-- detail --
Connection type: Relayed
ICE candidate (Local/Remote): srflx/relay
ICE candidate endpoints (Local/Remote): 198.51.100.0:20536/198.51.100.1:59835
Relay server address:
Last connection update: 4 minutes, 42 seconds ago
Last WireGuard handshake: -
Transfer status (received/sent) 0 B/6.8 KiB
Quantum resistance: false
Routes: -
Networks: -
Latency: 35.3872ms

byod-test.anon-7kZGa.domain:
NetBird IP: 100.103.188.150
Public key: zXKsNIcjLBqktRvgptUmEl2+SLyQMrNUulEYIWwgyF4=
Status: Connected
-- detail --
Connection type: Relayed
ICE candidate (Local/Remote): relay/srflx
ICE candidate endpoints (Local/Remote): 198.51.100.1:65063/198.51.100.2:57081
Relay server address:
Last connection update: 1 minute, 55 seconds ago
Last WireGuard handshake: 1 minute, 45 seconds ago
Transfer status (received/sent) 821.3 KiB/4.1 MiB
Quantum resistance: false
Routes: -
Networks: -
Latency: 48.6705ms

svvi-netbird03.anon-7kZGa.domain:
NetBird IP: 100.103.193.163
Public key: G6R0dIowqLql+rJ2+RUHcALi4kfpgoKYsOTO+RsmuyI=
Status: Connected
-- detail --
Connection type: Relayed
ICE candidate (Local/Remote): srflx/relay
ICE candidate endpoints (Local/Remote): 198.51.100.0:20536/198.51.100.1:53743
Relay server address:
Last connection update: 4 minutes, 42 seconds ago
Last WireGuard handshake: -
Transfer status (received/sent) 0 B/7.9 KiB
Quantum resistance: false
Routes: 10.1.0.0/24, 10.10.31.201/32, 10.10.31.202/32, 10.201.0.0/24, 10.5.0.0/24
Networks: 10.1.0.0/24, 10.10.31.201/32, 10.10.31.202/32, 10.201.0.0/24, 10.5.0.0/24
Latency: 50.2562ms

OS: windows/amd64
Daemon version: 0.36.6
CLI version: 0.36.6
Management: Connected to https://netbird.anon-9dvhh.domain:33073
Signal: Connected to http://netbird.anon-9dvhh.domain:10000
Relays:
[stun:netbird.anon-9dvhh.domain:3478] is Available
[turn:netbird.anon-9dvhh.domain:3478?transport=udp] is Available
Nameservers:
[10.201.0.10:53, 10.201.0.11:53] for [anon-7kZGa.domain, anon-B1tT6.domain, anon-E8uYY.domain, wiki.anon-9dvhh.domain, vault.anon-9dvhh.domain] is Unavailable, reason: 2 errors occurred:
* read udp 192.168.1.169:53556->10.201.0.11:53: i/o timeout
* read udp 192.168.1.169:53558->10.201.0.10:53: i/o timeout
FQDN: nb730-06.anon-7kZGa.domain
NetBird IP: 100.103.195.194/16
Interface type: Userspace
Quantum resistance: false
Routes: -
Networks: -
Peers count: 3/3 Connected

I added the netbird debug bundle again

netbird.debug.228244333.zip

<!-- gh-comment-id:2656588605 --> @roberthase commented on GitHub (Feb 13, 2025): Hi again, Updated to 0.36.6 yesterday. As of now this bug always seems to happen when our windows 11 devices go into standby. When waking up from standby and the access of our network over the routing peers does not work, while the client is connected we have four potential fixes. wait serveral minutes (this fixes the issue sometimes) disconnecting and then connecting the client again (this fixes the issue sometimes) moving the peer out and into the group (this fixes the issue most of the time) removing the peer and adding it again with the setup-key (this fixes the issue everytime) As of now there seems to be a chance of 5% of the problem happing again after waking up from standby. We also have clients that never seem to be affected, while all have the same gpo applied to them. Here is the netbird status -dA from a device from today: svvi-netbird02 and svvi-netbird03 are our routing-peers byod-test is my windows-machine. the connection between my device the problematic client was fine. svvi-netbird02.anon-7kZGa.domain: NetBird IP: 100.103.156.130 Public key: EwQvkLLAbpizZkvLRYUR3b2Xl52l4HKXfIOb0Lz5jCA= Status: Connected -- detail -- Connection type: Relayed ICE candidate (Local/Remote): srflx/relay ICE candidate endpoints (Local/Remote): 198.51.100.0:20536/198.51.100.1:59835 Relay server address: Last connection update: 4 minutes, 42 seconds ago Last WireGuard handshake: - Transfer status (received/sent) 0 B/6.8 KiB Quantum resistance: false Routes: - Networks: - Latency: 35.3872ms byod-test.anon-7kZGa.domain: NetBird IP: 100.103.188.150 Public key: zXKsNIcjLBqktRvgptUmEl2+SLyQMrNUulEYIWwgyF4= Status: Connected -- detail -- Connection type: Relayed ICE candidate (Local/Remote): relay/srflx ICE candidate endpoints (Local/Remote): 198.51.100.1:65063/198.51.100.2:57081 Relay server address: Last connection update: 1 minute, 55 seconds ago Last WireGuard handshake: 1 minute, 45 seconds ago Transfer status (received/sent) 821.3 KiB/4.1 MiB Quantum resistance: false Routes: - Networks: - Latency: 48.6705ms svvi-netbird03.anon-7kZGa.domain: NetBird IP: 100.103.193.163 Public key: G6R0dIowqLql+rJ2+RUHcALi4kfpgoKYsOTO+RsmuyI= Status: Connected -- detail -- Connection type: Relayed ICE candidate (Local/Remote): srflx/relay ICE candidate endpoints (Local/Remote): 198.51.100.0:20536/198.51.100.1:53743 Relay server address: Last connection update: 4 minutes, 42 seconds ago Last WireGuard handshake: - Transfer status (received/sent) 0 B/7.9 KiB Quantum resistance: false Routes: 10.1.0.0/24, 10.10.31.201/32, 10.10.31.202/32, 10.201.0.0/24, 10.5.0.0/24 Networks: 10.1.0.0/24, 10.10.31.201/32, 10.10.31.202/32, 10.201.0.0/24, 10.5.0.0/24 Latency: 50.2562ms OS: windows/amd64 Daemon version: 0.36.6 CLI version: 0.36.6 Management: Connected to https://netbird.anon-9dvhh.domain:33073 Signal: Connected to http://netbird.anon-9dvhh.domain:10000 Relays: [stun:netbird.anon-9dvhh.domain:3478] is Available [turn:netbird.anon-9dvhh.domain:3478?transport=udp] is Available Nameservers: [10.201.0.10:53, 10.201.0.11:53] for [anon-7kZGa.domain, anon-B1tT6.domain, anon-E8uYY.domain, wiki.anon-9dvhh.domain, vault.anon-9dvhh.domain] is Unavailable, reason: 2 errors occurred: * read udp 192.168.1.169:53556->10.201.0.11:53: i/o timeout * read udp 192.168.1.169:53558->10.201.0.10:53: i/o timeout FQDN: nb730-06.anon-7kZGa.domain NetBird IP: 100.103.195.194/16 Interface type: Userspace Quantum resistance: false Routes: - Networks: - Peers count: 3/3 Connected I added the netbird debug bundle again [netbird.debug.228244333.zip](https://github.com/user-attachments/files/18784414/netbird.debug.228244333.zip)
Sign in to join this conversation.
No Label triage-needed
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: DYNR/netbird#6623