Can't access Admin Panel once connected for a while. #1396

Closed
opened 2025-11-20 05:29:38 -05:00 by saavagebueno · 0 comments
Owner

Originally created by @tens0rcat on GitHub (Nov 4, 2024).

Describe the problem

Unable to get to the management node after being connected for some random amount of time.

To Reproduce

Connect, then select Admin Panel from the system tray menu or try to ssh to it from a client.

Expected behavior

Connects

Are you using NetBird Cloud?

self hosted

NetBird version

31.0

NetBird status -dA output:

***** NOTE THERE IS A PEER MISSING FROM THIS ****

Peers detail:
netbird-1.netbird.selfhosted:
NetBird IP: 100.84.30.201
Public key: PM6ADQ+y0+POLVjW9ciFr/mhS7uYYb6OY/uEzt4bFFs=
Status: Connected
-- detail --
Connection type: P2P
ICE candidate (Local/Remote): host/prflx
ICE candidate endpoints (Local/Remote): 10.10.10.5:51820/10.10.10.152:51820
Relay server address: rels://netbird.anon-P65kw.domain:443
Last connection update: 23 minutes, 45 seconds ago
Last WireGuard handshake: 44 seconds ago
Transfer status (received/sent) 1.8 KiB/2.6 KiB
Quantum resistance: false
Routes: 10.10.10.0/24
Latency: 1.512479ms

octarine.netbird.selfhosted:
NetBird IP: 100.84.89.219
Public key: xPpXXGHQyPyT53JaiwsyWgTwkw5iEbq6BtHUXkq6gxg=
Status: Connected
-- detail --
Connection type: Relayed
ICE candidate (Local/Remote): -/-
ICE candidate endpoints (Local/Remote): -/-
Relay server address: rels://netbird.anon-P65kw.domain:443
Last connection update: 16 minutes, 58 seconds ago
Last WireGuard handshake: 36 seconds ago
Transfer status (received/sent) 174.3 KiB/129.0 KiB
Quantum resistance: false
Routes: -
Latency: 0s

netbird-2.netbird.selfhosted:
NetBird IP: 100.84.166.142
Public key: TzbfhhsR7F0qCZbVD2JEmbpP7KxY8eWXClC2u7pHkxQ=
Status: Connected
-- detail --
Connection type: P2P
ICE candidate (Local/Remote): host/host
ICE candidate endpoints (Local/Remote): 10.10.10.5:51820/192.168.101.10:51820
Relay server address: rels://netbird.anon-P65kw.domain:443
Last connection update: 1 hour, 35 minutes ago
Last WireGuard handshake: 28 seconds ago
Transfer status (received/sent) 14.6 KiB/4.2 KiB
Quantum resistance: false
Routes: -
Latency: 8.361693ms

msc.netbird.selfhosted:
NetBird IP: 100.84.172.252
Public key: 3eqCotdtrFz4OZNEAigG0vHaxlFMuJlF5Z2D/XdIEFk=
Status: Disconnected
-- detail --
Connection type:
ICE candidate (Local/Remote): -/-
ICE candidate endpoints (Local/Remote): -/-
Relay server address:
Last connection update: -
Last WireGuard handshake: -
Transfer status (received/sent) 0 B/0 B
Quantum resistance: false
Routes: -
Latency: 0s

OS: linux/amd64
Daemon version: 0.31.0
CLI version: 0.31.0
Management: Connected to https://netbird.anon-P65kw.domain:443
Signal: Connected to https://netbird.anon-P65kw.domain:443
Relays:
[stun:netbird.anon-P65kw.domain:3478] is Available
[turn:netbird.anon-P65kw.domain:3478?transport=udp] is Available
[rels://netbird.anon-P65kw.domain:443] is Available
Nameservers:
[10.10.10.8:53, 10.10.10.7:53] for [anon-P65kw.domain] is Available
FQDN: netbird.netbird.selfhosted
NetBird IP: 100.84.78.46/16
Interface type: Kernel
Quantum resistance: false
Routes: -
Peers count: 3/4 Connected

Additional context

Immediately after connection it works, then it stops a few minutes later. I can get it it via ssh with the netbird IP, but that doesn't work for https maybe because it's running behind HAProxy, but again, it works for a few minutes (but exactly how long is very random, like between not at all and 30 mins)

I have noticed that on the admin panel it shows that the client is disconnected, but the client shows that it is connected.

Tried this from an additional machine, same issue but it's weirder and random. It'll show the node offline and the second node online on one, and the opposite from the other. then both online, then both offline, then .... it's just random. I've tried 29.4->31.0 clients. all the same

reverting back to the 29.4 server and 29.4 clients seems to resolve the issue. I'm going to test this more, then upgrade everything to latest with the same config that is working. Then start adding users and see where it breaks.

Updated a client to 31.0, working fine and is significantly faster. Upgrading server to latest.

Server updated, everything still working. I guess I messed something up in my original install. Closing.

Originally created by @tens0rcat on GitHub (Nov 4, 2024). **Describe the problem** Unable to get to the management node after being connected for some random amount of time. **To Reproduce** Connect, then select Admin Panel from the system tray menu or try to ssh to it from a client. **Expected behavior** Connects **Are you using NetBird Cloud?** self hosted **NetBird version** 31.0 **NetBird status -dA output:** ***** NOTE THERE IS A PEER MISSING FROM THIS **** Peers detail: netbird-1.netbird.selfhosted: NetBird IP: 100.84.30.201 Public key: PM6ADQ+y0+POLVjW9ciFr/mhS7uYYb6OY/uEzt4bFFs= Status: Connected -- detail -- Connection type: P2P ICE candidate (Local/Remote): host/prflx ICE candidate endpoints (Local/Remote): 10.10.10.5:51820/10.10.10.152:51820 Relay server address: rels://netbird.anon-P65kw.domain:443 Last connection update: 23 minutes, 45 seconds ago Last WireGuard handshake: 44 seconds ago Transfer status (received/sent) 1.8 KiB/2.6 KiB Quantum resistance: false Routes: 10.10.10.0/24 Latency: 1.512479ms octarine.netbird.selfhosted: NetBird IP: 100.84.89.219 Public key: xPpXXGHQyPyT53JaiwsyWgTwkw5iEbq6BtHUXkq6gxg= Status: Connected -- detail -- Connection type: Relayed ICE candidate (Local/Remote): -/- ICE candidate endpoints (Local/Remote): -/- Relay server address: rels://netbird.anon-P65kw.domain:443 Last connection update: 16 minutes, 58 seconds ago Last WireGuard handshake: 36 seconds ago Transfer status (received/sent) 174.3 KiB/129.0 KiB Quantum resistance: false Routes: - Latency: 0s netbird-2.netbird.selfhosted: NetBird IP: 100.84.166.142 Public key: TzbfhhsR7F0qCZbVD2JEmbpP7KxY8eWXClC2u7pHkxQ= Status: Connected -- detail -- Connection type: P2P ICE candidate (Local/Remote): host/host ICE candidate endpoints (Local/Remote): 10.10.10.5:51820/192.168.101.10:51820 Relay server address: rels://netbird.anon-P65kw.domain:443 Last connection update: 1 hour, 35 minutes ago Last WireGuard handshake: 28 seconds ago Transfer status (received/sent) 14.6 KiB/4.2 KiB Quantum resistance: false Routes: - Latency: 8.361693ms msc.netbird.selfhosted: NetBird IP: 100.84.172.252 Public key: 3eqCotdtrFz4OZNEAigG0vHaxlFMuJlF5Z2D/XdIEFk= Status: Disconnected -- detail -- Connection type: ICE candidate (Local/Remote): -/- ICE candidate endpoints (Local/Remote): -/- Relay server address: Last connection update: - Last WireGuard handshake: - Transfer status (received/sent) 0 B/0 B Quantum resistance: false Routes: - Latency: 0s OS: linux/amd64 Daemon version: 0.31.0 CLI version: 0.31.0 Management: Connected to https://netbird.anon-P65kw.domain:443 Signal: Connected to https://netbird.anon-P65kw.domain:443 Relays: [stun:netbird.anon-P65kw.domain:3478] is Available [turn:netbird.anon-P65kw.domain:3478?transport=udp] is Available [rels://netbird.anon-P65kw.domain:443] is Available Nameservers: [10.10.10.8:53, 10.10.10.7:53] for [anon-P65kw.domain] is Available FQDN: netbird.netbird.selfhosted NetBird IP: 100.84.78.46/16 Interface type: Kernel Quantum resistance: false Routes: - Peers count: 3/4 Connected **Additional context** Immediately after connection it works, then it stops a few minutes later. I can get it it via ssh with the netbird IP, but that doesn't work for https maybe because it's running behind HAProxy, but again, it works for a few minutes (but exactly how long is very random, like between not at all and 30 mins) I have noticed that on the admin panel it shows that the client is disconnected, but the client shows that it is connected. Tried this from an additional machine, same issue but it's weirder and random. It'll show the node offline and the second node online on one, and the opposite from the other. then both online, then both offline, then .... it's just random. I've tried 29.4->31.0 clients. all the same reverting back to the 29.4 server and 29.4 clients seems to resolve the issue. I'm going to test this more, then upgrade everything to latest with the same config that is working. Then start adding users and see where it breaks. Updated a client to 31.0, working fine and is significantly faster. Upgrading server to latest. Server updated, everything still working. I guess I messed something up in my original install. Closing.
saavagebueno added the triage-needed label 2025-11-20 05:29:38 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: SVI/netbird#1396