SVI/netbird
1
0
Fork 0
mirror of https://github.com/netbirdio/netbird.git synced 2026-08-04 19:55:09 -04:00
Code Issues 3.0k Packages Projects Releases 10 Wiki Activity

Teltonika RutOS (OpenWRT derivative) having trouble connecting to management service #1216

New Issue
Open
opened 2025-11-20 05:26:08 -05:00 by saavagebueno · 5 comments
saavagebueno commented 2025-11-20 05:26:08 -05:00
Owner
Copy Link

Originally created by @nazarewk on GitHub (Sep 4, 2024).

solution is at https://github.com/netbirdio/netbird/issues/2530#issuecomment-2482245422

Describe the problem

TLDR;

  1. There is some weird (it almost works) issue with FWMARK handling by Netbird on RutOS.
  2. the other issue I had was https://github.com/netbirdio/netbird/issues/730#issuecomment-2329119310

This is an issue dedicated to my problems with stock software running on Teltonika RUTX50 router (runs RutOS - a derivative of older version of OpenWRT):

root@yelk:/tmp/log/netbird# cat client.log 
2024-09-02T20:49:48Z INFO client/cmd/service_controller.go:24: starting Netbird service
2024-09-02T20:49:48Z INFO client/cmd/service_controller.go:64: started daemon server: /var/run/netbird.sock
2024-09-02T20:49:48Z INFO client/internal/connect.go:119: starting NetBird client version 0.28.9 on linux/arm
2024-09-02T20:49:48Z ERRO util/grpc/dialer.go:38: Failed to dial: dial: dial tcp 35.186.199.111:443: connect: invalid argument
2024-09-02T20:49:49Z ERRO util/grpc/dialer.go:38: Failed to dial: dial: dial tcp 35.186.199.111:443: connect: invalid argument
2024-09-02T20:49:51Z ERRO util/grpc/dialer.go:38: Failed to dial: dial: dial tcp 35.186.199.111:443: connect: invalid argument
2024-09-02T20:49:54Z ERRO util/grpc/dialer.go:38: Failed to dial: dial: dial tcp 35.186.199.111:443: connect: invalid argument
2024-09-02T20:49:58Z ERRO util/grpc/dialer.go:38: Failed to dial: dial: dial tcp 35.186.199.111:443: connect: invalid argument
2024-09-02T20:50:05Z ERRO util/grpc/dialer.go:38: Failed to dial: dial: dial tcp 35.186.199.111:443: connect: invalid argument
2024-09-02T20:50:14Z ERRO util/grpc/dialer.go:38: Failed to dial: dial: dial tcp 35.186.199.111:443: connect: invalid argument
2024-09-02T20:50:18Z INFO util/grpc/dialer.go:75: DialContext error: context deadline exceeded
2024-09-02T20:50:18Z INFO management/client/grpc.go:56: createConnection error: context deadline exceeded
2024-09-02T20:50:18Z ERRO management/client/grpc.go:64: failed creating connection to Management Service: context deadline exceeded
2024-09-02T20:50:19Z ERRO util/grpc/dialer.go:38: Failed to dial: dial: dial tcp 35.186.199.111:443: connect: invalid argument
...

We have debugged it a lot more than previous issues on the Slack thread, see "Additional context" below.

It is a follow-up of and possibly related to:

To Reproduce

Try to run Netbird on Teltonika's RutOS without additional configuration.

Expected behavior

  • Netbird client properly detects the limitations of the platform
    • I took from the Slack discussion it should do this already
  • Netbird documentation clearly states system requirements and possibly a way to verify those

Context

  • using Netbird Cloud
  • running v0.28.9 + trying main versions with additional patches
  • running on Teltonika RUTX50 mobile router with stock RutOS (an older OpenWRT derivative) in version RUTX_R_00.07.08.1.

Minimal working configuration

/etc/sysconfig/netbird:

export NB_DISABLE_CUSTOM_ROUTING=true

Debugging steps summary

Confirmed FWMARK is working with @lixmal Python script.

`netbird-socket-test.py` & execution

script:

import socket
import sys

def test_fwmark():
    try:
        sock = socket.socket(socket.AF_INET, socket.SOCK_STREAM)
        
        sock.setsockopt(socket.SOL_SOCKET, socket.SO_MARK, 100)
        
        print("Successfully set SO_MARK option")
        return True
    except OSError as e:
        print(f"Failed to set SO_MARK option: {e}")
        return False
    finally:
        sock.close()

if __name__ == "__main__":
    if test_fwmark():
        print('OK')
        sys.exit(0)
    else:
        print('ERROR')
        sys.exit(1)

execution

root@yelk:~# python netbird-socket-test.py 
Successfully set SO_MARK option
OK

By the end of yesterda's debugging session I had 2 patches by @lixmal running to get more information:

1st patch adding more debugging information

0abbade349

kdn@oams ~/d/g/n/n/p/netbird-armv6 (main)> ./build.sh 
+ pushd .
~/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6 ~/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6
+ wd=/home/kdn/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6
+ out=/home/kdn/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6/netbird
+ src=/home/kdn/dev/github.com/netbirdio/netbird
+ pushd /home/kdn/dev/github.com/netbirdio/netbird
~/dev/github.com/netbirdio/netbird ~/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6 ~/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6
+ git log origin..HEAD
commit 0abbade349e63e8b9f13f04f0b6afbe74a9c1780 (HEAD -> debugging-rutx50)
Author: Krzysztof Nazarewski <gpg@kdn.im>
Date:   Wed Sep 4 09:07:02 2024 +0200

    debugging RutOS issues
    
    https://github.com/netbirdio/netbird/issues/2530
+ GOARM=6
+ GOARCH=arm
+ CGO_ENABLED=0
+ go build -o /home/kdn/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6/netbird /home/kdn/dev/github.com/netbirdio/netbird/client
+ popd
~/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6 ~/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6
+ scp /home/kdn/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6/netbird root@yelk.yelk.lan:/root/netbird
netbird                                                                                                                       100%   35MB   1.0MB/s   00:34    
+ ssh root@yelk.yelk.lan. /root/netbird-try.sh
+ /root/netbird service uninstall
Netbird service has been uninstalled
+ /root/netbird service install
Netbird service has been installed
+ rm /var/log/netbird/client.log
+ cat /etc/sysconfig/netbird
export NB_LOG_LEVEL=trace
export NB_SKIP_SOCKET_MARK=true
#export NB_DISABLE_CUSTOM_ROUTING=true
#export NB_USE_LEGACY_ROUTING=true
+ /etc/init.d/netbird start
Starting netbird
+ sleep 5
+ cat /var/log/netbird/client.log
2024-09-04T07:16:20Z INFO client/cmd/service_controller.go:24: starting Netbird service
2024-09-04T07:16:20Z TRAC client/server/server.go:189: running client connection
2024-09-04T07:16:20Z INFO client/internal/connect.go:115: starting NetBird client version development on linux/arm
2024-09-04T07:16:20Z DEBG client/internal/connect.go:176: connecting to the Management service api.netbird.io:443
2024-09-04T07:16:20Z INFO util/grpc/dialer.go:24: Custom dialer called for address: api.netbird.io:443
2024-09-04T07:16:20Z INFO util/grpc/dialer.go:32: Current user UID: 0
2024-09-04T07:16:20Z DEBG util/grpc/dialer.go:40: Using nbnet.NewDialer()
2024-09-04T07:16:20Z INFO util/net/dialer_nonios.go:68: Dialing tcp api.netbird.io:443
2024-09-04T07:16:20Z INFO util/net/net_linux.go:26: In Control function, fd: 8
2024-09-04T07:16:20Z INFO util/net/net_linux.go:44: Attempting to set SO_MARK on fd 8
2024-09-04T07:16:20Z INFO util/net/net_linux.go:54: Successfully set SO_MARK to 113920
2024-09-04T07:16:20Z DEBG util/net/net_linux.go:39: SetRawSocketMark completed successfully
2024-09-04T07:16:20Z INFO util/net/net_linux.go:26: In Control function, fd: 8
2024-09-04T07:16:20Z INFO util/net/net_linux.go:44: Attempting to set SO_MARK on fd 8
2024-09-04T07:16:20Z INFO util/net/net_linux.go:54: Successfully set SO_MARK to 113920
2024-09-04T07:16:20Z DEBG util/net/net_linux.go:39: SetRawSocketMark completed successfully
2024-09-04T07:16:20Z ERRO util/net/dialer_nonios.go:71: d.Dialer.DialContext failed: dial tcp 35.186.199.111:443: connect: invalid argument
2024-09-04T07:16:20Z ERRO util/grpc/dialer.go:43: nbnet.NewDialer().DialContext failed: dial: dial tcp 35.186.199.111:443: connect: invalid argument
2024-09-04T07:16:21Z INFO util/grpc/dialer.go:24: Custom dialer called for address: api.netbird.io:443
2024-09-04T07:16:21Z INFO util/grpc/dialer.go:32: Current user UID: 0
2024-09-04T07:16:21Z DEBG util/grpc/dialer.go:40: Using nbnet.NewDialer()
2024-09-04T07:16:21Z INFO util/net/dialer_nonios.go:68: Dialing tcp api.netbird.io:443
2024-09-04T07:16:21Z INFO util/net/net_linux.go:26: In Control function, fd: 8
2024-09-04T07:16:21Z INFO util/net/net_linux.go:44: Attempting to set SO_MARK on fd 8
2024-09-04T07:16:21Z INFO util/net/net_linux.go:54: Successfully set SO_MARK to 113920
2024-09-04T07:16:21Z DEBG util/net/net_linux.go:39: SetRawSocketMark completed successfully
2024-09-04T07:16:21Z INFO util/net/net_linux.go:26: In Control function, fd: 8
2024-09-04T07:16:21Z INFO util/net/net_linux.go:44: Attempting to set SO_MARK on fd 8
2024-09-04T07:16:21Z INFO util/net/net_linux.go:54: Successfully set SO_MARK to 113920
2024-09-04T07:16:21Z DEBG util/net/net_linux.go:39: SetRawSocketMark completed successfully
2024-09-04T07:16:21Z ERRO util/net/dialer_nonios.go:71: d.Dialer.DialContext failed: dial tcp 35.186.199.111:443: connect: invalid argument
2024-09-04T07:16:21Z ERRO util/grpc/dialer.go:43: nbnet.NewDialer().DialContext failed: dial: dial tcp 35.186.199.111:443: connect: invalid argument
2024-09-04T07:16:23Z INFO util/grpc/dialer.go:24: Custom dialer called for address: api.netbird.io:443
2024-09-04T07:16:23Z INFO util/grpc/dialer.go:32: Current user UID: 0
2024-09-04T07:16:23Z DEBG util/grpc/dialer.go:40: Using nbnet.NewDialer()
2024-09-04T07:16:23Z INFO util/net/dialer_nonios.go:68: Dialing tcp api.netbird.io:443
2024-09-04T07:16:23Z INFO util/net/net_linux.go:26: In Control function, fd: 8
2024-09-04T07:16:23Z INFO util/net/net_linux.go:44: Attempting to set SO_MARK on fd 8
2024-09-04T07:16:23Z INFO util/net/net_linux.go:54: Successfully set SO_MARK to 113920
2024-09-04T07:16:23Z DEBG util/net/net_linux.go:39: SetRawSocketMark completed successfully
2024-09-04T07:16:23Z INFO util/net/net_linux.go:26: In Control function, fd: 8
2024-09-04T07:16:23Z INFO util/net/net_linux.go:44: Attempting to set SO_MARK on fd 8
2024-09-04T07:16:23Z INFO util/net/net_linux.go:54: Successfully set SO_MARK to 113920
2024-09-04T07:16:23Z DEBG util/net/net_linux.go:39: SetRawSocketMark completed successfully
2024-09-04T07:16:23Z ERRO util/net/dialer_nonios.go:71: d.Dialer.DialContext failed: dial tcp 35.186.199.111:443: connect: invalid argument
2024-09-04T07:16:23Z ERRO util/grpc/dialer.go:43: nbnet.NewDialer().DialContext failed: dial: dial tcp 35.186.199.111:443: connect: invalid argument
+ /etc/init.d/netbird stop
Stopping netbird....
Stopped
+ popd
~/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6
kdn@oams ~/d/g/n/n/p/netbird-armv6 (main)>

Second one one seems to be working by skipping smaller piece of code than NB_DISABLE_CUSTOM_ROUTING:

2nd patch + `NB_SKIP_SOCKET_MARK=true`

885a5744ab

kdn@oams ~/d/g/n/n/p/netbird-armv6 (main) [1]> ./build.sh 
+ pushd .
~/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6 ~/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6
+ wd=/home/kdn/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6
+ out=/home/kdn/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6/netbird
+ src=/home/kdn/dev/github.com/netbirdio/netbird
+ pushd /home/kdn/dev/github.com/netbirdio/netbird
~/dev/github.com/netbirdio/netbird ~/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6 ~/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6
+ git log origin..HEAD
commit 885a5744ab9fff3d542d6aaeb29f3323eadd38eb (HEAD -> debugging-rutx50, nazarewk/debugging-rutx50)
Author: Krzysztof Nazarewski <gpg@kdn.im>
Date:   Wed Sep 4 09:07:32 2024 +0200

    debugging RutOS issues
    
    https://github.com/netbirdio/netbird/issues/2530

commit 0abbade349e63e8b9f13f04f0b6afbe74a9c1780
Author: Krzysztof Nazarewski <gpg@kdn.im>
Date:   Wed Sep 4 09:07:02 2024 +0200

    debugging RutOS issues
    
    https://github.com/netbirdio/netbird/issues/2530
+ GOARM=6
+ GOARCH=arm
+ CGO_ENABLED=0
+ go build -o /home/kdn/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6/netbird /home/kdn/dev/github.com/netbirdio/netbird/client
+ popd
~/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6 ~/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6
+ scp /home/kdn/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6/netbird root@yelk.yelk.lan:/root/netbird
netbird                                                                                                                       100%   35MB   1.0MB/s   00:35    
+ ssh root@yelk.yelk.lan. /root/netbird-try.sh
+ /root/netbird service uninstall
Netbird service has been uninstalled
+ /root/netbird service install
Netbird service has been installed
+ rm /var/log/netbird/client.log
+ cat /etc/sysconfig/netbird
export NB_LOG_LEVEL=trace
export NB_SKIP_SOCKET_MARK=true
#export NB_DISABLE_CUSTOM_ROUTING=true
#export NB_USE_LEGACY_ROUTING=true
+ /etc/init.d/netbird start
Starting netbird
+ sleep 5
+ cat /var/log/netbird/client.log
2024-09-04T07:11:23Z INFO client/cmd/service_controller.go:24: starting Netbird service
2024-09-04T07:11:23Z TRAC client/server/server.go:189: running client connection
2024-09-04T07:11:23Z INFO client/internal/connect.go:115: starting NetBird client version development on linux/arm
2024-09-04T07:11:23Z DEBG client/internal/connect.go:176: connecting to the Management service api.netbird.io:443
2024-09-04T07:11:23Z INFO util/grpc/dialer.go:24: Custom dialer called for address: api.netbird.io:443
2024-09-04T07:11:23Z INFO util/grpc/dialer.go:32: Current user UID: 0
2024-09-04T07:11:23Z DEBG util/grpc/dialer.go:40: Using nbnet.NewDialer()
2024-09-04T07:11:23Z INFO util/net/dialer_nonios.go:68: Dialing tcp api.netbird.io:443
2024-09-04T07:11:23Z INFO util/net/net_linux.go:29: In Control function, fd: 8
2024-09-04T07:11:23Z INFO util/net/net_linux.go:47: Attempting to set SO_MARK on fd 8
2024-09-04T07:11:23Z INFO util/net/net_linux.go:55: NB_SKIP_SOCKET_MARK is set to true, skipping SO_MARK
2024-09-04T07:11:23Z DEBG util/net/net_linux.go:42: SetRawSocketMark completed successfully
2024-09-04T07:11:23Z DEBG util/net/dialer_nonios.go:74: d.Dialer.DialContext succeeded
2024-09-04T07:11:23Z DEBG util/grpc/dialer.go:46: nbnet.NewDialer().DialContext succeeded
2024-09-04T07:11:23Z DEBG client/internal/connect.go:184: connected to the Management service api.netbird.io:443
2024-09-04T07:11:24Z INFO util/grpc/dialer.go:24: Custom dialer called for address: signal.netbird.io:443
2024-09-04T07:11:24Z INFO util/grpc/dialer.go:32: Current user UID: 0
2024-09-04T07:11:24Z DEBG util/grpc/dialer.go:40: Using nbnet.NewDialer()
2024-09-04T07:11:24Z INFO util/net/dialer_nonios.go:68: Dialing tcp signal.netbird.io:443
2024-09-04T07:11:25Z INFO util/net/net_linux.go:29: In Control function, fd: 9
2024-09-04T07:11:25Z INFO util/net/net_linux.go:47: Attempting to set SO_MARK on fd 9
2024-09-04T07:11:25Z INFO util/net/net_linux.go:55: NB_SKIP_SOCKET_MARK is set to true, skipping SO_MARK
2024-09-04T07:11:25Z DEBG util/net/net_linux.go:42: SetRawSocketMark completed successfully
2024-09-04T07:11:25Z DEBG util/net/dialer_nonios.go:74: d.Dialer.DialContext succeeded
2024-09-04T07:11:25Z DEBG util/grpc/dialer.go:46: nbnet.NewDialer().DialContext succeeded
2024-09-04T07:11:25Z DEBG signal/client/grpc.go:81: connected to Signal Service: signal.netbird.io:443
2024-09-04T07:11:25Z TRAC client/internal/stdnet/filter.go:24: ignoring interface br-lan - it is not allowed
2024-09-04T07:11:25Z DEBG client/internal/wgproxy/proxy_ebpf.go:43: instantiate ebpf proxy
2024-09-04T07:11:25Z INFO util/net/net_linux.go:47: Attempting to set SO_MARK on fd 10
2024-09-04T07:11:25Z INFO util/net/net_linux.go:55: NB_SKIP_SOCKET_MARK is set to true, skipping SO_MARK
2024-09-04T07:11:25Z DEBG client/internal/ebpf/ebpf/wg_proxy_linux.go:11: load ebpf WG proxy
2024-09-04T07:11:25Z INFO util/net/net_linux.go:29: In Control function, fd: 15
2024-09-04T07:11:25Z INFO util/net/net_linux.go:47: Attempting to set SO_MARK on fd 15
2024-09-04T07:11:25Z INFO util/net/net_linux.go:55: NB_SKIP_SOCKET_MARK is set to true, skipping SO_MARK
2024-09-04T07:11:25Z DEBG util/net/net_linux.go:42: SetRawSocketMark completed successfully
2024-09-04T07:11:25Z INFO client/internal/wgproxy/proxy_ebpf.go:89: local wg proxy listening on: 3128
2024-09-04T07:11:25Z DEBG client/internal/routemanager/sysctl/sysctl_linux.go:87: Set sysctl net.ipv4.conf.all.src_valid_mark from 0 to 1
2024-09-04T07:11:25Z INFO client/internal/routemanager/manager.go:135: Routing setup complete
2024-09-04T07:11:25Z DEBG iface/tun_link_linux.go:63: adding device: wt0
2024-09-04T07:11:25Z DEBG iface/tun_link_linux.go:113: adding address 100.79.229.105/16 to interface: wt0
2024-09-04T07:11:25Z DEBG iface/tun_kernel_unix.go:64: setting MTU: 1280 interface: wt0
2024-09-04T07:11:25Z DEBG iface/wg_configurer_kernel_unix.go:27: adding Wireguard private key
2024-09-04T07:11:25Z INFO client/firewall/create_linux.go:45: creating an iptables firewall manager
2024-09-04T07:11:25Z DEBG client/firewall/iptables/router_linux.go:179: flushing routing related tables
2024-09-04T07:11:26Z DEBG iface/tun_kernel_unix.go:88: bringing up interface: wt0
2024-09-04T07:11:26Z INFO util/net/net_linux.go:29: In Control function, fd: 19
2024-09-04T07:11:26Z INFO util/net/net_linux.go:47: Attempting to set SO_MARK on fd 19
2024-09-04T07:11:26Z INFO util/net/net_linux.go:55: NB_SKIP_SOCKET_MARK is set to true, skipping SO_MARK
2024-09-04T07:11:26Z DEBG util/net/net_linux.go:42: SetRawSocketMark completed successfully
2024-09-04T07:11:26Z INFO util/net/net_linux.go:29: In Control function, fd: 21
2024-09-04T07:11:26Z INFO util/net/net_linux.go:47: Attempting to set SO_MARK on fd 21
2024-09-04T07:11:26Z INFO util/net/net_linux.go:55: NB_SKIP_SOCKET_MARK is set to true, skipping SO_MARK
2024-09-04T07:11:26Z DEBG util/net/net_linux.go:42: SetRawSocketMark completed successfully
2024-09-04T07:11:26Z DEBG iface/tun_kernel_unix.go:110: device is ready to use: wt0
2024-09-04T07:11:26Z INFO client/internal/dns/host_unix.go:68: System DNS manager discovered: file
2024-09-04T07:11:26Z DEBG signal/client/grpc.go:126: signal connection state READY
2024-09-04T07:11:26Z INFO signal/client/grpc.go:147: connected to the Signal Service stream
2024-09-04T07:11:26Z DEBG client/internal/engine.go:679: connecting to Management Service updates stream
2024-09-04T07:11:26Z INFO client/internal/engine.go:1478: Network monitor is disabled, not starting
2024-09-04T07:11:26Z INFO client/internal/connect.go:263: Netbird engine started, the IP is: 100.79.229.105/16
2024-09-04T07:11:26Z INFO client/cmd/service_controller.go:66: started daemon server: /var/run/netbird.sock
2024-09-04T07:11:26Z DEBG management/client/grpc.go:114: management connection state READY
2024-09-04T07:11:26Z INFO management/client/grpc.go:155: connected to the Management Service stream
2024-09-04T07:11:27Z DEBG management/client/grpc.go:252: got an update message from Management Service
2024-09-04T07:11:27Z DEBG client/internal/engine.go:705: got TURNs update from Management Service, updating
2024-09-04T07:11:27Z DEBG client/internal/engine.go:687: got STUNs update from Management Service, updating
2024-09-04T07:11:27Z WARN client/internal/engine.go:583: running SSH server is not permitted
2024-09-04T07:11:27Z DEBG client/internal/engine.go:750: got peers update from Management Service, total peers to connect to = 5
2024-09-04T07:11:27Z DEBG client/internal/routemanager/client.go:365: Received a new client network route update for [10.100.0.0/24]
2024-09-04T07:11:27Z DEBG client/internal/engine.go:991: creating peer connection TWqUoZfKeoVLJhNXElSgb7jCxT+Woj10q1A/CdNX1lU=
2024-09-04T07:11:27Z DEBG client/internal/routemanager/client.go:373: Client network update contains different routes, recalculating routes
2024-09-04T07:11:27Z DEBG client/internal/routemanager/client.go:79: couldn't fetch peer state: peer not found
2024-09-04T07:11:27Z DEBG client/internal/routemanager/client.go:79: couldn't fetch peer state: peer not found
2024-09-04T07:11:27Z WARN client/internal/routemanager/client.go:166: The network [10.100.0.0/24] has not been assigned a routing peer as no peers from the list [oA2X5dBvPmn1c1d9SOdOZoHe4KM1pho9pybwsUO0T30= TWqUoZfKeoVLJhNXElSgb7jCxT+Woj10q1A/CdNX1lU=] are currently connected
2024-09-04T07:11:27Z DEBG client/internal/engine.go:991: creating peer connection cavC6Fl1/Hj0mt7zGNLN3oWYzh4EwTFOLtPJlt3Xpzg=
2024-09-04T07:11:27Z DEBG client/internal/engine.go:991: creating peer connection +Yas9r/YFa6naMpQrAxL2OMgRflaGdru8r+hwcyDYRs=
2024-09-04T07:11:27Z DEBG client/internal/engine.go:991: creating peer connection oA2X5dBvPmn1c1d9SOdOZoHe4KM1pho9pybwsUO0T30=
2024-09-04T07:11:27Z DEBG client/internal/engine.go:991: creating peer connection KllUo0iSxLBD8v6nYa5oi+26yHIJf9YLl6+hQVWKqEY=
2024-09-04T07:11:27Z WARN client/internal/dns/service_listener.go:188: binding dns on 100.79.229.105:53 is not available, error: listen udp 100.79.229.105:53: bind: address already in use
2024-09-04T07:11:27Z WARN client/internal/dns/service_listener.go:188: binding dns on 127.0.0.1:53 is not available, error: listen udp 127.0.0.1:53: bind: address already in use
2024-09-04T07:11:27Z DEBG client/internal/dns/service_listener.go:69: starting dns on 127.0.0.153:53
2024-09-04T07:11:27Z ERRO client/internal/dns/server.go:322: unable to configure DNS for this peer using file manager without a nameserver group with all domains configured
2024-09-04T07:11:27Z INFO client/internal/acl/manager.go:52: ACL rules processed in: 63.346104ms, total rules count: 2
2024-09-04T07:11:27Z DEBG client/internal/peer/conn.go:256: trying to connect to peer oA2X5dBvPmn1c1d9SOdOZoHe4KM1pho9pybwsUO0T30=
2024-09-04T07:11:27Z TRAC client/internal/stdnet/filter.go:24: ignoring interface br-lan - it is not allowed
2024-09-04T07:11:27Z TRAC client/internal/stdnet/filter.go:24: ignoring interface wt0 - it is not allowed
2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:256: trying to connect to peer TWqUoZfKeoVLJhNXElSgb7jCxT+Woj10q1A/CdNX1lU=
2024-09-04T07:11:28Z TRAC client/internal/stdnet/filter.go:24: ignoring interface br-lan - it is not allowed
2024-09-04T07:11:28Z TRAC client/internal/stdnet/filter.go:24: ignoring interface wt0 - it is not allowed
2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:288: connection offer sent to peer oA2X5dBvPmn1c1d9SOdOZoHe4KM1pho9pybwsUO0T30=, waiting for the confirmation
2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:256: trying to connect to peer KllUo0iSxLBD8v6nYa5oi+26yHIJf9YLl6+hQVWKqEY=
2024-09-04T07:11:28Z TRAC client/internal/stdnet/filter.go:24: ignoring interface br-lan - it is not allowed
2024-09-04T07:11:28Z TRAC client/internal/stdnet/filter.go:24: ignoring interface wt0 - it is not allowed
2024-09-04T07:11:28Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: oA2X5dBvPmn1c1d9SOdOZoHe4KM1pho9pybwsUO0T30=]
2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:288: connection offer sent to peer TWqUoZfKeoVLJhNXElSgb7jCxT+Woj10q1A/CdNX1lU=, waiting for the confirmation
2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:741: OnRemoteAnswer from peer oA2X5dBvPmn1c1d9SOdOZoHe4KM1pho9pybwsUO0T30= on status Disconnected
2024-09-04T07:11:28Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: TWqUoZfKeoVLJhNXElSgb7jCxT+Woj10q1A/CdNX1lU=]
2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:309: received connection confirmation from peer oA2X5dBvPmn1c1d9SOdOZoHe4KM1pho9pybwsUO0T30= running version 0.28.7 and with remote WireGuard listen port 51819
2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:639: peer oA2X5dBvPmn1c1d9SOdOZoHe4KM1pho9pybwsUO0T30= ICE ConnectionState has changed to Checking
2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:603: discovered local candidate udp4 host 100.122.82.135:51820
2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:741: OnRemoteAnswer from peer TWqUoZfKeoVLJhNXElSgb7jCxT+Woj10q1A/CdNX1lU= on status Disconnected
2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:309: received connection confirmation from peer TWqUoZfKeoVLJhNXElSgb7jCxT+Woj10q1A/CdNX1lU= running version 0.28.7 and with remote WireGuard listen port 51819
2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:639: peer TWqUoZfKeoVLJhNXElSgb7jCxT+Woj10q1A/CdNX1lU= ICE ConnectionState has changed to Checking
2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:603: discovered local candidate udp4 host 100.122.82.135:51820
2024-09-04T07:11:28Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: TWqUoZfKeoVLJhNXElSgb7jCxT+Woj10q1A/CdNX1lU=]
2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer TWqUoZfKeoVLJhNXElSgb7jCxT+Woj10q1A/CdNX1lU= -> udp4 host 195.201.20.51:51819
2024-09-04T07:11:28Z DEBG iface/bind/udp_mux.go:346: ICE: registered 195.201.20.51:51819 for XkEMDondlghhExfB
2024-09-04T07:11:28Z INFO util/net/dialer_nonios.go:68: Dialing tcp4 94.237.103.92:443
2024-09-04T07:11:28Z INFO util/net/net_linux.go:29: In Control function, fd: 23
2024-09-04T07:11:28Z INFO util/net/net_linux.go:47: Attempting to set SO_MARK on fd 23
2024-09-04T07:11:28Z INFO util/net/net_linux.go:55: NB_SKIP_SOCKET_MARK is set to true, skipping SO_MARK
2024-09-04T07:11:28Z DEBG util/net/net_linux.go:42: SetRawSocketMark completed successfully
2024-09-04T07:11:28Z INFO util/net/dialer_nonios.go:68: Dialing tcp4 94.237.103.92:443
2024-09-04T07:11:28Z INFO util/net/net_linux.go:29: In Control function, fd: 24
2024-09-04T07:11:28Z INFO util/net/net_linux.go:47: Attempting to set SO_MARK on fd 24
2024-09-04T07:11:28Z INFO util/net/net_linux.go:55: NB_SKIP_SOCKET_MARK is set to true, skipping SO_MARK
2024-09-04T07:11:28Z DEBG util/net/net_linux.go:42: SetRawSocketMark completed successfully
2024-09-04T07:11:28Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: TWqUoZfKeoVLJhNXElSgb7jCxT+Woj10q1A/CdNX1lU=]
2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:288: connection offer sent to peer KllUo0iSxLBD8v6nYa5oi+26yHIJf9YLl6+hQVWKqEY=, waiting for the confirmation
2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer TWqUoZfKeoVLJhNXElSgb7jCxT+Woj10q1A/CdNX1lU= -> udp4 srflx 195.201.20.51:51819 related 0.0.0.0:51819
2024-09-04T07:11:28Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: oA2X5dBvPmn1c1d9SOdOZoHe4KM1pho9pybwsUO0T30=]
2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:603: discovered local candidate udp4 srflx 37.30.16.87:51480 related 0.0.0.0:51820
2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:603: discovered local candidate udp4 srflx 37.30.16.87:51480 related 0.0.0.0:51820
2024-09-04T07:11:28Z DEBG iface/bind/udp_mux.go:346: ICE: registered 195.201.20.51:51819 for XkEMDondlghhExfBturns:turn.netbird.io:443?transport=tcp
2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer oA2X5dBvPmn1c1d9SOdOZoHe4KM1pho9pybwsUO0T30= -> udp4 host 192.168.27.247:51819
2024-09-04T07:11:28Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: oA2X5dBvPmn1c1d9SOdOZoHe4KM1pho9pybwsUO0T30=]
2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer oA2X5dBvPmn1c1d9SOdOZoHe4KM1pho9pybwsUO0T30= -> udp4 host 192.168.122.1:51819
2024-09-04T07:11:28Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.122.1:51819 for ezdEKYfrUbObvlzK
2024-09-04T07:11:28Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.122.1:51819 for ezdEKYfrUbObvlzKturns:turn.netbird.io:443?transport=tcp
2024-09-04T07:11:28Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.27.247:51819 for ezdEKYfrUbObvlzK
2024-09-04T07:11:28Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.27.247:51819 for ezdEKYfrUbObvlzKturns:turn.netbird.io:443?transport=tcp
2024-09-04T07:11:28Z DEBG util/net/dialer_nonios.go:74: d.Dialer.DialContext succeeded
2024-09-04T07:11:28Z DEBG util/net/dialer_nonios.go:74: d.Dialer.DialContext succeeded
2024-09-04T07:11:28Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: TWqUoZfKeoVLJhNXElSgb7jCxT+Woj10q1A/CdNX1lU=]
2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer TWqUoZfKeoVLJhNXElSgb7jCxT+Woj10q1A/CdNX1lU= -> udp4 relay 94.237.103.92:61035 related 195.201.20.51:51032
2024-09-04T07:11:28Z DEBG iface/bind/udp_mux.go:346: ICE: registered 94.237.103.92:61035 for XkEMDondlghhExfB
2024-09-04T07:11:28Z DEBG iface/bind/udp_mux.go:346: ICE: registered 94.237.103.92:61035 for XkEMDondlghhExfBturns:turn.netbird.io:443?transport=tcp
+ /etc/init.d/netbird stop
Stopping netbird......
Stopped
+ popd
~/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6
kdn@oams ~/d/g/n/n/p/netbird-armv6 (main)>
Originally created by @nazarewk on GitHub (Sep 4, 2024). solution is at https://github.com/netbirdio/netbird/issues/2530#issuecomment-2482245422 # Describe the problem TLDR; 1. There is some weird (it almost works) issue with `FWMARK` handling by Netbird on RutOS. 2. the other issue I had was https://github.com/netbirdio/netbird/issues/730#issuecomment-2329119310 This is an issue dedicated to my problems with stock software running on Teltonika RUTX50 router (runs RutOS - a derivative of older version of OpenWRT): ``` root@yelk:/tmp/log/netbird# cat client.log 2024-09-02T20:49:48Z INFO client/cmd/service_controller.go:24: starting Netbird service 2024-09-02T20:49:48Z INFO client/cmd/service_controller.go:64: started daemon server: /var/run/netbird.sock 2024-09-02T20:49:48Z INFO client/internal/connect.go:119: starting NetBird client version 0.28.9 on linux/arm 2024-09-02T20:49:48Z ERRO util/grpc/dialer.go:38: Failed to dial: dial: dial tcp 35.186.199.111:443: connect: invalid argument 2024-09-02T20:49:49Z ERRO util/grpc/dialer.go:38: Failed to dial: dial: dial tcp 35.186.199.111:443: connect: invalid argument 2024-09-02T20:49:51Z ERRO util/grpc/dialer.go:38: Failed to dial: dial: dial tcp 35.186.199.111:443: connect: invalid argument 2024-09-02T20:49:54Z ERRO util/grpc/dialer.go:38: Failed to dial: dial: dial tcp 35.186.199.111:443: connect: invalid argument 2024-09-02T20:49:58Z ERRO util/grpc/dialer.go:38: Failed to dial: dial: dial tcp 35.186.199.111:443: connect: invalid argument 2024-09-02T20:50:05Z ERRO util/grpc/dialer.go:38: Failed to dial: dial: dial tcp 35.186.199.111:443: connect: invalid argument 2024-09-02T20:50:14Z ERRO util/grpc/dialer.go:38: Failed to dial: dial: dial tcp 35.186.199.111:443: connect: invalid argument 2024-09-02T20:50:18Z INFO util/grpc/dialer.go:75: DialContext error: context deadline exceeded 2024-09-02T20:50:18Z INFO management/client/grpc.go:56: createConnection error: context deadline exceeded 2024-09-02T20:50:18Z ERRO management/client/grpc.go:64: failed creating connection to Management Service: context deadline exceeded 2024-09-02T20:50:19Z ERRO util/grpc/dialer.go:38: Failed to dial: dial: dial tcp 35.186.199.111:443: connect: invalid argument ... ``` We have debugged it a lot more than previous issues on the [Slack thread](https://netbirdio.slack.com/archives/C02KHAE8VLZ/p1725351531376339), see "Additional context" below. It is a follow-up of and possibly related to: - #2512 - #2116 - https://github.com/netbirdio/netbird/issues/2187#issuecomment-2325291308 # To Reproduce Try to run Netbird on Teltonika's RutOS without additional configuration. # Expected behavior - Netbird client properly detects the limitations of the platform - I took from the Slack discussion it should do this already - Netbird documentation clearly states system requirements and possibly a way to verify those # Context - using Netbird Cloud - running `v0.28.9` + trying `main` versions with additional patches - running on Teltonika RUTX50 mobile router with stock RutOS (an older OpenWRT derivative) in version `RUTX_R_00.07.08.1`. ## Minimal working configuration `/etc/sysconfig/netbird`: ``` export NB_DISABLE_CUSTOM_ROUTING=true ``` ## Debugging steps summary Confirmed `FWMARK` is working with @lixmal Python script. <details> <summary>`netbird-socket-test.py` & execution</summary> script: ```python import socket import sys def test_fwmark(): try: sock = socket.socket(socket.AF_INET, socket.SOCK_STREAM) sock.setsockopt(socket.SOL_SOCKET, socket.SO_MARK, 100) print("Successfully set SO_MARK option") return True except OSError as e: print(f"Failed to set SO_MARK option: {e}") return False finally: sock.close() if __name__ == "__main__": if test_fwmark(): print('OK') sys.exit(0) else: print('ERROR') sys.exit(1) ``` execution ```shell root@yelk:~# python netbird-socket-test.py Successfully set SO_MARK option OK ``` </details> By the end of yesterda's debugging session I had 2 patches by @lixmal running to get more information: <details> <summary>1st patch adding more debugging information</summary> https://github.com/netbirdio/netbird/commit/0abbade349e63e8b9f13f04f0b6afbe74a9c1780 ``` kdn@oams ~/d/g/n/n/p/netbird-armv6 (main)> ./build.sh + pushd . ~/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6 ~/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6 + wd=/home/kdn/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6 + out=/home/kdn/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6/netbird + src=/home/kdn/dev/github.com/netbirdio/netbird + pushd /home/kdn/dev/github.com/netbirdio/netbird ~/dev/github.com/netbirdio/netbird ~/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6 ~/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6 + git log origin..HEAD commit 0abbade349e63e8b9f13f04f0b6afbe74a9c1780 (HEAD -> debugging-rutx50) Author: Krzysztof Nazarewski <gpg@kdn.im> Date: Wed Sep 4 09:07:02 2024 +0200 debugging RutOS issues https://github.com/netbirdio/netbird/issues/2530 + GOARM=6 + GOARCH=arm + CGO_ENABLED=0 + go build -o /home/kdn/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6/netbird /home/kdn/dev/github.com/netbirdio/netbird/client + popd ~/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6 ~/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6 + scp /home/kdn/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6/netbird root@yelk.yelk.lan:/root/netbird netbird 100% 35MB 1.0MB/s 00:34 + ssh root@yelk.yelk.lan. /root/netbird-try.sh + /root/netbird service uninstall Netbird service has been uninstalled + /root/netbird service install Netbird service has been installed + rm /var/log/netbird/client.log + cat /etc/sysconfig/netbird export NB_LOG_LEVEL=trace export NB_SKIP_SOCKET_MARK=true #export NB_DISABLE_CUSTOM_ROUTING=true #export NB_USE_LEGACY_ROUTING=true + /etc/init.d/netbird start Starting netbird + sleep 5 + cat /var/log/netbird/client.log 2024-09-04T07:16:20Z INFO client/cmd/service_controller.go:24: starting Netbird service 2024-09-04T07:16:20Z TRAC client/server/server.go:189: running client connection 2024-09-04T07:16:20Z INFO client/internal/connect.go:115: starting NetBird client version development on linux/arm 2024-09-04T07:16:20Z DEBG client/internal/connect.go:176: connecting to the Management service api.netbird.io:443 2024-09-04T07:16:20Z INFO util/grpc/dialer.go:24: Custom dialer called for address: api.netbird.io:443 2024-09-04T07:16:20Z INFO util/grpc/dialer.go:32: Current user UID: 0 2024-09-04T07:16:20Z DEBG util/grpc/dialer.go:40: Using nbnet.NewDialer() 2024-09-04T07:16:20Z INFO util/net/dialer_nonios.go:68: Dialing tcp api.netbird.io:443 2024-09-04T07:16:20Z INFO util/net/net_linux.go:26: In Control function, fd: 8 2024-09-04T07:16:20Z INFO util/net/net_linux.go:44: Attempting to set SO_MARK on fd 8 2024-09-04T07:16:20Z INFO util/net/net_linux.go:54: Successfully set SO_MARK to 113920 2024-09-04T07:16:20Z DEBG util/net/net_linux.go:39: SetRawSocketMark completed successfully 2024-09-04T07:16:20Z INFO util/net/net_linux.go:26: In Control function, fd: 8 2024-09-04T07:16:20Z INFO util/net/net_linux.go:44: Attempting to set SO_MARK on fd 8 2024-09-04T07:16:20Z INFO util/net/net_linux.go:54: Successfully set SO_MARK to 113920 2024-09-04T07:16:20Z DEBG util/net/net_linux.go:39: SetRawSocketMark completed successfully 2024-09-04T07:16:20Z ERRO util/net/dialer_nonios.go:71: d.Dialer.DialContext failed: dial tcp 35.186.199.111:443: connect: invalid argument 2024-09-04T07:16:20Z ERRO util/grpc/dialer.go:43: nbnet.NewDialer().DialContext failed: dial: dial tcp 35.186.199.111:443: connect: invalid argument 2024-09-04T07:16:21Z INFO util/grpc/dialer.go:24: Custom dialer called for address: api.netbird.io:443 2024-09-04T07:16:21Z INFO util/grpc/dialer.go:32: Current user UID: 0 2024-09-04T07:16:21Z DEBG util/grpc/dialer.go:40: Using nbnet.NewDialer() 2024-09-04T07:16:21Z INFO util/net/dialer_nonios.go:68: Dialing tcp api.netbird.io:443 2024-09-04T07:16:21Z INFO util/net/net_linux.go:26: In Control function, fd: 8 2024-09-04T07:16:21Z INFO util/net/net_linux.go:44: Attempting to set SO_MARK on fd 8 2024-09-04T07:16:21Z INFO util/net/net_linux.go:54: Successfully set SO_MARK to 113920 2024-09-04T07:16:21Z DEBG util/net/net_linux.go:39: SetRawSocketMark completed successfully 2024-09-04T07:16:21Z INFO util/net/net_linux.go:26: In Control function, fd: 8 2024-09-04T07:16:21Z INFO util/net/net_linux.go:44: Attempting to set SO_MARK on fd 8 2024-09-04T07:16:21Z INFO util/net/net_linux.go:54: Successfully set SO_MARK to 113920 2024-09-04T07:16:21Z DEBG util/net/net_linux.go:39: SetRawSocketMark completed successfully 2024-09-04T07:16:21Z ERRO util/net/dialer_nonios.go:71: d.Dialer.DialContext failed: dial tcp 35.186.199.111:443: connect: invalid argument 2024-09-04T07:16:21Z ERRO util/grpc/dialer.go:43: nbnet.NewDialer().DialContext failed: dial: dial tcp 35.186.199.111:443: connect: invalid argument 2024-09-04T07:16:23Z INFO util/grpc/dialer.go:24: Custom dialer called for address: api.netbird.io:443 2024-09-04T07:16:23Z INFO util/grpc/dialer.go:32: Current user UID: 0 2024-09-04T07:16:23Z DEBG util/grpc/dialer.go:40: Using nbnet.NewDialer() 2024-09-04T07:16:23Z INFO util/net/dialer_nonios.go:68: Dialing tcp api.netbird.io:443 2024-09-04T07:16:23Z INFO util/net/net_linux.go:26: In Control function, fd: 8 2024-09-04T07:16:23Z INFO util/net/net_linux.go:44: Attempting to set SO_MARK on fd 8 2024-09-04T07:16:23Z INFO util/net/net_linux.go:54: Successfully set SO_MARK to 113920 2024-09-04T07:16:23Z DEBG util/net/net_linux.go:39: SetRawSocketMark completed successfully 2024-09-04T07:16:23Z INFO util/net/net_linux.go:26: In Control function, fd: 8 2024-09-04T07:16:23Z INFO util/net/net_linux.go:44: Attempting to set SO_MARK on fd 8 2024-09-04T07:16:23Z INFO util/net/net_linux.go:54: Successfully set SO_MARK to 113920 2024-09-04T07:16:23Z DEBG util/net/net_linux.go:39: SetRawSocketMark completed successfully 2024-09-04T07:16:23Z ERRO util/net/dialer_nonios.go:71: d.Dialer.DialContext failed: dial tcp 35.186.199.111:443: connect: invalid argument 2024-09-04T07:16:23Z ERRO util/grpc/dialer.go:43: nbnet.NewDialer().DialContext failed: dial: dial tcp 35.186.199.111:443: connect: invalid argument + /etc/init.d/netbird stop Stopping netbird.... Stopped + popd ~/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6 kdn@oams ~/d/g/n/n/p/netbird-armv6 (main)> ``` </details> Second one one seems to be working by skipping smaller piece of code than `NB_DISABLE_CUSTOM_ROUTING`: <details> <summary> 2nd patch + `NB_SKIP_SOCKET_MARK=true` </summary> https://github.com/netbirdio/netbird/commit/885a5744ab9fff3d542d6aaeb29f3323eadd38eb ``` kdn@oams ~/d/g/n/n/p/netbird-armv6 (main) [1]> ./build.sh + pushd . ~/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6 ~/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6 + wd=/home/kdn/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6 + out=/home/kdn/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6/netbird + src=/home/kdn/dev/github.com/netbirdio/netbird + pushd /home/kdn/dev/github.com/netbirdio/netbird ~/dev/github.com/netbirdio/netbird ~/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6 ~/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6 + git log origin..HEAD commit 885a5744ab9fff3d542d6aaeb29f3323eadd38eb (HEAD -> debugging-rutx50, nazarewk/debugging-rutx50) Author: Krzysztof Nazarewski <gpg@kdn.im> Date: Wed Sep 4 09:07:32 2024 +0200 debugging RutOS issues https://github.com/netbirdio/netbird/issues/2530 commit 0abbade349e63e8b9f13f04f0b6afbe74a9c1780 Author: Krzysztof Nazarewski <gpg@kdn.im> Date: Wed Sep 4 09:07:02 2024 +0200 debugging RutOS issues https://github.com/netbirdio/netbird/issues/2530 + GOARM=6 + GOARCH=arm + CGO_ENABLED=0 + go build -o /home/kdn/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6/netbird /home/kdn/dev/github.com/netbirdio/netbird/client + popd ~/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6 ~/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6 + scp /home/kdn/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6/netbird root@yelk.yelk.lan:/root/netbird netbird 100% 35MB 1.0MB/s 00:35 + ssh root@yelk.yelk.lan. /root/netbird-try.sh + /root/netbird service uninstall Netbird service has been uninstalled + /root/netbird service install Netbird service has been installed + rm /var/log/netbird/client.log + cat /etc/sysconfig/netbird export NB_LOG_LEVEL=trace export NB_SKIP_SOCKET_MARK=true #export NB_DISABLE_CUSTOM_ROUTING=true #export NB_USE_LEGACY_ROUTING=true + /etc/init.d/netbird start Starting netbird + sleep 5 + cat /var/log/netbird/client.log 2024-09-04T07:11:23Z INFO client/cmd/service_controller.go:24: starting Netbird service 2024-09-04T07:11:23Z TRAC client/server/server.go:189: running client connection 2024-09-04T07:11:23Z INFO client/internal/connect.go:115: starting NetBird client version development on linux/arm 2024-09-04T07:11:23Z DEBG client/internal/connect.go:176: connecting to the Management service api.netbird.io:443 2024-09-04T07:11:23Z INFO util/grpc/dialer.go:24: Custom dialer called for address: api.netbird.io:443 2024-09-04T07:11:23Z INFO util/grpc/dialer.go:32: Current user UID: 0 2024-09-04T07:11:23Z DEBG util/grpc/dialer.go:40: Using nbnet.NewDialer() 2024-09-04T07:11:23Z INFO util/net/dialer_nonios.go:68: Dialing tcp api.netbird.io:443 2024-09-04T07:11:23Z INFO util/net/net_linux.go:29: In Control function, fd: 8 2024-09-04T07:11:23Z INFO util/net/net_linux.go:47: Attempting to set SO_MARK on fd 8 2024-09-04T07:11:23Z INFO util/net/net_linux.go:55: NB_SKIP_SOCKET_MARK is set to true, skipping SO_MARK 2024-09-04T07:11:23Z DEBG util/net/net_linux.go:42: SetRawSocketMark completed successfully 2024-09-04T07:11:23Z DEBG util/net/dialer_nonios.go:74: d.Dialer.DialContext succeeded 2024-09-04T07:11:23Z DEBG util/grpc/dialer.go:46: nbnet.NewDialer().DialContext succeeded 2024-09-04T07:11:23Z DEBG client/internal/connect.go:184: connected to the Management service api.netbird.io:443 2024-09-04T07:11:24Z INFO util/grpc/dialer.go:24: Custom dialer called for address: signal.netbird.io:443 2024-09-04T07:11:24Z INFO util/grpc/dialer.go:32: Current user UID: 0 2024-09-04T07:11:24Z DEBG util/grpc/dialer.go:40: Using nbnet.NewDialer() 2024-09-04T07:11:24Z INFO util/net/dialer_nonios.go:68: Dialing tcp signal.netbird.io:443 2024-09-04T07:11:25Z INFO util/net/net_linux.go:29: In Control function, fd: 9 2024-09-04T07:11:25Z INFO util/net/net_linux.go:47: Attempting to set SO_MARK on fd 9 2024-09-04T07:11:25Z INFO util/net/net_linux.go:55: NB_SKIP_SOCKET_MARK is set to true, skipping SO_MARK 2024-09-04T07:11:25Z DEBG util/net/net_linux.go:42: SetRawSocketMark completed successfully 2024-09-04T07:11:25Z DEBG util/net/dialer_nonios.go:74: d.Dialer.DialContext succeeded 2024-09-04T07:11:25Z DEBG util/grpc/dialer.go:46: nbnet.NewDialer().DialContext succeeded 2024-09-04T07:11:25Z DEBG signal/client/grpc.go:81: connected to Signal Service: signal.netbird.io:443 2024-09-04T07:11:25Z TRAC client/internal/stdnet/filter.go:24: ignoring interface br-lan - it is not allowed 2024-09-04T07:11:25Z DEBG client/internal/wgproxy/proxy_ebpf.go:43: instantiate ebpf proxy 2024-09-04T07:11:25Z INFO util/net/net_linux.go:47: Attempting to set SO_MARK on fd 10 2024-09-04T07:11:25Z INFO util/net/net_linux.go:55: NB_SKIP_SOCKET_MARK is set to true, skipping SO_MARK 2024-09-04T07:11:25Z DEBG client/internal/ebpf/ebpf/wg_proxy_linux.go:11: load ebpf WG proxy 2024-09-04T07:11:25Z INFO util/net/net_linux.go:29: In Control function, fd: 15 2024-09-04T07:11:25Z INFO util/net/net_linux.go:47: Attempting to set SO_MARK on fd 15 2024-09-04T07:11:25Z INFO util/net/net_linux.go:55: NB_SKIP_SOCKET_MARK is set to true, skipping SO_MARK 2024-09-04T07:11:25Z DEBG util/net/net_linux.go:42: SetRawSocketMark completed successfully 2024-09-04T07:11:25Z INFO client/internal/wgproxy/proxy_ebpf.go:89: local wg proxy listening on: 3128 2024-09-04T07:11:25Z DEBG client/internal/routemanager/sysctl/sysctl_linux.go:87: Set sysctl net.ipv4.conf.all.src_valid_mark from 0 to 1 2024-09-04T07:11:25Z INFO client/internal/routemanager/manager.go:135: Routing setup complete 2024-09-04T07:11:25Z DEBG iface/tun_link_linux.go:63: adding device: wt0 2024-09-04T07:11:25Z DEBG iface/tun_link_linux.go:113: adding address 100.79.229.105/16 to interface: wt0 2024-09-04T07:11:25Z DEBG iface/tun_kernel_unix.go:64: setting MTU: 1280 interface: wt0 2024-09-04T07:11:25Z DEBG iface/wg_configurer_kernel_unix.go:27: adding Wireguard private key 2024-09-04T07:11:25Z INFO client/firewall/create_linux.go:45: creating an iptables firewall manager 2024-09-04T07:11:25Z DEBG client/firewall/iptables/router_linux.go:179: flushing routing related tables 2024-09-04T07:11:26Z DEBG iface/tun_kernel_unix.go:88: bringing up interface: wt0 2024-09-04T07:11:26Z INFO util/net/net_linux.go:29: In Control function, fd: 19 2024-09-04T07:11:26Z INFO util/net/net_linux.go:47: Attempting to set SO_MARK on fd 19 2024-09-04T07:11:26Z INFO util/net/net_linux.go:55: NB_SKIP_SOCKET_MARK is set to true, skipping SO_MARK 2024-09-04T07:11:26Z DEBG util/net/net_linux.go:42: SetRawSocketMark completed successfully 2024-09-04T07:11:26Z INFO util/net/net_linux.go:29: In Control function, fd: 21 2024-09-04T07:11:26Z INFO util/net/net_linux.go:47: Attempting to set SO_MARK on fd 21 2024-09-04T07:11:26Z INFO util/net/net_linux.go:55: NB_SKIP_SOCKET_MARK is set to true, skipping SO_MARK 2024-09-04T07:11:26Z DEBG util/net/net_linux.go:42: SetRawSocketMark completed successfully 2024-09-04T07:11:26Z DEBG iface/tun_kernel_unix.go:110: device is ready to use: wt0 2024-09-04T07:11:26Z INFO client/internal/dns/host_unix.go:68: System DNS manager discovered: file 2024-09-04T07:11:26Z DEBG signal/client/grpc.go:126: signal connection state READY 2024-09-04T07:11:26Z INFO signal/client/grpc.go:147: connected to the Signal Service stream 2024-09-04T07:11:26Z DEBG client/internal/engine.go:679: connecting to Management Service updates stream 2024-09-04T07:11:26Z INFO client/internal/engine.go:1478: Network monitor is disabled, not starting 2024-09-04T07:11:26Z INFO client/internal/connect.go:263: Netbird engine started, the IP is: 100.79.229.105/16 2024-09-04T07:11:26Z INFO client/cmd/service_controller.go:66: started daemon server: /var/run/netbird.sock 2024-09-04T07:11:26Z DEBG management/client/grpc.go:114: management connection state READY 2024-09-04T07:11:26Z INFO management/client/grpc.go:155: connected to the Management Service stream 2024-09-04T07:11:27Z DEBG management/client/grpc.go:252: got an update message from Management Service 2024-09-04T07:11:27Z DEBG client/internal/engine.go:705: got TURNs update from Management Service, updating 2024-09-04T07:11:27Z DEBG client/internal/engine.go:687: got STUNs update from Management Service, updating 2024-09-04T07:11:27Z WARN client/internal/engine.go:583: running SSH server is not permitted 2024-09-04T07:11:27Z DEBG client/internal/engine.go:750: got peers update from Management Service, total peers to connect to = 5 2024-09-04T07:11:27Z DEBG client/internal/routemanager/client.go:365: Received a new client network route update for [10.100.0.0/24] 2024-09-04T07:11:27Z DEBG client/internal/engine.go:991: creating peer connection TWqUoZfKeoVLJhNXElSgb7jCxT+Woj10q1A/CdNX1lU= 2024-09-04T07:11:27Z DEBG client/internal/routemanager/client.go:373: Client network update contains different routes, recalculating routes 2024-09-04T07:11:27Z DEBG client/internal/routemanager/client.go:79: couldn't fetch peer state: peer not found 2024-09-04T07:11:27Z DEBG client/internal/routemanager/client.go:79: couldn't fetch peer state: peer not found 2024-09-04T07:11:27Z WARN client/internal/routemanager/client.go:166: The network [10.100.0.0/24] has not been assigned a routing peer as no peers from the list [oA2X5dBvPmn1c1d9SOdOZoHe4KM1pho9pybwsUO0T30= TWqUoZfKeoVLJhNXElSgb7jCxT+Woj10q1A/CdNX1lU=] are currently connected 2024-09-04T07:11:27Z DEBG client/internal/engine.go:991: creating peer connection cavC6Fl1/Hj0mt7zGNLN3oWYzh4EwTFOLtPJlt3Xpzg= 2024-09-04T07:11:27Z DEBG client/internal/engine.go:991: creating peer connection +Yas9r/YFa6naMpQrAxL2OMgRflaGdru8r+hwcyDYRs= 2024-09-04T07:11:27Z DEBG client/internal/engine.go:991: creating peer connection oA2X5dBvPmn1c1d9SOdOZoHe4KM1pho9pybwsUO0T30= 2024-09-04T07:11:27Z DEBG client/internal/engine.go:991: creating peer connection KllUo0iSxLBD8v6nYa5oi+26yHIJf9YLl6+hQVWKqEY= 2024-09-04T07:11:27Z WARN client/internal/dns/service_listener.go:188: binding dns on 100.79.229.105:53 is not available, error: listen udp 100.79.229.105:53: bind: address already in use 2024-09-04T07:11:27Z WARN client/internal/dns/service_listener.go:188: binding dns on 127.0.0.1:53 is not available, error: listen udp 127.0.0.1:53: bind: address already in use 2024-09-04T07:11:27Z DEBG client/internal/dns/service_listener.go:69: starting dns on 127.0.0.153:53 2024-09-04T07:11:27Z ERRO client/internal/dns/server.go:322: unable to configure DNS for this peer using file manager without a nameserver group with all domains configured 2024-09-04T07:11:27Z INFO client/internal/acl/manager.go:52: ACL rules processed in: 63.346104ms, total rules count: 2 2024-09-04T07:11:27Z DEBG client/internal/peer/conn.go:256: trying to connect to peer oA2X5dBvPmn1c1d9SOdOZoHe4KM1pho9pybwsUO0T30= 2024-09-04T07:11:27Z TRAC client/internal/stdnet/filter.go:24: ignoring interface br-lan - it is not allowed 2024-09-04T07:11:27Z TRAC client/internal/stdnet/filter.go:24: ignoring interface wt0 - it is not allowed 2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:256: trying to connect to peer TWqUoZfKeoVLJhNXElSgb7jCxT+Woj10q1A/CdNX1lU= 2024-09-04T07:11:28Z TRAC client/internal/stdnet/filter.go:24: ignoring interface br-lan - it is not allowed 2024-09-04T07:11:28Z TRAC client/internal/stdnet/filter.go:24: ignoring interface wt0 - it is not allowed 2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:288: connection offer sent to peer oA2X5dBvPmn1c1d9SOdOZoHe4KM1pho9pybwsUO0T30=, waiting for the confirmation 2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:256: trying to connect to peer KllUo0iSxLBD8v6nYa5oi+26yHIJf9YLl6+hQVWKqEY= 2024-09-04T07:11:28Z TRAC client/internal/stdnet/filter.go:24: ignoring interface br-lan - it is not allowed 2024-09-04T07:11:28Z TRAC client/internal/stdnet/filter.go:24: ignoring interface wt0 - it is not allowed 2024-09-04T07:11:28Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: oA2X5dBvPmn1c1d9SOdOZoHe4KM1pho9pybwsUO0T30=] 2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:288: connection offer sent to peer TWqUoZfKeoVLJhNXElSgb7jCxT+Woj10q1A/CdNX1lU=, waiting for the confirmation 2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:741: OnRemoteAnswer from peer oA2X5dBvPmn1c1d9SOdOZoHe4KM1pho9pybwsUO0T30= on status Disconnected 2024-09-04T07:11:28Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: TWqUoZfKeoVLJhNXElSgb7jCxT+Woj10q1A/CdNX1lU=] 2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:309: received connection confirmation from peer oA2X5dBvPmn1c1d9SOdOZoHe4KM1pho9pybwsUO0T30= running version 0.28.7 and with remote WireGuard listen port 51819 2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:639: peer oA2X5dBvPmn1c1d9SOdOZoHe4KM1pho9pybwsUO0T30= ICE ConnectionState has changed to Checking 2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:603: discovered local candidate udp4 host 100.122.82.135:51820 2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:741: OnRemoteAnswer from peer TWqUoZfKeoVLJhNXElSgb7jCxT+Woj10q1A/CdNX1lU= on status Disconnected 2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:309: received connection confirmation from peer TWqUoZfKeoVLJhNXElSgb7jCxT+Woj10q1A/CdNX1lU= running version 0.28.7 and with remote WireGuard listen port 51819 2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:639: peer TWqUoZfKeoVLJhNXElSgb7jCxT+Woj10q1A/CdNX1lU= ICE ConnectionState has changed to Checking 2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:603: discovered local candidate udp4 host 100.122.82.135:51820 2024-09-04T07:11:28Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: TWqUoZfKeoVLJhNXElSgb7jCxT+Woj10q1A/CdNX1lU=] 2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer TWqUoZfKeoVLJhNXElSgb7jCxT+Woj10q1A/CdNX1lU= -> udp4 host 195.201.20.51:51819 2024-09-04T07:11:28Z DEBG iface/bind/udp_mux.go:346: ICE: registered 195.201.20.51:51819 for XkEMDondlghhExfB 2024-09-04T07:11:28Z INFO util/net/dialer_nonios.go:68: Dialing tcp4 94.237.103.92:443 2024-09-04T07:11:28Z INFO util/net/net_linux.go:29: In Control function, fd: 23 2024-09-04T07:11:28Z INFO util/net/net_linux.go:47: Attempting to set SO_MARK on fd 23 2024-09-04T07:11:28Z INFO util/net/net_linux.go:55: NB_SKIP_SOCKET_MARK is set to true, skipping SO_MARK 2024-09-04T07:11:28Z DEBG util/net/net_linux.go:42: SetRawSocketMark completed successfully 2024-09-04T07:11:28Z INFO util/net/dialer_nonios.go:68: Dialing tcp4 94.237.103.92:443 2024-09-04T07:11:28Z INFO util/net/net_linux.go:29: In Control function, fd: 24 2024-09-04T07:11:28Z INFO util/net/net_linux.go:47: Attempting to set SO_MARK on fd 24 2024-09-04T07:11:28Z INFO util/net/net_linux.go:55: NB_SKIP_SOCKET_MARK is set to true, skipping SO_MARK 2024-09-04T07:11:28Z DEBG util/net/net_linux.go:42: SetRawSocketMark completed successfully 2024-09-04T07:11:28Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: TWqUoZfKeoVLJhNXElSgb7jCxT+Woj10q1A/CdNX1lU=] 2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:288: connection offer sent to peer KllUo0iSxLBD8v6nYa5oi+26yHIJf9YLl6+hQVWKqEY=, waiting for the confirmation 2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer TWqUoZfKeoVLJhNXElSgb7jCxT+Woj10q1A/CdNX1lU= -> udp4 srflx 195.201.20.51:51819 related 0.0.0.0:51819 2024-09-04T07:11:28Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: oA2X5dBvPmn1c1d9SOdOZoHe4KM1pho9pybwsUO0T30=] 2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:603: discovered local candidate udp4 srflx 37.30.16.87:51480 related 0.0.0.0:51820 2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:603: discovered local candidate udp4 srflx 37.30.16.87:51480 related 0.0.0.0:51820 2024-09-04T07:11:28Z DEBG iface/bind/udp_mux.go:346: ICE: registered 195.201.20.51:51819 for XkEMDondlghhExfBturns:turn.netbird.io:443?transport=tcp 2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer oA2X5dBvPmn1c1d9SOdOZoHe4KM1pho9pybwsUO0T30= -> udp4 host 192.168.27.247:51819 2024-09-04T07:11:28Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: oA2X5dBvPmn1c1d9SOdOZoHe4KM1pho9pybwsUO0T30=] 2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer oA2X5dBvPmn1c1d9SOdOZoHe4KM1pho9pybwsUO0T30= -> udp4 host 192.168.122.1:51819 2024-09-04T07:11:28Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.122.1:51819 for ezdEKYfrUbObvlzK 2024-09-04T07:11:28Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.122.1:51819 for ezdEKYfrUbObvlzKturns:turn.netbird.io:443?transport=tcp 2024-09-04T07:11:28Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.27.247:51819 for ezdEKYfrUbObvlzK 2024-09-04T07:11:28Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.27.247:51819 for ezdEKYfrUbObvlzKturns:turn.netbird.io:443?transport=tcp 2024-09-04T07:11:28Z DEBG util/net/dialer_nonios.go:74: d.Dialer.DialContext succeeded 2024-09-04T07:11:28Z DEBG util/net/dialer_nonios.go:74: d.Dialer.DialContext succeeded 2024-09-04T07:11:28Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: TWqUoZfKeoVLJhNXElSgb7jCxT+Woj10q1A/CdNX1lU=] 2024-09-04T07:11:28Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer TWqUoZfKeoVLJhNXElSgb7jCxT+Woj10q1A/CdNX1lU= -> udp4 relay 94.237.103.92:61035 related 195.201.20.51:51032 2024-09-04T07:11:28Z DEBG iface/bind/udp_mux.go:346: ICE: registered 94.237.103.92:61035 for XkEMDondlghhExfB 2024-09-04T07:11:28Z DEBG iface/bind/udp_mux.go:346: ICE: registered 94.237.103.92:61035 for XkEMDondlghhExfBturns:turn.netbird.io:443?transport=tcp + /etc/init.d/netbird stop Stopping netbird...... Stopped + popd ~/dev/github.com/nazarewk-iac/nix-configs/packages/netbird-armv6 kdn@oams ~/d/g/n/n/p/netbird-armv6 (main)> ``` </details>
saavagebueno added the triage-needed label 2025-11-20 05:26:08 -05:00
saavagebueno commented 2025-11-20 05:26:08 -05:00
Author
Owner
Copy Link

@nazarewk commented on GitHub (Sep 4, 2024):

cross-posting https://github.com/netbirdio/netbird/issues/730#issuecomment-2329119310

I had to add NB_ICE_FORCE_RELAY_CONN=true due to mobile (4G/5G etc.) routers usually being behind CG-NAT and I had no connectivity outside router's LAN. This turned all (even local) connections to be routed over internet, but at least it works.

@nazarewk commented on GitHub (Sep 4, 2024): cross-posting https://github.com/netbirdio/netbird/issues/730#issuecomment-2329119310 I had to add `NB_ICE_FORCE_RELAY_CONN=true` due to mobile (4G/5G etc.) routers usually being behind CG-NAT and I had no connectivity outside router's LAN. This turned all (even local) connections to be routed over internet, but at least it works.
saavagebueno commented 2025-11-20 05:26:09 -05:00
Author
Owner
Copy Link

@felixn-unity commented on GitHub (Nov 16, 2024):

Hi

Any progress on getting Netbird to run on Teltonika RUTX__

Thanks
Felix

@felixn-unity commented on GitHub (Nov 16, 2024): Hi Any progress on getting Netbird to run on Teltonika RUTX__ Thanks Felix
saavagebueno commented 2025-11-20 05:26:09 -05:00
Author
Owner
Copy Link

@nazarewk commented on GitHub (Nov 18, 2024):

I got it to work with https://github.com/netbirdio/netbird/issues/730#issuecomment-2329119310 linked above:

  1. NB_DISABLE_CUSTOM_ROUTING=true (actually got a more precise option in my patched fork) to fix one of the issues
  2. NB_ICE_FORCE_RELAY_CONN=true to work aroung CG-NAT
  3. looks like I'm building armv6 binaries: GOARM=6 GOARCH=arm CGO_ENABLED=0 go build "${go_args[@]}" -o "${out}" "${local}/client"
@nazarewk commented on GitHub (Nov 18, 2024): I got it to work with https://github.com/netbirdio/netbird/issues/730#issuecomment-2329119310 linked above: 1. `NB_DISABLE_CUSTOM_ROUTING=true` (actually got a more precise option in my patched fork) to fix one of the issues 2. `NB_ICE_FORCE_RELAY_CONN=true` to work aroung CG-NAT 3. looks like I'm building `armv6` binaries: ` GOARM=6 GOARCH=arm CGO_ENABLED=0 go build "${go_args[@]}" -o "${out}" "${local}/client"`
saavagebueno commented 2025-11-20 05:26:09 -05:00
Author
Owner
Copy Link

@felixn-unity commented on GitHub (Nov 18, 2024):

thanks! - do you have a patched ipk I can get?

@felixn-unity commented on GitHub (Nov 18, 2024): thanks! - do you have a patched ipk I can get?
saavagebueno commented 2025-11-20 05:26:09 -05:00
Author
Owner
Copy Link

@nazarewk commented on GitHub (Nov 18, 2024):

thanks! - do you have a patched ipk I can get?

I don't know how to write or edit OpenWRT packages also it's switching to apk

@nazarewk commented on GitHub (Nov 18, 2024): > thanks! - do you have a patched ipk I can get? I don't know how to write or edit OpenWRT packages also [it's switching to `apk`](https://forum.openwrt.org/t/major-change-notice-new-package-manager/215682)
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
2021 Q4
2022 Q1
2022 Q1
accessibility
acl
agent
agent
Android
Android
api
authentik
automation
azure
battery-usage
bug
cache
client
client-ui
cloud
cloud-only
cloudflare
community
compatibility
config-idp
config-issue
connection
contribution
coturn
cross-vpn
dashboard
data-usage
distribution
dns
docker
documentation
duplicate
enhancement
enhancement
event-stream
feature-request
freebsd
getting-started
go
good first issue
gui
help wanted
home-assistant
idp
inconsistency
integration
integrations
ios
ipv6
jwt
k8s
keycloak
linux
login
macos
management-service
missing-docs
mobile
moved-internal
needs-review
netbird-ui
networking
new-platform
nginx
notification
okta
openwrt
packaging
peer-management
peer-management
peer-management
performance
postgres
posture-checks
psk
pull-request
Mirrored from GitHub Pull Request
 question
refactor
relay
release
rfc
routes
security
security-related
self-hosting
server
signal
sleep-issue
ssh
ssl
status
store
synology
system-compatibility-issue
test-suite
third-party-integration
triage
triage-needed
troubleshooting
UX
waiting-feedback
windows
wontfix
zitadel
No Label triage-needed
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
saavagebueno
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: SVI/netbird#1216
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?