Diversion Diversion 5.1.3 - the Router Ad-Blocker, May 09, 2024

[bibikalka]

I don't know. I was assuming with custom DNS you mean a third party DNS resolver. But you are using a Diversion service which is not custom.
Anyway, the excerpt above is the log of Diversion trying to start a separate Dnsmasq instance for the service "Exclude devices from ad-blocking" on IP 192.168.1.16 which is already in use by something else.

Are you sure this IP is not used by any of your other devices on the network?
.16 is a high number of reserved addresses as you should have set during the setup of this service in Diversion. What is the routers IP address, what is your "IP Pool Starting Address" and "IP Pool Ending Address" in LAN/DHCP Server in the routers WebUI?


This is also suspicious that your setup is completely borked or generally wrong as the main Dnsmasq instance fails to start up.

Yes, nothing out of ordinary.

dhcp-range=lan,192.168.1.32,192.168.1.254,255.255.255.0,86400s

I guess maybe pixel-serv is running somewhere?

I walk to the router, hit the power button, and then it reboots fine. The errors are similar of Diversion 5.1.0 when the dnsmasq got updated to 2.90 with 386.12_6, and that required the 5.1.1 fix. The issue appears a bit intermittent - not all the time like last time.

I guess I could try flash 386.13_2 again, so it goes to the 2nd set of partitions? I had this issue with 386.13_0, but Diversion re-install fixed that. I have daily backups, but nothing appears to have changed after I updated to 13_2.

 

[bibikalka]

This is also suspicious that your setup is completely borked or generally wrong as the main Dnsmasq instance fails to start up.

Unrolled back to 386.13_0. Will see how it goes tomorrow during morning auto-reboot!

 

[bibikalka]

Unrolled back to 386.13_0. Will see how it goes tomorrow during morning auto-reboot!

Tried to reformat /jffs and restore backup - no improvement.
Tried to unroll to 13_0, 12_6, etc - still same issues even though worked before!
Changed non-blocking DNS server from 192.168.1.16 to 192.168.1.17 in Diversion - seems like the issues have disappeared. Rebooted a bunch of times - seems to reboot fine, with things working.

Will continue monitoring!

 

[bibikalka]

Got the same issue today, but not yesterday, on .17 address. There is absolutely nothing on that IP. I now think that a hot reboot (no power off) does not seem to clear the prior info for these. See this grep of dnsmasq and Diversion.

It seems a few steps are missing in the hot reboot case. Such as this message is missing:
rc_service: service 4604:notify_rc restart_dnsmasq

Bad hot reboot:

May  5 04:06:40 dnsmasq[1161]: using nameserver 172.16.1.254#53 for domain attlocal.net
May  5 04:06:40 dnsmasq[1161]: using only locally-known addresses for mask-h2.icloud.com
May  5 04:06:40 dnsmasq[1161]: using only locally-known addresses for mask.icloud.com
May  5 04:06:40 dnsmasq[1161]: using only locally-known addresses for _dns.resolver.arpa
May  5 04:06:40 dnsmasq[1161]: using only locally-known addresses for use-application-dns.net
May  5 04:06:48 dnsmasq-dhcp[1161]: DHCPDISCOVER(br0) fc:d4:36:f2:36:aa
May  5 04:06:48 dnsmasq-dhcp[1161]: DHCPOFFER(br0) 192.168.1.41 fc:d4:36:f2:36:aa
May  5 04:06:48 dnsmasq-dhcp[1161]: DHCPREQUEST(br0) 192.168.1.41 fc:d4:36:f2:36:aa
May  5 04:06:48 dnsmasq-dhcp[1161]: DHCPACK(br0) 192.168.1.41 fc:d4:36:f2:36:aa
May  5 04:06:55 Entware: Starting Entware and Diversion services on /tmp/mnt/ac86u
May  5 04:06:57 RT-AC86U-9988 Diversion: Mounting Diversion WebUI page
May  5 04:06:57 RT-AC86U-9988 Diversion: Mounted Diversion WebUI as user3.asp in LAN/Diversion
May  5 04:06:57 RT-AC86U-9988 Diversion: created br0:ad_blocking_excl for 192.168.1.17
May  5 04:06:57 RT-AC86U-9988 dnsmasq[5227]: failed to create listening socket for 192.168.1.17: Address already in use
May  5 04:06:57 RT-AC86U-9988 dnsmasq[5227]: FAILED to start up
May  5 04:06:57 RT-AC86U-9988 Diversion: started separate Dnsmasq instance for ad-blocking exclusion on IP 192.168.1.17
May  5 04:06:57 RT-AC86U-9988 Diversion: restarted Dnsmasq to apply settings
May  5 04:06:57 RT-AC86U-9988 (dnsmasq.postconf): Updating /etc/dnsmasq.conf for unbound.....
May  5 04:06:57 RT-AC86U-9988 uiDivStats: dnsmasq has restarted, restarting taildns

Good cold reboot:

May  5 07:19:19 dnsmasq[1159]: using nameserver 172.16.1.254#53
May  5 07:19:19 dnsmasq[1159]: using nameserver 172.16.1.254#53 for domain attlocal.net
May  5 07:19:19 dnsmasq[1159]: using only locally-known addresses for mask-h2.icloud.com
May  5 07:19:19 dnsmasq[1159]: using only locally-known addresses for mask.icloud.com
May  5 07:19:19 dnsmasq[1159]: using only locally-known addresses for _dns.resolver.arpa
May  5 07:19:19 dnsmasq[1159]: using only locally-known addresses for use-application-dns.net
May  5 07:19:26 dnsmasq-dhcp[1159]: DHCPDISCOVER(br0) 1c:93:c4:5d:28:6e
May  5 07:19:26 dnsmasq-dhcp[1159]: DHCPOFFER(br0) 192.168.1.69 1c:93:c4:5d:28:6e
May  5 07:19:26 dnsmasq-dhcp[1159]: DHCPREQUEST(br0) 192.168.1.69 1c:93:c4:5d:28:6e
May  5 07:19:26 dnsmasq-dhcp[1159]: DHCPACK(br0) 192.168.1.69 1c:93:c4:5d:28:6e
May  5 07:19:29 Entware: Starting Entware and Diversion services on /tmp/mnt/ac86u
May  5 07:19:34 RT-AC86U-9988 rc_service: service 4604:notify_rc restart_dnsmasq
May  5 07:19:34 RT-AC86U-9988 custom_script: Running /jffs/scripts/service-event (args: restart dnsmasq)
May  5 07:19:30 RT-AC86U-9988 dnsmasq[4219]: started, version 2.90 cachesize 150
May  5 07:19:34 RT-AC86U-9988 dnsmasq[4219]: overflow: 7 log entries lost
May  5 07:19:35 RT-AC86U-9988 rc_service: waitting "restart_dnsmasq" via  ...
May  5 07:19:35 RT-AC86U-9988 custom_config: Appending content of /jffs/configs/dnsmasq.conf.add.
May  5 07:19:35 RT-AC86U-9988 custom_script: Running /jffs/scripts/dnsmasq.postconf (args: /etc/dnsmasq.conf)
May  5 07:19:35 RT-AC86U-9988 Diversion: created br0:ad_blocking_excl for 192.168.1.17
May  5 07:19:35 RT-AC86U-9988 dnsmasq[5518]: started, version 2.90 cachesize 150
May  5 07:19:35 RT-AC86U-9988 dnsmasq[5518]: compile time options: IPv6 GNU-getopt no-RTC no-DBus no-UBus no-i18n no-IDN DHCP DHCPv6 no-Lua TFTP
May  5 07:19:35 RT-AC86U-9988 dnsmasq[5518]: read /etc/hosts - 22 names
May  5 07:19:35 RT-AC86U-9988 dnsmasq[5518]: using nameserver 172.16.1.254#53
May  5 07:19:35 RT-AC86U-9988 dnsmasq[5518]: using nameserver 172.16.1.254#53 for domain attlocal.net
May  5 07:19:35 RT-AC86U-9988 dnsmasq[5518]: using nameserver 172.16.1.254#53
May  5 07:19:35 RT-AC86U-9988 dnsmasq[5518]: using nameserver 172.16.1.254#53 for domain attlocal.net
May  5 07:19:35 RT-AC86U-9988 Diversion: started separate Dnsmasq instance for ad-blocking exclusion on IP 192.168.1.17
May  5 07:19:35 RT-AC86U-9988 Diversion: restarted Dnsmasq to apply settings
May  5 07:19:35 RT-AC86U-9988 (dnsmasq.postconf): Updating /etc/dnsmasq.conf for unbound.....
May  5 07:19:35 RT-AC86U-9988 uiDivStats: dnsmasq has restarted, restarting taildns
May  5 07:19:43 RT-AC86U-9988 rc_service: service 7970:notify_rc restart_dnsmasq
May  5 07:19:43 RT-AC86U-9988 custom_script: Running /jffs/scripts/service-event (args: restart dnsmasq)
May  5 07:19:43 RT-AC86U-9988 dnsmasq[5518]: exiting on receipt of SIGTERM
May  5 07:19:44 RT-AC86U-9988 custom_config: Appending content of /jffs/configs/dnsmasq.conf.add.
May  5 07:19:44 RT-AC86U-9988 custom_script: Running /jffs/scripts/dnsmasq.postconf (args: /etc/dnsmasq.conf)
May  5 07:19:44 RT-AC86U-9988 Diversion: created br0:ad_blocking_excl for 192.168.1.17
May  5 07:19:44 RT-AC86U-9988 dnsmasq[8642]: started, version 2.90 cachesize 150
May  5 07:19:44 RT-AC86U-9988 dnsmasq[8642]: compile time options: IPv6 GNU-getopt no-RTC no-DBus no-UBus no-i18n no-IDN DHCP DHCPv6 no-Lua TFTP
May  5 07:19:44 RT-AC86U-9988 dnsmasq[8642]: read /etc/hosts - 22 names
May  5 07:19:44 RT-AC86U-9988 dnsmasq[8642]: using nameserver 172.16.1.254#53
May  5 07:19:44 RT-AC86U-9988 dnsmasq[8642]: using nameserver 172.16.1.254#53 for domain attlocal.net

 

[thelonelycoder]

Bad hot reboot:

What is the reason you have so many reservations: dhcp-range=lan,192.168.1.32,192.168.1.254,255.255.255.0,86400s

 

[bibikalka]

What is the reason you have so many reservations: dhcp-range=lan,192.168.1.32,192.168.1.254,255.255.255.0,86400s

Well, I have about 30 devices on my network - so I am thinking 220 IP addresses should more than plenty for the rest of them.

I have some bridges and other stuff under 32, mostly under 16.

Is that a problem to leave a lot of addresses out of the DHCP pool?

 

[bibikalka]

I guess I did have prior issues with warm reboots - but mostly related to logging. As I look at it - it appears that the logging messages are quite different in the course of warm and cold reboots. This is the first time it's impacting my need to have stuff - I guess it could have been a different thing, but it happened here.

Here is the bad warm reboot segment:

May  5 04:06:57 RT-AC86U-9988 Diversion: Mounting Diversion WebUI page
May  5 04:06:57 RT-AC86U-9988 Diversion: Mounted Diversion WebUI as user3.asp in LAN/Diversion
May  5 04:06:57 RT-AC86U-9988 avahi-daemon[4210]: Registering new address record for 192.168.1.17 on br0.IPv4.
May  5 04:06:57 RT-AC86U-9988 Diversion: created br0:ad_blocking_excl for 192.168.1.17
May  5 04:06:57 RT-AC86U-9988 dnsmasq[5227]: failed to create listening socket for 192.168.1.17: Address already in use
May  5 04:06:57 RT-AC86U-9988 dnsmasq[5227]: FAILED to start up
May  5 04:06:57 RT-AC86U-9988 Diversion: started separate Dnsmasq instance for ad-blocking exclusion on IP 192.168.1.17
May  5 04:06:57 RT-AC86U-9988 Diversion: restarted Dnsmasq to apply settings
May  5 04:06:57 RT-AC86U-9988 (dnsmasq.postconf): Updating /etc/dnsmasq.conf for unbound.....
May  5 04:06:57 RT-AC86U-9988 uiDivStats: dnsmasq has restarted, restarting taildns
May  5 04:06:57 RT-AC86U-9988 admin: Started ntpd from /jffs/scripts/post-mount.
May  5 04:06:57 RT-AC86U-9988 admin: Started taildns from /jffs/scripts/post-mount.
May  5 04:06:58 RT-AC86U-9988 rc_service: service 5326:notify_rc restart_dnsmasq
May  5 04:06:58 RT-AC86U-9988 rc_service: waitting "start_samba" via  ...
May  5 04:06:58 RT-AC86U-9988 dnsmasq[5256]: failed to create listening socket for 192.168.1.1: Address already in use
May  5 04:06:58 RT-AC86U-9988 dnsmasq[5256]: FAILED to start up
May  5 04:06:58 RT-AC86U-9988 Samba_Server: daemon is started
May  5 04:06:58 RT-AC86U-9988 wsdd2[5348]: starting.
May  5 04:06:58 RT-AC86U-9988 custom_script: Running /jffs/scripts/service-event (args: start logger)

Good reboot segment:

May  5 07:19:29 custom_script: Running /jffs/scripts/post-mount (args: /tmp/mnt/ac86u)
May  5 07:19:29 Entware: Starting Entware and Diversion services on /tmp/mnt/ac86u
...
May  5 07:19:35 RT-AC86U-9988 scMerlin: Mounted Sitemap page as user3.asp
May  5 07:19:35 RT-AC86U-9988 rc_service: hotplug 2467:notify_rc restart_nasapps
May  5 07:19:35 RT-AC86U-9988 rc_service: waitting "restart_dnsmasq" via  ...
May  5 07:19:35 RT-AC86U-9988 scMerlin: Mounted scMerlin WebUI page as user2.asp
May  5 07:19:35 RT-AC86U-9988 custom_config: Appending content of /jffs/configs/dnsmasq.conf.add.
May  5 07:19:35 RT-AC86U-9988 custom_script: Running /jffs/scripts/dnsmasq.postconf (args: /etc/dnsmasq.conf)
May  5 07:19:35 RT-AC86U-9988 Diversion: created br0:ad_blocking_excl for 192.168.1.17
May  5 07:19:35 RT-AC86U-9988 dnsmasq[5518]: started, version 2.90 cachesize 150
May  5 07:19:35 RT-AC86U-9988 dnsmasq[5518]: compile time options: IPv6 GNU-getopt no-RTC no-DBus no-UBus no-i18n no-IDN DHCP DHCPv6 no-Lua TFTP no-conntrack ipset no-nftset no-auth cryptohash DNSSEC no-ID loop-detect no-inotify no-dumpfile
May  5 07:19:35 RT-AC86U-9988 dnsmasq[5518]: read /etc/hosts - 22 names
May  5 07:19:35 RT-AC86U-9988 dnsmasq[5518]: using nameserver 172.16.1.254#53
May  5 07:19:35 RT-AC86U-9988 dnsmasq[5518]: using nameserver 172.16.1.254#53 for domain attlocal.net
May  5 07:19:35 RT-AC86U-9988 dnsmasq[5518]: using nameserver 172.16.1.254#53
May  5 07:19:35 RT-AC86U-9988 dnsmasq[5518]: using nameserver 172.16.1.254#53 for domain attlocal.net
May  5 07:19:35 RT-AC86U-9988 Diversion: started separate Dnsmasq instance for ad-blocking exclusion on IP 192.168.1.17
May  5 07:19:35 RT-AC86U-9988 Diversion: restarted Dnsmasq to apply settings
May  5 07:19:35 RT-AC86U-9988 (dnsmasq.postconf): Updating /etc/dnsmasq.conf for unbound.....
May  5 07:19:35 RT-AC86U-9988 uiDivStats: dnsmasq has restarted, restarting taildns
May  5 07:19:36 RT-AC86U-9988 custom_script: Running /jffs/scripts/service-event (args: restart nasapps)

 

[thelonelycoder]

@bibikalka turn off logging in Diversion and then do a warm reboot. Then look in the Syslog if any of the devices grabs that IP before Diversion kicks in.

 

[bibikalka]

@bibikalka turn off logging in Diversion and then do a warm reboot. Then look in the Syslog if any of the devices grabs that IP before Diversion kicks in.

I don't think this is an actual issue due to Diversion. It's a an issue due to a warm reboot that still "remembers" stuff.

I think that .17 IP is the ghost of the pre-warm boot Diversion server. Is there a command to release all existing IP allocations? I'd put it somewhere early in the boot process. Alternatively, I could put in a logging command early in the process, to list "active" IP addresses. Right now both "ip neigh" and "arp -a" don't show .17 even after a cold reboot. I need more potent commands

 

[thelonelycoder]

I don't think this is an actual issue due to Diversion. It's a an issue due to a warm reboot that still "remembers" stuff.

I think that .17 IP is the ghost of the pre-warm boot Diversion server. Is there a command to release all existing IP allocations? I'd put it somewhere early in the boot process. Alternatively, I could put in a logging command early in the process, to list "active" IP addresses. Right now both "ip neigh" and "arp -a" don't show .17 even after a cold reboot. I need more potent commands

Try this and report back:
Add this line below the Diversion entry in /jffs/scripts/unmount

ifconfig br0:ad_blocking_excl 192.168.1.17 down

 

[bibikalka]

Try this and report back:
Add this line below the Diversion entry in /jffs/scripts/unmount

ifconfig br0:ad_blocking_excl 192.168.1.17 down

OK! Added it! Will monitor for a week - and report back!

Thanks again!!!

 

[thelonelycoder]

Diversion 5.1.3 is now available

What's new

• Deregisters additional Dnsmasq instance IPs when rebooting. Thanks to @bibikalka for reporting

On some router models a reboot does not deregister virtual IP interfaces. This fixes it. @bibikalka you can remove the line in /jffs/scripts/unmount I asked to add.