Diversion Diversion 5.1.3 - the Router Ad-Blocker, May 09, 2024

[Aziron5]

It happened to me right now on RT-AX68U: error hostslist empty or not found ...

Some extra info ... the only obvious things I can recall right now was that WAN IPs changed several times, many reconnects, limited connectivity (modem link but no WAN), and the whole router was turned on idling without WAN or any DHCP clients for days (so it had a period of like no DNS activity of any kind)

 

[thelonelycoder]

It happened to me right now on RT-AX68U: error hostslist empty or not found ...

Any extra info ... the only obvious things I can recall right now was that WAN IPs changed several times, many reconnects, limited connectivity (modem link but no WAN), and the whole router was turned on idling without WAN or any DHCP clients for days (so it had a period of like no DNS activity of any kind)

Is Diversion updated to 5.1.2? Check the Update-blocking-list.log with sf in the SSH UI.

 

[SomeWhereOverTheRainBow]

Well, it finally happened - I met a forum member and user of my scripts in real life here in my hometown Lucerne, Switzerland. @visortgw is in town for two days with his charming wife and friends for a trip across part of Europe. Thank you for dinner, I enjoyed the in person exchange after so many years of collaboration and discussions on this board.

You were in good company!

 

[zer0bitz]

My usual luck is in play today.

Just updated firmware and got my router configured. Installed all of the scripts and lastly tried to install Diversion only to get error message that it cant download the Standard blocking list and for dnsmasq to fail to start.

I gotta reset my router again because its so unresponsive. What do with Diversion installation because I cant go manually change the blocking list? Too bad I didnt screenshot what goes wrong during it trying to download the Standard blocking list.

 

[Ripshod]

My usual luck is in play today.

Just updated firmware and got my router configured. Installed all of the scripts and lastly tried to install Diversion only to get error message that it cant download the Standard blocking list and for dnsmasq to fail to start.

I gotta reset my router again because its so unresponsive. What do with Diversion installation because I cant go manually change the blocking list? Too bad I didnt screenshot what goes wrong during it trying to download the Standard blocking list.

Just had to rebuild from scratch after updating Merlin, and I have to say I had no issues installing Diversion with the Standard list. I've switched to the Large list now though.

 

[zer0bitz]

Just had to rebuild from scratch after updating Merlin, and I have to say I had no issues installing Diversion with the Standard list. I've switched to the Large list now though.

Really strange. Im gonna try again if I get same error as last time. Will edit this post with screenshots if it happens.

Edit: Well it downloaded the blocking list and everything working. Switched also to Large list.

 

[Aziron5]

Is Diversion updated to 5.1.2? Check the Update-blocking-list.log with sf in the SSH UI.

Update did not fix. hostslist still empty. Troubleshoot further or just manually fix?

That's how it started:

Apr 15 12:00:16 Diversion: https://small.oisd.nl/dnsmasq2 is not a valid compatible file format, removing it from the hostslist

 

[martinr]

Well, it finally happened - I met a forum member and user of my scripts in real life here in my hometown Lucerne, Switzerland. @visortgw is in town for two days with his charming wife and friends for a trip across part of Europe. Thank you for dinner, I enjoyed the in person exchange after so many years of collaboration and discussions on this board.

I’ll wait till I hear visortgw’s version of events before I book my trip to Lucerne.

Only joking. I think that’s terrific, and I’m sure other members of this fraternity visiting Switzerland would arrange their trips to include a Diversion to Lucerne for a similar meet-up, especially as you’ve been so kind as to tell us about it. Really good to hear you enjoyed it so much.

 

[thelonelycoder]

Update did not fix. hostslist still empty. Troubleshoot further or just manually fix?

That's how it started:

Apr 15 12:00:16 Diversion: https://small.oisd.nl/dnsmasq2 is not a valid compatible file format, removing it from the hostslist

Fix this by re-selecting the desired blocking list in b, 1.

 

[thelonelycoder]

I’ll wait till I hear visortgw’s version of events before I book my trip to Lucerne.

Only joking. I think that’s terrific, and I’m sure other members of this fraternity visiting Switzerland would arrange their trips to include a Diversion to Lucerne for a similar meet-up, especially as you’ve been so kind as to tell us about it. Really good to hear you enjoyed it so much.

@thelonelycoder Spotting!

I'm in Lucerne (or Luzern) Switzerland with my wife and two other couples for a pre-cruise extension to a Viking Rhine Cruise. I had the pleasure of dining (and a couple of beers) with @thelonelycoder at the Rathaus Braueri. Great authentic Swiss food, locally brewed beer, and great...

www.snbforums.com

 

[martinr]

@thelonelycoder Spotting!

I'm in Lucerne (or Luzern) Switzerland with my wife and two other couples for a pre-cruise extension to a Viking Rhine Cruise. I had the pleasure of dining (and a couple of beers) with @thelonelycoder at the Rathaus Braueri. Great authentic Swiss food, locally brewed beer, and great...

www.snbforums.com

. I need to widen my horizons concerning the other forums I visit. I think that those of us who’ve been around since, and fondly remember, AB Solution days, should get our own special T-shirt, or jacket.

 

[thelonelycoder]

. I need to widen my horizons concerning the other forums I visit. I think that those of us who’ve been around since, and fondly remember, AB Solution days, should get our own special T-shirt, or jacket.

Ah, the old I SURVIVED AB-SOLUTION t-shirt. Those were the days. @visortgw was one of the few beta testers I invited back then. We had lively conversations.

 

[jsbeddow]

Ah, the old I SURVIVED AB-SOLUTION t-shirt. Those were the days. @visortgw was one of the few beta testers I invited back then. We had lively conversations.

Was it really that long ago? If so, sign me up for one of those commemorative t-shirts , as I fondly recall AB-Solution as well.

 

[bibikalka]

Installed 386.13_0 on AC86U. Every other reboot appear to be back to the prior troubles. Forced diversion 5.1.1 to force update itself, will see how it goes!

Apr 15 08:30:32 RT-AC86U-9988 dnsmasq[5555]: FAILED to start up

OK, forced update back to 5.1.1 worked - it was stable. Then I updated to 5.1.2 - still stable.

Now I just updated to 386.13_2 yesterday, and got the same issue this morning upon auto reboot. Now forced updated 5.1.2 again, will see what happens!

Apr 30 04:06:49 RT-AC86U-9988 dnsmasq[4292]: FAILED to start up
Apr 30 04:06:49 RT-AC86U-9988 dnsmasq[4358]: FAILED to start up
Apr 30 04:06:58 RT-AC86U-9988 dnsmasq[9575]: FAILED to start up
Apr 30 04:06:59 RT-AC86U-9988 dnsmasq[10683]: FAILED to start up
Apr 30 04:07:00 RT-AC86U-9988 dnsmasq[10779]: FAILED to start up
Apr 30 04:07:04 RT-AC86U-9988 dnsmasq[13775]: FAILED to start up
Apr 30 04:07:05 RT-AC86U-9988 dnsmasq[13949]: FAILED to start up
Apr 30 04:43:14 RT-AC86U-9988 dnsmasq[67573]: FAILED to start up
Apr 30 04:43:15 RT-AC86U-9988 dnsmasq[67631]: FAILED to start up
Apr 30 04:43:33 RT-AC86U-9988 dnsmasq[68950]: FAILED to start up
Apr 30 04:43:33 RT-AC86U-9988 dnsmasq[68979]: FAILED to start up
Apr 30 04:44:03 RT-AC86U-9988 dnsmasq[69530]: FAILED to start up
Apr 30 04:44:03 RT-AC86U-9988 dnsmasq[69560]: FAILED to start up
Apr 30 04:44:33 RT-AC86U-9988 dnsmasq[70038]: FAILED to start up
Apr 30 04:44:33 RT-AC86U-9988 dnsmasq[70068]: FAILED to start up

 

[dave14305]

Now I just updated to 386.13_2 yesterday, and got the same issue this morning upon auto reboot. Now forced updated 5.1.2 again, will see what happens!

There should be something else in the log before that FAILED line. There’s likely a duplicate parameter in your configs.

cat /etc/dnsmasq.conf
cat /jffs/configs/dnsmasq.conf*
cat /jffs/scripts/dnsmasq.postconf

 

[bibikalka]

There should be something else in the log before that FAILED line. There’s likely a duplicate parameter in your configs.

cat /etc/dnsmasq.conf
cat /jffs/configs/dnsmasq.conf*
cat /jffs/scripts/dnsmasq.postconf

All 3:

admin@RT-AC86U-9988:/tmp/home/root# source /opt/var/log/dump.all
pid-file=/var/run/dnsmasq.pid
user=nobody
bind-dynamic
interface=br0
interface=pptp*
no-dhcp-interface=pptp*
no-resolv
servers-file=/tmp/resolv.dnsmasq
no-poll
no-negcache
cache-size=1500
min-port=4096
bogus-priv
domain-needed
dhcp-range=lan,192.168.1.32,192.168.1.254,255.255.255.0,86400s
dhcp-option=lan,3,192.168.1.1
dhcp-option=lan,252,"\n"
dhcp-authoritative
interface=br1
dhcp-range=br1,192.168.101.2,192.168.101.254,255.255.255.0,86400s
dhcp-option=br1,3,192.168.101.1
interface=br2
dhcp-range=br2,192.168.102.2,192.168.102.254,255.255.255.0,86400s
dhcp-option=br2,3,192.168.102.1
dhcp-host=54:MAC,set:54:MAC,192.168.1.12
dhcp-host=00:MAC,set:00:MAC,192.168.1.9
address=/use-application-dns.net/
address=/_dns.resolver.arpa/
address=/mask.icloud.com/mask-h2.icloud.com/
dhcp-name-match=set:wpad-ignore,wpad
dhcp-ignore-names=tag:wpad-ignore
dhcp-script=/sbin/dhcpc_lease
script-arp
edns-packet-max=1232
ipset=/1drv.ms/aax-eu.amazon-adsystem.com/aax-us-east.amazon-adsystem.com/asuswrt-merlin.net/asuswrt.lostrealm.ca/big.oisd.nl/bin.entware.net/cdn.staticneo.com/clarium.global.ssl.fastly.net/codeload.github.com/diversion.ch/entware.diversion.ch/entware.net/fls-na.amazon-adsystem.com/fwupdate.asuswrt-merlin.net/ib.adnxs.com/images-na.ssl-images-amazon.com/ir-na.amazon-adsystem.com/ir-uk.amazon-adsystem.com/localhost.localdomain/Skynet-WhitelistDomains # Skynet
ipset=/maurerr.github.io/mirrors.bfsu.edu.cn/oisd.nl/onedrive.live.com/pagead2.googlesyndication.com/pgl.yoyo.org/pkg.entware.net/raw.githubusercontent.com/small.oisd.nl/snbforums.com/someonewhocares.org/sourceforge.net/urlhaus.abuse.ch/wms-eu.amazon-adsystem.com/wms-na.amazon-adsystem.com/wms-na.assoc-amazon.com/ws-eu.amazon-adsystem.com/ws-na.amazon-adsystem.com/z-na.amazon-adsystem.com/iplists.firehol.org/Skynet-WhitelistDomains # Skynet
ipset=/ipdeny.com/ipapi.co/api.db-ip.com/api.bgpview.io/asn.ipinfo.app/speedguide.net/otx.alienvault.com/github.com/astrill.com/strongpath.net/nwsrv-ns1.asus.com/pool.ntp.org/time.nist.gov/Skynet-WhitelistDomains # Skynet

# start of Diversion directives #
conf-file=/opt/share/diversion/list/allowlist.conf
conf-file=/opt/share/diversion/list/blockinglist.conf
conf-file=/opt/share/diversion/list/denylist.conf
log-async
log-queries
log-facility=/opt/var/log/dnsmasq.log
# end of Diversion directives #
ipset=/1drv.ms/aax-eu.amazon-adsystem.com/aax-us-east.amazon-adsystem.com/asuswrt-merlin.net/asuswrt.lostrealm.ca/big.oisd.nl/bin.entware.net/cdn.staticneo.com/clarium.global.ssl.fastly.net/codeload.github.com/diversion.ch/entware.diversion.ch/entware.net/fls-na.amazon-adsystem.com/fwupdate.asuswrt-merlin.net/ib.adnxs.com/images-na.ssl-images-amazon.com/ir-na.amazon-adsystem.com/ir-uk.amazon-adsystem.com/localhost.localdomain/Skynet-WhitelistDomains # Skynet
ipset=/maurerr.github.io/mirrors.bfsu.edu.cn/oisd.nl/onedrive.live.com/pagead2.googlesyndication.com/pgl.yoyo.org/pkg.entware.net/raw.githubusercontent.com/small.oisd.nl/snbforums.com/someonewhocares.org/sourceforge.net/urlhaus.abuse.ch/wms-eu.amazon-adsystem.com/wms-na.amazon-adsystem.com/wms-na.assoc-amazon.com/ws-eu.amazon-adsystem.com/ws-na.amazon-adsystem.com/z-na.amazon-adsystem.com/iplists.firehol.org/Skynet-WhitelistDomains # Skynet
ipset=/ipdeny.com/ipapi.co/api.db-ip.com/api.bgpview.io/asn.ipinfo.app/speedguide.net/otx.alienvault.com/github.com/astrill.com/strongpath.net/nwsrv-ns1.asus.com/pool.ntp.org/time.nist.gov/Skynet-WhitelistDomains # Skynet
#!/bin/sh
. /opt/share/diversion/file/post-conf.div # Added by Diversion
sh /jffs/addons/unbound/unbound.postconf "$1"           # unbound_manager
/jffs/scripts/uiDivStats dnsmasq & # uiDivStats

 

[bibikalka]

There should be something else in the log before that FAILED line. There’s likely a duplicate parameter in your configs.

cat /etc/dnsmasq.conf
cat /jffs/configs/dnsmasq.conf*
cat /jffs/scripts/dnsmasq.postconf

It failed today as well. Here is where the error messages start. I am running a custom non-filtering DNS on 192.168.1.16.

May  1 04:06:55 custom_script: Running /jffs/scripts/post-mount (args: /tmp/mnt/ac86u)
May  1 04:06:55 Entware: Starting Entware and Diversion services on /tmp/mnt/ac86u
May  1 04:06:55 kernel: klogd: exiting
May  1 04:06:55 syslogd exiting
May  1 04:06:57 RT-AC86U-9988 kernel: ip_set: protocol 6
May  1 04:06:58 RT-AC86U-9988 Diversion: Mounting Diversion WebUI page
May  1 04:06:58 RT-AC86U-9988 Diversion: Mounted Diversion WebUI as user1.asp in LAN/Diversion
May  1 04:06:58 RT-AC86U-9988 avahi-daemon[3674]: Registering new address record for 192.168.1.16 on br0.IPv4.
May  1 04:06:58 RT-AC86U-9988 Diversion: created br0:ad_blocking_excl for 192.168.1.16
May  1 04:06:58 RT-AC86U-9988 dnsmasq[4577]: failed to create listening socket for 192.168.1.16: Address already in use
May  1 04:06:58 RT-AC86U-9988 dnsmasq[4577]: FAILED to start up
May  1 04:06:58 RT-AC86U-9988 Diversion: started separate Dnsmasq instance for ad-blocking exclusion on IP 192.168.1.16
May  1 04:06:58 RT-AC86U-9988 Diversion: restarted Dnsmasq to apply settings
May  1 04:06:58 RT-AC86U-9988 (dnsmasq.postconf): Updating /etc/dnsmasq.conf for unbound.....
May  1 04:06:58 RT-AC86U-9988 admin: Started ntpd from /jffs/scripts/post-mount.
May  1 04:06:58 RT-AC86U-9988 uiDivStats: dnsmasq has restarted, restarting taildns
May  1 04:06:58 RT-AC86U-9988 admin: Started taildns from /jffs/scripts/post-mount.
May  1 04:06:58 RT-AC86U-9988 rc_service: service 4685:notify_rc restart_dnsmasq
May  1 04:06:58 RT-AC86U-9988 rc_service: waitting "start_samba" via  ...
May  1 04:06:59 RT-AC86U-9988 dnsmasq[4607]: failed to create listening socket for 192.168.1.1: Address already in use
May  1 04:06:59 RT-AC86U-9988 dnsmasq[4607]: FAILED to start up
May  1 04:06:59 RT-AC86U-9988 Samba_Server: daemon is started
May  1 04:06:59 RT-AC86U-9988 wsdd2[4771]: starting.
May  1 04:06:59 RT-AC86U-9988 custom_script: Running /jffs/scripts/service-event (args: start logger)
May  1 04:07:00 RT-AC86U-9988 kernel: Adding 2097148k swap on /tmp/mnt/ac86u/myswap.swp.  Priority:-1 extents:39 across:3260412k
May  1 04:06:59 syslogd started: BusyBox v1.25.1
May  1 04:06:59 kernel: klogd started: BusyBox v1.25.1 (2024-04-26 14:24:48 EDT)
May  1 04:06:59 kernel: klogd: exiting
May  1 04:06:59 syslogd exiting
May  1 04:07:01 RT-AC86U-9988 avahi-daemon[3674]: Files changed, reloading.
May  1 04:07:01 RT-AC86U-9988 avahi-daemon[3674]: Loading service file /tmp/avahi/services/mt-daap.service.

 

[thelonelycoder]

It failed today as well. Here is where the error messages start. I am running a custom non-filtering DNS on 192.168.1.16

Oh boy, what a mess.
Rethink your network strategy. You run at least two services on that .16 address. And on top of that Unbound.
No wonder Dnsmasq fails.

 

[bibikalka]

Oh boy, what a mess.
Rethink your network strategy. You run at least two services on that .16 address. And on top of that Unbound.
No wonder Dnsmasq fails.

I am doing this on 192.168.1.16:

Exclude devices from ad-blocking - Diversion

diversion.ch

I am not sure I intended to run anything else. What else is running there?

 

[thelonelycoder]

May 1 04:06:58 RT-AC86U-9988 avahi-daemon[3674]: Registering new address record for 192.168.1.16 on br0.IPv4.
May 1 04:06:58 RT-AC86U-9988 Diversion: created br0:ad_blocking_excl for 192.168.1.16
May 1 04:06:58 RT-AC86U-9988 dnsmasq[4577]: failed to create listening socket for 192.168.1.16: Address already in use

I am not sure I intended to run anything else. What else is running there?

I don't know. I was assuming with custom DNS you mean a third party DNS resolver. But you are using a Diversion service which is not custom.
Anyway, the excerpt above is the log of Diversion trying to start a separate Dnsmasq instance for the service "Exclude devices from ad-blocking" on IP 192.168.1.16 which is already in use by something else.

Are you sure this IP is not used by any of your other devices on the network?
.16 is a high number of reserved addresses as you should have set during the setup of this service in Diversion. What is the routers IP address, what is your "IP Pool Starting Address" and "IP Pool Ending Address" in LAN/DHCP Server in the routers WebUI?

May 1 04:06:59 RT-AC86U-9988 dnsmasq[4607]: failed to create listening socket for 192.168.1.1: Address already in use

This is also suspicious that your setup is completely borked or generally wrong as the main Dnsmasq instance fails to start up.