Diversion Diversion 5.1.3 - the Router Ad-Blocker, May 09, 2024

[Boji]

Its too broken, blocking everything.... edge updates, snbforums. had to disable it to post here. how do I revert to the previous diversion? I have backed up my jffs prior to the update, should restoring be enough?

 

[thelonelycoder]

Its too broken, blocking everything.... had to disable it to post here. how do I revert to the previous diversion? I have backed up my jffs prior to the update, should restoring be enough?

View attachment 56381

There is no way to go back to Diversion 4.x.

Use one of the predefined blocking lists, the Standard or Large are ideal for Diversion 5.x because they are designed for its type of blocking. These two lists are VERY well curated, whitelisting is almost never necessary on those two.

 

[Boji]

but snbforums is not in any list, except the hardcoded whitelist. searching just for the exact string "snbforums", it is not in any .conf list... dnsmasq is picking up ghost entries. care to explain?

 

[Boji]

There is no way to go back to Diversion 4.x.

Use one of the predefined blocking lists, the Standard or Large are ideal for Diversion 5.x because they are designed for its type of blocking. These two lists are VERY well curated, whitelisting is almost never necessary on those two.

is there a manual command that can be used to pull the previous version from github or another third party site?

 

[thelonelycoder]

but snbforums is not in any list, except the hardcoded whitelist. searching just for the exact string "snbforums", it is not in any .conf list... dnsmasq is picking up ghost entries. care to explain?

SNBForums is not blocked, why would it be?

 

[thelonelycoder]

is there a manual command that can be used to pull the previous version from github or another third party site?

Nope, just wait until I release an update.

 

[Boji]

SNBForums is not blocked, why would it be?

lol, yes exactly... it was being blocked even though it was not in any list except the hardcoded white list...

 

[Boji]

Nope, just wait until I release an update.

Okay fine, i'll adapt I'm going through my ancient lists only to find many of these haven't even been updated in 7 years. Perhaps thinning out my conservative 43 lists will prevent dnsmasq from hallucinating.

using the ones you suggested + hegazi did fix the problem.

 

[thelonelycoder]

lol, yes exactly... it was being blocked even though it was not in any list except the hardcoded white list...

NOT through Diversion, it is permanently whitelisted among other necessary domains for amtm, Diversion and third party scripts in amtm to work.
Check your ISP modem or DNS resolver.

 

[thelonelycoder]

using the ones you suggested + hegazi did fix the problem.

Make sure the hagezi list is in Dnsmasq 2.86+ format, it is listed as "DNSMasq (v2.86 or newer), adblock-lean, Diversion (v5 or newer)"

 

[thelonelycoder]

Okay fine, i'll adapt I'm going through my ancient lists only to find many of these haven't even been updated in 7 years. Perhaps thinning out my conservative 43 lists will prevent dnsmasq from hallucinating.

That is insane. Overkill in truest meaning of the word.
The big https://oisd.nl/ list which is the Large selection in Diversion is more than anyone ever would have to block.

I plan on releasing the update today.

 

[Boji]

NOT through Diversion, it is permanently whitelisted among other necessary domains for amtm, Diversion and third party scripts in amtm to work.
Check your ISP modem or DNS resolver.

Yeah... diversion whitelists it... dnsmasq was still blocking it, along with many that were not in any blocklist (like duckduckgo.com), they were not in the final .conf blocklist file... but for whatever reason the problem went away after I shrunk the lists down from 43 to 11, so seems to be some kind of bug, perhaps in dnsmasq. I checked upstream services, it was a dnsmasq issue. Ram was not maxed out (173/250), using ac66 b1.


If you want to try recreate the issue, here was the list I used... though I did modify it slightly since.

Spoiler

#2024 https://github.com/hagezi/dns-blocklists
#https://raw.githubusercontent.com/hagezi/dns-blocklists/main/dnsmasq/pro.txt
https://raw.githubusercontent.com/hagezi/dns-blocklists/main/dnsmasq/pro.plus.txt
https://big.oisd.nl/dnsmasq2
#2022
#Pegasys https://github.com/jjjxu/NSO_Pegasus_Blocklist
https://github.com/jjjxu/NSO_Pegasus_Blocklist/blob/main/Pegasus-Hosts-Formatted.txt
#Chinese https://github.com/jdlingyu/ad-wars/
https://raw.githubusercontent.com/jdlingyu/ad-wars/master/hosts
#GoodByeAds Mobile ads, awesome list
#https://github.com/jerryn70/GoodbyeAds #Specially Designed for Mobile Ad Protection.
https://raw.githubusercontent.com/jerryn70/GoodbyeAds/master/Hosts/GoodbyeAds.txt
#MiscHosts PIHole
https://github.com/llacb47/mischosts/raw/master/blacklist
#2020-05-18
https://hostfiles.frogeye.fr/multiparty-trackers-hosts.txt
https://hostfiles.frogeye.fr/firstparty-trackers-hosts.txt
https://raw.githubusercontent.com/rugabunda/hosts-blocklist/master/hpHosts_Ad%26TrackingOnly
https://pgl.yoyo.org/adservers/serverlist.php?hostformat=hosts&showintro=0&mimetype=plaintext&useip=0.0.0.0
https://raw.githubusercontent.com/crazy-max/WindowsSpyBlocker/master/data/hosts/spy.txt
#https://raw.githubusercontent.com/WindowsLies/BlockWindows/master/hosts
https://raw.githubusercontent.com/notracking/hosts-blocklists/master/hostnames.txt
#IOS
https://tgc.cloud/downloads/iOSAds.txt
#https://raw.githubusercontent.com/biroloter/Mobile-Ad-Hosts/master/hosts
#https://hostsmobile.oisd.nl/ #502,500 10 mb. [now 52,000]
#https://dbl.oisd.nl/basic/
#https://raw.githubusercontent.com/ookangzheng/dbl-oisd-nl/master/dbl.txt
#https://gitlab.com/ookangzheng/dbl-oisd-nl/-/raw/master/dbl.txt
#IOS OISD
#https://gitlab.com/ookangzheng/dbl-oisd-nl/-/blob/master/dblw.txt
#https://gitlab.com/ookangzheng/dbl-oisd-nl/-/blob/master/dbl_light.txt
# 10 stars, unique, nothing else has these! Light switch is great! https://github.com/dead-hosts
https://www.github.developerdan.com/hosts/lists/ads-and-tracking-extended.txt
https://gitlab.com/intr0/iVOID.GitLab.io/raw/master/iVOID.hosts
#MOAB
#http://adblock.mahakala.is/
#Mine
https://raw.githubusercontent.com/rugabunda/hosts-blocklist/master/hosts
#https://raw.githubusercontent.com/rugabunda/hosts-blocklist/master/spotify_ads
#my_version_of_https://github.com/CHEF-KOCH/Spotify-Ad-free/blob/master/filters/Spotify-AdBlock.txt
#Hosts only lists
https://raw.githubusercontent.com/jakejarvis/ios-trackers/master/blocklist.txt
https://raw.githubusercontent.com/HexxiumCreations/threat-list/gh-pages/hosts.txt
https://gitlab.com/quidsup/notrack-blocklists/raw/master/notrack-blocklist.txt
https://gitlab.com/quidsup/notrack-blocklists/raw/master/notrack-malware.txt
https://v.firebog.net/hosts/static/w3kbl.txt
#http://mirror.cedia.org.ec/malwaredomains/immortal_domains.txt
#http://mirror.cedia.org.ec/malwaredomains/justdomains
#Ublock https://hexxiumcreations.github.io/threat-list/hexxiumthreatlist.txt
#Ultimate Hosts #Includes porn
#https://hosts.ubuntu101.co.za/hosts # 234,708 0ct 28/2019, #723,297 - 737,855
#More lists: https://firebog.net/
### here https://drive.google.com/file/d/11uNf1yonr6nQm-1c-pygesRis6MgmxUT/view is a PHP script that can be used to automatically convert lists into Diversion format. Simply point your list to it in Diversion, appending actual list as url query:
### example: http://yourwebsiteaddress/get.php?u=https://s3.amazonaws.com/lists.disconnect.me/simple_tracking.txt
https://hostfiles.frogeye.fr/firstparty-trackers-hosts.txt
https://raw.githubusercontent.com/hectorm/hmirror/master/data/adaway.org/list.txt
https://raw.githubusercontent.com/hectorm/hmirror/master/data/adguard-simplified/list.txt
https://raw.githubusercontent.com/hectorm/hmirror/master/data/easylist/list.txt
https://raw.githubusercontent.com/hectorm/hmirror/master/data/eth-phishing-detect/list.txt
https://www.stopforumspam.com/downloads/toxic_domains_whole.txt
#OISD
##https://gitlab.com/ookangzheng/dbl-oisd-nl/raw/master/dbl2.txt #optimized for mobile
##https://gitlab.com/ookangzheng/dbl-oisd-nl/raw/master/hostsmobile.txt
#they also have a 0.0.0.0 version of dbl: https://gitlab.com/ookangzheng/dbl-oisd-nl/raw/master/dblzero.txt
https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts
https://someonewhocares.org/hosts/zero/hosts
https://winhelp2002.mvps.org/hosts.txt
#https://raw.githubusercontent.com/jakejarvis/ios-trackers/master/blocklist.txt
https://raw.githubusercontent.com/r-a-y/mobile-hosts/master/AdguardMobileSpyware.txt
https://raw.githubusercontent.com/r-a-y/mobile-hosts/master/AdguardMobileAds.txt
https://abpvn.com/android/abpvn.txt
https://raw.githubusercontent.com/michaeltrimm/hosts-blocking/master/_hosts.txt
https://raw.githubusercontent.com/xxcriticxx/.pl-host-file/master/hosts.txt
https://raw.githubusercontent.com/hectorm/hmirror/master/data/fademind-add.2o7net/list.txt
https://raw.githubusercontent.com/hectorm/hmirror/master/data/easyprivacy/list.txt
https://sysctl.org/cameleon/hosts
https://raw.githubusercontent.com/hectorm/hmirror/master/data/anudeepnd-adservers/list.txt
https://s3.amazonaws.com/lists.disconnect.me/simple_tracking.txt
https://s3.amazonaws.com/lists.disconnect.me/simple_ad.txt
https://raw.githubusercontent.com/mitchellkrogza/Badd-Boyz-Hosts/master/hosts

 

[thelonelycoder]

Yeah... diversion whitelists it... dnsmasq was still blocking it, along with many that were not in any blocklist (like duckduckgo.com), they were not in the final .conf blocklist file... but for whatever reason the problem went away after I shrunk the lists down from 43 to 11, so seems to be some kind of bug, perhaps in dnsmasq. I checked upstream services, it was a dnsmasq issue. Ram was not maxed out (173/250), using ac66 b1.


If you want to try recreate the issue, here was the list I used... though I did modify it slightly since.

Spoiler

#2024 https://github.com/hagezi/dns-blocklists
#https://raw.githubusercontent.com/hagezi/dns-blocklists/main/dnsmasq/pro.txt
https://raw.githubusercontent.com/hagezi/dns-blocklists/main/dnsmasq/pro.plus.txt
https://big.oisd.nl/dnsmasq2
#2022
#Pegasys https://github.com/jjjxu/NSO_Pegasus_Blocklist
https://github.com/jjjxu/NSO_Pegasus_Blocklist/blob/main/Pegasus-Hosts-Formatted.txt
#Chinese https://github.com/jdlingyu/ad-wars/
https://raw.githubusercontent.com/jdlingyu/ad-wars/master/hosts
#GoodByeAds Mobile ads, awesome list
#https://github.com/jerryn70/GoodbyeAds #Specially Designed for Mobile Ad Protection.
https://raw.githubusercontent.com/jerryn70/GoodbyeAds/master/Hosts/GoodbyeAds.txt
#MiscHosts PIHole
https://github.com/llacb47/mischosts/raw/master/blacklist
#2020-05-18
https://hostfiles.frogeye.fr/multiparty-trackers-hosts.txt
https://hostfiles.frogeye.fr/firstparty-trackers-hosts.txt
https://raw.githubusercontent.com/rugabunda/hosts-blocklist/master/hpHosts_Ad%26TrackingOnly
https://pgl.yoyo.org/adservers/serverlist.php?hostformat=hosts&showintro=0&mimetype=plaintext&useip=0.0.0.0
https://raw.githubusercontent.com/crazy-max/WindowsSpyBlocker/master/data/hosts/spy.txt
#https://raw.githubusercontent.com/WindowsLies/BlockWindows/master/hosts
https://raw.githubusercontent.com/notracking/hosts-blocklists/master/hostnames.txt
#IOS
https://tgc.cloud/downloads/iOSAds.txt
#https://raw.githubusercontent.com/biroloter/Mobile-Ad-Hosts/master/hosts
#https://hostsmobile.oisd.nl/ #502,500 10 mb. [now 52,000]
#https://dbl.oisd.nl/basic/
#https://raw.githubusercontent.com/ookangzheng/dbl-oisd-nl/master/dbl.txt
#https://gitlab.com/ookangzheng/dbl-oisd-nl/-/raw/master/dbl.txt
#IOS OISD
#https://gitlab.com/ookangzheng/dbl-oisd-nl/-/blob/master/dblw.txt
#https://gitlab.com/ookangzheng/dbl-oisd-nl/-/blob/master/dbl_light.txt
# 10 stars, unique, nothing else has these! Light switch is great! https://github.com/dead-hosts
https://www.github.developerdan.com/hosts/lists/ads-and-tracking-extended.txt
https://gitlab.com/intr0/iVOID.GitLab.io/raw/master/iVOID.hosts
#MOAB
#http://adblock.mahakala.is/
#Mine
https://raw.githubusercontent.com/rugabunda/hosts-blocklist/master/hosts
#https://raw.githubusercontent.com/rugabunda/hosts-blocklist/master/spotify_ads
#my_version_of_https://github.com/CHEF-KOCH/Spotify-Ad-free/blob/master/filters/Spotify-AdBlock.txt
#Hosts only lists
https://raw.githubusercontent.com/jakejarvis/ios-trackers/master/blocklist.txt
https://raw.githubusercontent.com/HexxiumCreations/threat-list/gh-pages/hosts.txt
https://gitlab.com/quidsup/notrack-blocklists/raw/master/notrack-blocklist.txt
https://gitlab.com/quidsup/notrack-blocklists/raw/master/notrack-malware.txt
https://v.firebog.net/hosts/static/w3kbl.txt
#http://mirror.cedia.org.ec/malwaredomains/immortal_domains.txt
#http://mirror.cedia.org.ec/malwaredomains/justdomains
#Ublock https://hexxiumcreations.github.io/threat-list/hexxiumthreatlist.txt
#Ultimate Hosts #Includes porn
#https://hosts.ubuntu101.co.za/hosts # 234,708 0ct 28/2019, #723,297 - 737,855
#More lists: https://firebog.net/
### here https://drive.google.com/file/d/11uNf1yonr6nQm-1c-pygesRis6MgmxUT/view is a PHP script that can be used to automatically convert lists into Diversion format. Simply point your list to it in Diversion, appending actual list as url query:
### example: http://yourwebsiteaddress/get.php?u=https://s3.amazonaws.com/lists.disconnect.me/simple_tracking.txt
https://hostfiles.frogeye.fr/firstparty-trackers-hosts.txt
https://raw.githubusercontent.com/hectorm/hmirror/master/data/adaway.org/list.txt
https://raw.githubusercontent.com/hectorm/hmirror/master/data/adguard-simplified/list.txt
https://raw.githubusercontent.com/hectorm/hmirror/master/data/easylist/list.txt
https://raw.githubusercontent.com/hectorm/hmirror/master/data/eth-phishing-detect/list.txt
https://www.stopforumspam.com/downloads/toxic_domains_whole.txt
#OISD
##https://gitlab.com/ookangzheng/dbl-oisd-nl/raw/master/dbl2.txt #optimized for mobile
##https://gitlab.com/ookangzheng/dbl-oisd-nl/raw/master/hostsmobile.txt
#they also have a 0.0.0.0 version of dbl: https://gitlab.com/ookangzheng/dbl-oisd-nl/raw/master/dblzero.txt
https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts
https://someonewhocares.org/hosts/zero/hosts
https://winhelp2002.mvps.org/hosts.txt
#https://raw.githubusercontent.com/jakejarvis/ios-trackers/master/blocklist.txt
https://raw.githubusercontent.com/r-a-y/mobile-hosts/master/AdguardMobileSpyware.txt
https://raw.githubusercontent.com/r-a-y/mobile-hosts/master/AdguardMobileAds.txt
https://abpvn.com/android/abpvn.txt
https://raw.githubusercontent.com/michaeltrimm/hosts-blocking/master/_hosts.txt
https://raw.githubusercontent.com/xxcriticxx/.pl-host-file/master/hosts.txt
https://raw.githubusercontent.com/hectorm/hmirror/master/data/fademind-add.2o7net/list.txt
https://raw.githubusercontent.com/hectorm/hmirror/master/data/easyprivacy/list.txt
https://sysctl.org/cameleon/hosts
https://raw.githubusercontent.com/hectorm/hmirror/master/data/anudeepnd-adservers/list.txt
https://s3.amazonaws.com/lists.disconnect.me/simple_tracking.txt
https://s3.amazonaws.com/lists.disconnect.me/simple_ad.txt
https://raw.githubusercontent.com/mitchellkrogza/Badd-Boyz-Hosts/master/hosts

Well, I was able to prove my new methods of verifying usable lists. You need to better curate or select your lists.
So, thanks for the above list

 downloading Large blocking list, 41 file(s)
 omitting 1 duplicate(s):
https://hostfiles.frogeye.fr/firstparty-trackers-hosts.txt
... a while later ....
 updated Large blocking list from 39 valid file(s) (2 non-valid file(s)),
 1431202 domains are now blocked by Diversion

 

[thelonelycoder]

I plan on releasing the update today.

Uh, life got in the way

 

[visortgw]

Uh, life got in the way

I am so glad to see that you have your priorities in order!

Looking forward to the update whenever it's ready...

 

[Viktor Jaep]

Uh, life got in the way

BTW... Your new avatar graphic cracks me up when I see it... "TLC" for the longest time for me meant "The Learning Channel" on our Cable TV lineup. I can always learn something from @thelonelycoder!

 

[dave14305]

BTW... Your new avatar graphic cracks me up when I see it... "TLC" for the longest time for me meant "The Learning Channel" on our Cable TV lineup. I can always learn something from @thelonelycoder!

Tender Loving Care from The Lonely Coder…

 

[visortgw]

BTW... Your new avatar graphic cracks me up when I see it... "TLC" for the longest time for me meant "The Learning Channel" on our Cable TV lineup. I can always learn something from @thelonelycoder!

And for me, "Tender Loving Care" — exactly what goes into every one of @thelonelycoder's releases!

 

[Treadler]

Make sure the hagezi list is in Dnsmasq 2.86+ format, it is listed as "DNSMasq (v2.86 or newer), adblock-lean, Diversion (v5 or newer)"

Yes, Hagezi working fine here.

 

[thelonelycoder]

BTW... Your new avatar graphic cracks me up when I see it... "TLC" for the longest time for me meant "The Learning Channel" on our Cable TV lineup. I can always learn something from @thelonelycoder!

A bit of TLC from tlc.