Diversion Diversion - the Router Ad-Blocker

[no_name]

1.19M on my RT_AC86U and RAM at 94%


Sent from my iPad using Tapatalk

 

[HairyA00]

Do you guys really need all these domains blocked for your home network? Isn't it best if one can curate thier own list depending on their specific network usage? I'm pretty sure no one will use all the blocked domains such large lists provides and in my opinion it's a wastage of resources.

That's how I feel. That's the approach hp-hosts takes (by classification). My only issue with them is that some of their lists are severely outdated.
https://hosts-file.net/?s=Download

 

[Butterfly Bones]

Do you guys really need all these domains blocked for your home network? Isn't it best if one can curate thier own list depending on their specific network usage? I'm pretty sure no one will use all the blocked domains such large lists provides and in my opinion it's a wastage of resources.

^^^^ This 1000+
The logic - if a little is good, then way too much must be better.

 

[Mutzli]

Do you guys really need all these domains blocked for your home network? Isn't it best if one can curate thier own list depending on their specific network usage? I'm pretty sure no one will use all the blocked domains such large lists provides and in my opinion it's a wastage of resources.

What's your router doing all day with the unused resources? Might want to use them when you have them.

 

[HairyA00]

What's your router doing all day with the unused resources? Might want to use them when you have them.

By that logic, what is your parked car doing when it's just sitting there in the garage? Why not put it in neutral and wedge something to hold on the gas pedal to keep it running at full force all day.

 

[Asad Ali]

What's your router doing all day with the unused resources? Might want to use them when you have them.

Those unused resources can be used for other important stuff crucial for smooth internet usage for example VPN servers or QoS etc but everyone is entitled to thier own opinion.

 

[Mutzli]

By that logic, what is your parked car doing when it's just sitting there in the garage? Why not put it in neutral and wedge something to hold on the gas pedal to keep it running at full force all day.

Apple and oranges, you're router is running 24/7 and adding a larger hosts file doesn't but your router into full speed all day. But it might catch a few extra domains that would have snuck through.

 

[HairyA00]

Apple and oranges, you're router is running 24/7 and adding a larger hosts file doesn't but your router into full speed all day. But it might catch a few extra domains that would have snuck through.

It may also be loaded with 1000s and 1000s of domains that don't even exist, wasting away cycles on a $300 piece of equipment. And as @Asad Ali said, my router isn't simply a DNS sinkhole; there are numerous servers running all day long without a monstrous hosts file (AC86U).

 

[Asad Ali]

Apple and oranges, you're router is running 24/7 and adding a larger hosts file doesn't but your router into full speed all day. But it might catch a few extra domains that would have snuck through.

That's just like buying a medicine for every disease out there hoping you might actually need it one day.

 

[Mutzli]

That's just like buying a medicine for every disease out there hoping you might actually need it one day.

Exactly, we get immunizations that protect us from a possible disease.
My RT-AX88U shows 192MB free RAM after loading the new list and than some for a grand total of 2.4million blocked domains

 

[HairyA00]

I DO NOT recommend using such a large hosts file in Diversion.

From the horse's mouth (back in May).

Although the experiments have been going well on awesome hardware. Just playing devil's advocate here...

 

[Asad Ali]

Exactly, we get immunizations that protect us from a possible disease.
My RT-AX88U shows 192MB free RAM after loading the new list and than some for a grand total of 2.4million blocked domains

That's different, we get vaccines for SELECT number of diseases and its really not like purchasing every medicine out there and that's exactly my point, curating a well planned block list native to your network is the best way for those who can do it.

Also CPU cycles is more important than RAM usage, you can use swap file to compensate for RAM but you can't compensate the extra CPU cycles a larger list needs.

 

[SwampKracker]

Exactly, we get immunizations that protect us from a possible disease.
My RT-AX88U shows 192MB free RAM after loading the new list and than some for a grand total of 2.4million blocked domains

Maybe you should consider a white-list rather than blocking millions of domains.

 

[thelonelycoder]

From the horse's mouth (back in May).

Although the experiments have been going well on awesome hardware. Just playing devil's advocate here...

I also wrote this earlier today:

I should not promote large hosts lists but this one seems to be carefully maintained.

Anyways, I like to give options. Diversion has four predefined blocking lists to choose from, all of them are configurable.

The Large blocking file happens to be mainly sourced from https://hosts-file.net which is a slow updating and not so careful maintained source.
Finding that "Amazing/Sensational/Remarkable/Revolutionary #1 Blocklist" with just about the same size as the current Large list, in one source and apparently very well maintained came just at the right time.
It is very likely that the future Large blocking list will be that one single source. Just as the Standard blocking list is a single source.

While were at it discussing large files, I would like to hear suggestions for the Small blocking file. As it is, the Small and Standard block about the same number of domains. While I want to keep the Standard as it is, I'd like to cut down the Small list to a bare well maintained minimum. If anyone has a source to suggest let me know.

Pasting the Diversion code directly, these are the sources at the moment:

Small_list='https://someonewhocares.org/hosts/zero/hosts
https://pgl.yoyo.org/adservers/serverlist.php?hostformat=hosts&showintro=0&mimetype=plaintext&useip=0.0.0.0
https://raw.githubusercontent.com/hoshsadiq/adblock-nocoin-list/master/hosts.txt
https://zerodot1.gitlab.io/CoinBlockerLists/hosts'

Standard_list='https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts'

Medium_list='https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts
https://adblock.mahakala.is'

Large_list='https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts
http://support.it-mate.co.uk/downloads/hosts.txt
https://hosts-file.net/hphosts-partial.txt
https://hosts-file.net/ad_servers.txt
https://hosts-file.net/grm.txt'

 

[bluepoint]

Do you guys really need all these domains blocked for your home network? Isn't it best if one can curate thier own list depending on their specific network usage? I'm pretty sure no one will use all the blocked domains such large lists provides and in my opinion it's a wastage of resources.

I don't mind experimenting. That's the way I find the right poison. So far there's not much change with the router's RAM/CPU usage behavior so yes I think I'll continue with this huge hosts file. Besides, this is not a one way trip, I can always go back to where it was if the trial produces too many false positives. So come on join us and share your thoughts.

 

[HairyA00]

I also wrote this earlier today:

Anyways, I like to give options. Diversion has four predefined blocking lists to choose from, all of them are configurable.

The Large blocking file happens to be mainly sourced from https://hosts-file.net which is a slow updating and not so careful maintained source.
Finding that "Amazing/Sensational/Remarkable/Revolutionary #1 Blocklist" with just about the same size as the current Large list, in one source and apparently very well maintained came just at the right time.
It is very likely that the future Large blocking list will be that one single source. Just as the Standard blocking list is a single source.

While were at it discussing large files, I would like to hear suggestions for the Small blocking file. As it is, the Small and Standard block about the same number of domains. While I want to keep the Standard as it is, I'd like to cut down the Small list to a bare well maintained minimum. If anyone has a source to suggest let me know.

Pasting the Diversion code directly, these are the sources at the moment:

Small_list='https://someonewhocares.org/hosts/zero/hosts
https://pgl.yoyo.org/adservers/serverlist.php?hostformat=hosts&showintro=0&mimetype=plaintext&useip=0.0.0.0
https://raw.githubusercontent.com/hoshsadiq/adblock-nocoin-list/master/hosts.txt
https://zerodot1.gitlab.io/CoinBlockerLists/hosts'

Standard_list='https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts'

Medium_list='https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts
https://adblock.mahakala.is'

Large_list='https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts
http://support.it-mate.co.uk/downloads/hosts.txt
https://hosts-file.net/hphosts-partial.txt
https://hosts-file.net/ad_servers.txt
https://hosts-file.net/grm.txt'

Hey @thelonelycoder . Whenever I am looking for lists to try, I go here. Albeit, some are not in hosts format, but many are. The "ticked" lists are the ones that require the least amount of whitelisting. There is also a good whitelist referenced there that I highly recommend: https://firebog.net/

I would never use https://adblock.mahakala.is/ due to the amount of random things it breaks (at least in my experience). But that site is a fantastic resource.

 

[Asad Ali]

If anyone has a source to suggest let me know.

Ultimate Host List for Mobile Adblockers (Focused on iOS) https://github.com/BlackJack8/iOSAdblockList

I use this list as a base for my own customization on top of it, it's well curated for most ads out there. Though it is more focused for iOS but usually the domains are same for both iOS/Android or any other device.

 

[thelonelycoder]

I would never use https://adblock.mahakala.is/ due to the amount of random things it breaks (at least in my experience). But that site is a fantastic resource.

My thoughts exactly, that list should have been removed a long time ago.
Thanks for the firebog.net link.

 

[thelonelycoder]

Ultimate Host List for Mobile Adblockers (Focused on iOS) https://github.com/BlackJack8/iOSAdblockList

I use this list as a base for my own customization on top of it, it's well curated for most ads out there. Though it is more focused for iOS but usually the domains are same for both iOS/Android or any other device.

iOS itself and apps from the app store are carefully maintained, with few rogue out links if any added by developers. Android is an entirely different matter in that regard.

 

[HairyA00]

My thoughts exactly, that list should have been removed a long time ago.
Thanks for the firebog.net link.

EDIT: Removed the lists that were not in HOSTS format to simplify. My apologies for making 100 edits on this post to get it all right!

This is what I would suggest for lists:

Whitelist:
https://github.com/anudeepND/whitelist/blob/master/domains/whitelist.txt


Small:
https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts


Standard (same as Pi-hole out of the box):
https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts
http://sysctl.org/cameleon/hosts
https://hosts-file.net/ad_servers.txt
https://mirror1.malwaredomains.com/files/domains.hosts


Medium (eliminate)


Large (ticked lists from firebog.net):

https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts
https://raw.githubusercontent.com/anudeepND/blacklist/master/adservers.txt
https://hosts-file.net/ad_servers.txt
https://hosts-file.net/grm.txt
http://sysctl.org/cameleon/hosts
https://mirror1.malwaredomains.com/files/domains.hosts
https://raw.githubusercontent.com/crazy-max/WindowsSpyBlocker/master/data/hosts/spy.txt