Diversion Diversion - the Router Ad-Blocker

[thelonelycoder]

I concur, I have over 500 whitelisted domains ( I hope @thelonelycoder may someday remove cap on white listing.) I know why it exist for black listing tho.

I also noticed there is a 4000 limit for wildcard blacklists.

I have reasons to add that limit. It's there to help less savvy users.

 

[thelonelycoder]

Perhaps there was some conflict with something else then because as soon as I uninstalled Diversion, the problem became much less frequent, although not completely cured.

Then it's not Diversion that causes the original problem.

 

[thelonelycoder]

When i install Download Master + Diversion, show me an error, why i cant install both? I use Download Master on a HDD and Diversion on a Pen Driver.

Someone can help me?

Download Master uses Optware, while Diversion uses the more recent and still maintained Entware software repository.
Both use /opt to add the additional services. Obviously there would be a conflict having two repositories fight for the same place on your router.

 

[thelonelycoder]

Thank you!! I apreciate so much that! I'll change it tomorrow and follow the guide step by step! by the way, i read the guide and it say that need format on ext2 or ext3, What happen with the ext4? doesnt support?

It should work with ext4 as well.

It will work with ext4 file system.

 

[SomeWhereOverTheRainBow]

I have reasons to add that limit. It's there to help less savvy users.

I guess the more savy users can compile their block-list daily with whitelisted domains auto remove on time of compile...
https://github.com/jumpsmm7/MyGeneratedDomainsList

big list

https://raw.githubusercontent.com/jumpsmm7/MyGeneratedDomainsList/master/My-GeneratedHosts.txt
**edit**

added a smaller list as well.

https://raw.githubusercontent.com/jumpsmm7/MyGeneratedDomainsList/master/My-ConservativeHosts.txt

 

[Ubimo]

How many domains are in "MyGeneratedDomainsList"
"

 

[thelonelycoder]

How many domains are in "MyGeneratedDomainsList"
"

File size: 17.1M
Line count (domains): 860483

 

[thelonelycoder]

I am looking for suggestions for a small carefully curated ADS ONLY hosts file.
Dan Pollok's https://pgl.yoyo.org/adservers/ is what I have in mind, but maybe there are better alternatives.

This will be added as the "JustAds" predefined blocking list option to Diversion, along with Small, Standard etc.

 

[Asad Ali]

I am looking for suggestions for a small carefully curated ADS ONLY hosts file.
Dan Pollok's https://pgl.yoyo.org/adservers/ is what I have in mind, but maybe there are better alternatives.

This will be added as the "JustAds" predefined blocking list option to Diversion, along with Small, Standard etc.

If you're up for WC only list then my list is designed exactly with that purpose in mind lol.

https://github.com/asaddon/Asads-Hosts/blob/master/data/Diversion.txt

 

[SomeWhereOverTheRainBow]

I am looking for suggestions for a small carefully curated ADS ONLY hosts file.
Dan Pollok's https://pgl.yoyo.org/adservers/ is what I have in mind, but maybe there are better alternatives.

This will be added as the "JustAds" predefined blocking list option to Diversion, along with Small, Standard etc.

Yea mine is focused around most common blocked with out breaking functionality, basically white list can be expanded per need arises, compiles are set to happen daily at 1 am starting today and newly white listed removals will get adjusted if added on next compile.

 

[jrmwvu04]

I am looking for suggestions for a small carefully curated ADS ONLY hosts file.
Dan Pollok's https://pgl.yoyo.org/adservers/ is what I have in mind, but maybe there are better alternatives.

This will be added as the "JustAds" predefined blocking list option to Diversion, along with Small, Standard etc.

I think that's a sensible option. I also like and use the MVPS hosts file source, but they do go above and beyond "just ads" per their own "criteria for detection" (available at http://winhelp2002.mvps.org/criteria.htm). I've been using that source for ages, I believe since the beginning of blocking hosts on a router, and never had any problems with false positives. But short of including that, I would say your idea is sound as it is.

 

[jrmwvu04]

If you're up for WC only list then my list is designed exactly with that purpose in mind lol.

https://github.com/asaddon/Asads-Hosts/blob/master/data/Diversion.txt

Interesting list, I saw you mention it before. I ran it through my scripts to see what if anything your list adds to mine, and it's more than I expected (https://pastebin.com/XaH3YmML if you are curious) leading me to ask, where/how did you decide on these hosts, if you don't mind sharing the secret to the sauce?

 

[Asad Ali]

Interesting list, I saw you mention it before. I ran it through my scripts to see what if anything your list adds to mine, and it's more than I expected (https://pastebin.com/XaH3YmML if you are curious) leading me to ask, where/how did you decide on these hosts, if you don't mind sharing the secret to the sauce?

I use a combination of MiTM tools to intercept my network traffic for a week every few months and I extract all the ad related domains out of it, then I go through the list and see how many of the domains I can convert to pure WC entries without sacrificing the websites.

Let me clear it once again, my list is meant to be used as a Wildcard hosts list to take full advantage because it contains only single entry for the hard core ad domains.

 

[jrmwvu04]

I use a combination of MiTM tools to intercept my network traffic for a week every few months and I extract all the ad related domains out of it, then I go through the list and see how many of the domains I can convert to pure WC entries without sacrificing the websites.

Let me clear it once again, my list is meant to be used as a Wildcard hosts list to take full advantage because it contains only single entry for the hard core ad domains.

I like your method. I have added your list to my sources and will try it out. At a glance of what it provided, I didn’t see anything that looks problematic for whitelisting so I expect no issues.

 

[Asad Ali]

I like your method. I have added your list to my sources and will try it out. At a glance of what it provided, I didn’t see anything that looks problematic for whitelisting so I expect no issues.

The only domain which may effect your browsing is (o.aolcdn.com) and that too only if you use aol.com
I blocked this domain because most websites use this domain for ad hostings but aol.com use it for images too on thier website.

 

[thelonelycoder]

I use a combination of MiTM tools to intercept my network traffic for a week every few months and I extract all the ad related domains out of it, then I go through the list and see how many of the domains I can convert to pure WC entries without sacrificing the websites.

Let me clear it once again, my list is meant to be used as a Wildcard hosts list to take full advantage because it contains only single entry for the hard core ad domains.

Yours is therefore a very personalised list and therefore not good for others.

 

[Asad Ali]

Yours is therefore a very personalised list and therefore not good for others.

Yep, it is personalised I get that, but hard-core ad domains are same for everyone and they're not region dependant ( at least not all )

There's one more smaller Ads only list if you're interested which I used in the past and may be of interest to you.

https://raw.githubusercontent.com/BlackJack8/iOSAdblockList/master/iPv4Hosts.txt

Don't get confused by the iOS name, this list includes ad domains that are not platform-dependent and it blocks most ads on iOS, Android and Windows/Linux, etc.

 

[jrmwvu04]

I use a combination of MiTM tools to intercept my network traffic for a week every few months and I extract all the ad related domains out of it, then I go through the list and see how many of the domains I can convert to pure WC entries without sacrificing the websites.

Let me clear it once again, my list is meant to be used as a Wildcard hosts list to take full advantage because it contains only single entry for the hard core ad domains.

Yours is therefore a very personalised list and therefore not good for others.

I agree completely that this is not good for inclusion in a basic, universal use list for diversion. I derailed another thread with my personal questions. Since I'm already on a roll with that, @thelonelycoder, as it is now included in my firmware (41E8) I tried out amtm - gotta say that is pretty slick.

 

[thelonelycoder]

I agree completely that this is not good for inclusion in a basic, universal use list for diversion. I derailed another thread with my personal questions. Since I'm already on a roll with that, @thelonelycoder, as it is now included in my firmware (41E8) I tried out amtm - gotta say that is pretty slick.

I'm sorry that my script is now force-included on some routers worldwide
Glad you like amtm, thanks.

 

[Clark Griswald]

I have reasons to add that limit. It's there to help less savvy users.

Thank You for keeping those of us "less savvy users" in your coding thoughts!