Diversion Diversion - the Router Ad-Blocker

[thelonelycoder]

Diversion 4.1.1 Should the blocklist on USB look like this ???

It did not look like that on 4.1.0. Only thing that I change was that I use host URL in whitelist and wc_black list.

Anyway check this copy of the blocklist on the USB. Im used that pixel server adress is in front of every host on a new line.. this just looks like a big mess....

Release notes from Diversion 4.1.0:

• New blocking file composition. File size decreases by about 30% by mapping 20 domains to blocking IP per line

 

[Asad Ali]

Diversion 4.1.1 Should the blocklist on USB look like this ???

It did not look like that on 4.1.0. Only thing that I change was that I use host URL in whitelist and wc_black list.

Anyway check this copy of the blocklist on the USB. Im used that pixel server adress is in front of every host on a new line.. this just looks like a big mess....

That's normal, Diversion now uses 20 domains on a single line to make the file size smaller, don't worry about it.

 

[IT Guy]

Release notes from Diversion 4.1.0:

• New blocking file composition. File size decreases by about 30% by mapping 20 domains to blocking IP per line

Ok cool, but can you add a switch or something for people like me that want the ip xxx hostname on everyline, like old diversion.
I usally copy the blockinglist and rename the pixelserver ip to 0.0.0.0 then I use it to put it on mobilephone. Thats why I like the old way it stored the blocked hosts. So I use it on the go for my phone. It's not easy too do that now...you see...

 

[Asad Ali]

Ok cool, but can you add a switch or something for people like me that want the ip xxx hostname on everyline, like old diversion.
I usally copy the blockinglist and rename the pixelserver ip to 0.0.0.0 then I use it to put it on mobilephone. Thats why I like the old way it stored the blocked hosts. So I use it on the go for my phone. It's not easy too do that now...you see...

Fetch the unprocessed files from:

/opt/share/diversion/backup

 

[IT Guy]

Fetch the unprocessed files from:

/opt/share/diversion/backup

Yeah but then I have to put all host too gether and remove all duplicate lines, after this I need to remove all my whitelisted domains also.

2 mutch work... whay better if there where an option in diversion so that we could choose if we like to save space by doing the 30% thing or stick to a normal host block file. Im not only using it for phone but also on tablet when Im traveling.

If no such option is planned, then Im wondering how do I install an old version of diversion?

 

[dave14305]

2 mutch work...

LOL, but not too much work for @thelonelycoder to accommodate your non-router requirements?

 

[Asad Ali]

Yeah but then I have to put all host too gether and remove all duplicate lines, after this I need to remove all my whitelisted domains also.

2 mutch work... whay better if there where an option in diversion so that we could choose if we like to save space by doing the 30% thing or stick to a normal host block file. Im not only using it for phone but also on tablet when Im traveling.

If no such option is planned, then Im wondering how do I install an old version of diversion?

In that case it's way better if you generate your own hosts file on computer using a Python script and simply add the final file in Diversion using hosted list. That way you can use the file directly for your mobile etc and with Diversion as well.

There's many pre-made scripts available, for example:

https://github.com/StevenBlack/hosts/blob/master/readme.md#generate-your-own-unified-hosts-file

Read the complete Readme file on how to do it.

 

[IT Guy]

In that case it's way better if you generate your own hosts file on computer using a Python script and simply add the final file in Diversion using hosted list. That way you can use the file directly for your mobile etc and with Diversion as well.

There's many pre-made scripts available, for example:

https://github.com/StevenBlack/hosts/blob/master/readme.md#generate-your-own-unified-hosts-file

Read the complete Readme file on how to do it.

Thanks

Well I still would like a Diversion option that we can choose....old or new way....

 

[L&LD]

Thanks

Well I still would like a Diversion option that we can choose....old or new way....

I think that is a selfish request to make on thelonelycoder.

 

[cmkelley]

Yeah but then I have to put all host too gether and remove all duplicate lines, after this I need to remove all my whitelisted domains also.

2 mutch work... whay better if there where an option in diversion so that we could choose if we like to save space by doing the 30% thing or stick to a normal host block file. Im not only using it for phone but also on tablet when Im traveling.

If no such option is planned, then Im wondering how do I install an old version of diversion?

I'd say an enterprising computer wiz would use this as a great chance to learn shell scripting and whip themselves out a script to do the conversion. A bit of sed and awk ought to be make short work of converting that.

Give a man a script, and he'll have that problem solved. Teach a man to script, and he can solve a lot of problems on his own.

 

[Mandarina]

Yes, as said in the amtm thread. Please report back.

Now it's working perfectly, thank you very much.

 

[thelonelycoder]

Ok cool, but can you add a switch or something for people like me that want the ip xxx hostname on everyline, like old diversion.
I usally copy the blockinglist and rename the pixelserver ip to 0.0.0.0 then I use it to put it on mobilephone. Thats why I like the old way it stored the blocked hosts. So I use it on the go for my phone. It's not easy too do that now...you see...

It's a hidden menu entry. Enter b and then dpl (for domains per line) into Diversion and set it to 1.
Then run bu to update the blocking list.
You're welcome.

 

[thelonelycoder]

LOL, but not too much work for @thelonelycoder to accommodate your non-router requirements?

I got that covered, thanks.

 

[thelonelycoder]

whay better if there where an option in diversion so that we could choose if we like to save space by doing the 30% thing or stick to a normal host block file. Im not only using it for phone but also on tablet when Im traveling.

The 30% thing also affects your routers available memory. But noone seems to notice that.

 

[cmkelley]

It's a hidden menu entry. Enter b and then dpl (for domains per line) into Diversion and set it to 1.
Then run bu to update the blocking list.
You're welcome.

Dang man, you're ON FIRE!!!

 

[Asad Ali]

The 30% thing also affects your routers available memory. But noone seems to notice that.

I do lol , infact after your hidden reveal I changed it to 25 from default 20 [emoji1787]

 

[thelonelycoder]

I do lol , infact after your hidden reveal I changed it to 25 from default 20 [emoji1787]

25 is the maximum and I check it. Any higher and the domains after that mark are no longer loaded into Dnsmasq.

 

[L&LD]

I do lol , infact after your hidden reveal I changed it to 25 from default 20 [emoji1787]

Thanks. I just changed that too to 25.

 

[L&LD]

Before I change the setting above from 20 to 25, I had 26MB of free RAM.

Now, after 15 minutes after changing it to 25, I have just under 71MB of free RAM.

I'm sure it will go down to my usual 29 to 26MB in a few hours (because, Linux), but it means that more RAM will be used for routing and other duties too.

 

[Dabombber]

It doesn't make any difference in memory having more hosts per line, it just decreases the file size.

Spoiler: 1 entry per line, 123672 kB

$ tail /tmp/adblock.hosts
0.0.0.0 zzzyzs.net
:: zzzyzs.net
0.0.0.0 zzzzz.cauction.hop.clickbank.net
:: zzzzz.cauction.hop.clickbank.net
0.0.0.0 zzzzz.regmum.hop.clickbank.net
:: zzzzz.regmum.hop.clickbank.net
0.0.0.0 zzzzzqp.com
:: zzzzzqp.com
0.0.0.0 zzzzzzzz.su
:: zzzzzzzz.su

$ cat "/proc/$(ps | awk '$2=="nobody"&&$5=="dnsmasq"{print $1}')/status"
Name:   dnsmasq
State:  S (sleeping)
Tgid:   23617
Pid:    23617
PPid:   1
TracerPid:      0
Uid:    65534   65534   65534   65534
Gid:    65534   65534   65534   65534
FDSize: 32
Groups:
VmPeak:   124228 kB
VmSize:   124228 kB
VmLck:         0 kB
VmHWM:    123672 kB
VmRSS:    123672 kB
VmData:   123216 kB
VmStk:       136 kB
VmExe:       384 kB
VmLib:       464 kB
VmPTE:       126 kB
VmSwap:        0 kB
Threads:        1
SigQ:   0/4022
SigPnd: 0000000000000000
ShdPnd: 0000000000000000
SigBlk: 0000000000000000
SigIgn: 0000000000001000
SigCgt: 0000000000016a03
CapInh: 0000000000000000
CapPrm: 0000000000003400
CapEff: 0000000000003400
CapBnd: ffffffffffffffff
Cpus_allowed:   3
Cpus_allowed_list:      0-1
voluntary_ctxt_switches:        77
nonvoluntary_ctxt_switches:     1165

Spoiler: 25 entries per line, 123680 kB

$ tail /tmp/adblock.hosts
0.0.0.0 zyski-z-innowacji.pl zysyeg.plesa.maxgrowth.ru zyt-scholarship.com zytpirwai.net zywekolory.pl zywno.pl zyworld.com zyxqstudio.com zyy8zblby6.neliver.com zyyxeotxxdzarij.usa.cc zyz-industry.cf zyzhjc.com zz-xx.tk zz.cpcempower.com zz.cqcounter.com zz.kjukenhi.in zz.zeroredirect1.com zz0580.com zz6vwhtwdigk4htm3spj.galton.pila.pl zz918pge4j.neliver.com zz9ntlqywb.neliver.com zz9pza.net zzajjyj.com zzanchi.com zzarzlfyun.neliver.com
:: zyski-z-innowacji.pl zysyeg.plesa.maxgrowth.ru zyt-scholarship.com zytpirwai.net zywekolory.pl zywno.pl zyworld.com zyxqstudio.com zyy8zblby6.neliver.com zyyxeotxxdzarij.usa.cc zyz-industry.cf zyzhjc.com zz-xx.tk zz.cpcempower.com zz.cqcounter.com zz.kjukenhi.in zz.zeroredirect1.com zz0580.com zz6vwhtwdigk4htm3spj.galton.pila.pl zz918pge4j.neliver.com zz9ntlqywb.neliver.com zz9pza.net zzajjyj.com zzanchi.com zzarzlfyun.neliver.com
0.0.0.0 zzb.bz zzb.kz zzbbmm.com zzbgjjc.com zzbhfw.com zzbkltrje.com zzbroya.com.ua zzcihevvdigesting.download zzcylm.net zzdatpatchily.review zzdkjtdtvw.neliver.com zzdnet.com zzdwys.com zzdy.gumohib.yi.org zzefs.com zzejxebbzoi.cn zzerkalo.ru zzf0pzzpmy.neliver.com zzfldy.top zzforcesecureq.site zzfpgzvew7.neliver.com zzfyky.com zzg90296.zapto.org zzgszjdv.com zzgzq.qufewec.yi.org
:: zzb.bz zzb.kz zzbbmm.com zzbgjjc.com zzbhfw.com zzbkltrje.com zzbroya.com.ua zzcihevvdigesting.download zzcylm.net zzdatpatchily.review zzdkjtdtvw.neliver.com zzdnet.com zzdwys.com zzdy.gumohib.yi.org zzefs.com zzejxebbzoi.cn zzerkalo.ru zzf0pzzpmy.neliver.com zzfldy.top zzforcesecureq.site zzfpgzvew7.neliver.com zzfyky.com zzg90296.zapto.org zzgszjdv.com zzgzq.qufewec.yi.org
0.0.0.0 zzhauk.com zzhc.vnet.cn zzhcibi3xl.neliver.com zzhhc.cn zzhomes.com zzhrcw.com zzhuajing.com zzhytzy.com zzilod6d87.neliver.com zzjhdxby.com zzjrzdzlgv1lzr8jyr-noreply-netflix.info zzkadra-kwbbelchatow.com.pl zzlrcw.com zzmx.fj.cn zzn3t2prfa.neliver.com zznleolntyj.com zznvfgzyny.neliver.com zzodpsxitd.neliver.com zzollinger.ch zzp5wldr7z.neliver.com zzpapahost.com zzpcriskalertus.club zzpe4ork.ashgabad.su zzpmaph.info zzptzdhugavot.review
:: zzhauk.com zzhc.vnet.cn zzhcibi3xl.neliver.com zzhhc.cn zzhomes.com zzhrcw.com zzhuajing.com zzhytzy.com zzilod6d87.neliver.com zzjhdxby.com zzjrzdzlgv1lzr8jyr-noreply-netflix.info zzkadra-kwbbelchatow.com.pl zzlrcw.com zzmx.fj.cn zzn3t2prfa.neliver.com zznleolntyj.com zznvfgzyny.neliver.com zzodpsxitd.neliver.com zzollinger.ch zzp5wldr7z.neliver.com zzpapahost.com zzpcriskalertus.club zzpe4ork.ashgabad.su zzpmaph.info zzptzdhugavot.review
0.0.0.0 zzqhsrg.ru zzqingying.com zzqrt.com zzrvy6jvfr.neliver.com zzscidoyvr.neliver.com zzseonlne.com zzshw.net zzsyw.com zztabwatoke.review zztnal.org zztonuvcrnolfdt.usa.cc zzts2008.com zztysp.com zzusapcriskalertd.club zzwx.ru zzxcgasdasdd.com zzxd7ali0k.neliver.com zzxxccllkkjj99.zapto.org zzxxjs.net zzxxyy.000webhostapp.com zzy9sbz9qe.neliver.com zzygdx.com zzyimiao.com zzyin.cn zzyirul7zj.neliver.com
:: zzqhsrg.ru zzqingying.com zzqrt.com zzrvy6jvfr.neliver.com zzscidoyvr.neliver.com zzseonlne.com zzshw.net zzsyw.com zztabwatoke.review zztnal.org zztonuvcrnolfdt.usa.cc zzts2008.com zztysp.com zzusapcriskalertd.club zzwx.ru zzxcgasdasdd.com zzxd7ali0k.neliver.com zzxxccllkkjj99.zapto.org zzxxjs.net zzxxyy.000webhostapp.com zzy9sbz9qe.neliver.com zzygdx.com zzyimiao.com zzyin.cn zzyirul7zj.neliver.com
0.0.0.0 zzypjyywn.fiepiux.maxgrowth.ru zzyuz3ant3.neliver.com zzyzjk.com zzz.clickbank.net zzz.nosu.yi.org zzz78.tk zzzbfvfglucoside.review zzzessay.com zzzha.com zzzkjwiive.neliver.com zzzl.org zzzort10xtest123.com zzzrtrcm2.com zzzxxxcc.no-ip.biz zzzyzs.net zzzzz.cauction.hop.clickbank.net zzzzz.regmum.hop.clickbank.net zzzzzqp.com zzzzzzzz.su
:: zzypjyywn.fiepiux.maxgrowth.ru zzyuz3ant3.neliver.com zzyzjk.com zzz.clickbank.net zzz.nosu.yi.org zzz78.tk zzzbfvfglucoside.review zzzessay.com zzzha.com zzzkjwiive.neliver.com zzzl.org zzzort10xtest123.com zzzrtrcm2.com zzzxxxcc.no-ip.biz zzzyzs.net zzzzz.cauction.hop.clickbank.net zzzzz.regmum.hop.clickbank.net zzzzzqp.com zzzzzzzz.su

$ cat "/proc/$(ps | awk '$2=="nobody"&&$5=="dnsmasq"{print $1}')/status"
Name:   dnsmasq
State:  S (sleeping)
Tgid:   26654
Pid:    26654
PPid:   1
TracerPid:      0
Uid:    65534   65534   65534   65534
Gid:    65534   65534   65534   65534
FDSize: 32
Groups:
VmPeak:   124236 kB
VmSize:   124236 kB
VmLck:         0 kB
VmHWM:    123680 kB
VmRSS:    123680 kB
VmData:   123224 kB
VmStk:       136 kB
VmExe:       384 kB
VmLib:       464 kB
VmPTE:       128 kB
VmSwap:        0 kB
Threads:        1
SigQ:   0/4022
SigPnd: 0000000000000000
ShdPnd: 0000000000000000
SigBlk: 0000000000000000
SigIgn: 0000000000001000
SigCgt: 0000000000016a03
CapInh: 0000000000000000
CapPrm: 0000000000003400
CapEff: 0000000000003400
CapBnd: ffffffffffffffff
Cpus_allowed:   3
Cpus_allowed_list:      0-1
voluntary_ctxt_switches:        32
nonvoluntary_ctxt_switches:     2034

Not using Diversion there, but addn-hosts=/tmp/adblock.hosts is in my dnsmasq config.