Diversion Diversion - the Router Ad-Blocker

[tomsk]

Yes, I'm absolutely sure Consider it confirmed

 

[M@rco]

What do you use? (Standard? Custom? Which?)

I use Custom+, using
https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/fakenews-gambling-porn/hosts
during daytimes and Standard during evenings. The custom hosts list consists of Unified + Fakenews + Gambling + Porn. See https://github.com/StevenBlack/hosts for more details (and links to every thinkable combination).

Edit: Oh, almost forgot, I'll add social to the list as well, as soon as @thelonelycoder adds the option fw ('wife filter') in one of his future releases... But until then, the above will have to do

 

[M@rco]

What do you use? (Standard? Custom? Which?)

One important addition in regards to my previous post, which I nearly forgot. @thelonelycoder wrote in this post:

This one I did not mention in the Diversion 4.0.1 update change log, I simply forgot about it but it seemed to make sense at the time I did the change locally.

Due to the restirctive blocking, I have removed https://raw.githubusercontent.com/S...lternates/fakenews-gambling-porn-social/hosts
and replaced it with the less intrusive
https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/fakenews-gambling-porn/hosts

This change only affects new installations or if you change or reapply one of the four blocking file types.
It would make sense if Google Play was included in the fakenews-gambling-porn-social list but not in fakenews-gambling-porn. Give it a try by re-selecting your blocking file type then run a manual update.

So basically, when an existing user changes the blocking file type to Standard, you'll have the same hosts file I'm using in Custom currently.

 

[HowIFix]

What do you use? (Standard? Custom? Which?)

Open WinSCP and go to:

/opt/share/diversion/list

Double click on hostslist


Add this Custom hosts list:

https://someonewhocares.org/hosts/zero/hosts
https://pgl.yoyo.org/adservers/serverlist.php?hostformat=hosts&mimetype=plaintext&useip=0.0.0.0
https://hosts-file.net/ad_servers.txt
https://hosts-file.net/grm.txt
https://hosts-file.net/emd.txt
https://hosts-file.net/exp.txt
https://hosts-file.net/hjk.txt
https://hosts-file.net/mmt.txt
https://hosts-file.net/psh.txt
https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/fakenews-gambling-porn/hosts
https://raw.githubusercontent.com/notracking/hosts-blocklists/master/hostnames.txt
https://raw.githubusercontent.com/crazy-max/WindowsSpyBlocker/master/data/hosts/spy.txt
https://raw.githubusercontent.com/WindowsLies/BlockWindows/master/hosts
https://raw.githubusercontent.com/hoshsadiq/adblock-nocoin-list/master/hosts.txt
https://zerodot1.gitlab.io/CoinBlockerLists/hosts
https://raw.githubusercontent.com/Clefspeare13/pornhosts/master/0.0.0.0/hosts
https://raw.githubusercontent.com/Sinfonietta/hostfiles/master/pornography-hosts
https://raw.githubusercontent.com/Sinfonietta/hostfiles/master/snuff-hosts
https://raw.githubusercontent.com/Sinfonietta/hostfiles/master/gambling-hosts


Extra host for block Social Media: (I do not use it)
https://raw.githubusercontent.com/Sinfonietta/hostfiles/master/social-hosts

- I use the version of StevenBlack hosts that also blocks fakenews, gambling and porn.
- I deleted adblock.mahakala.is because it gives me problems with facebook.
- I delete the hosts that are already included in StevenBlack hosts, but leave these someonewhocares.org and pgl.yoyo.org, because some of their hosts are not added on the StevenBlack hosts.
- StevenBlack hosts use CoinBlocker version browser (2,500 hosts) and I use the full version (12,000 hosts)

 

[XIII]

So basically, when an existing user changes the blocking file type to Standard, you'll have the same hosts file I'm using in Custom currently.

Is that true? I though this remark was about Medium, not Standard?

 

[HowIFix]

Use WinSCP for add the host list and go to:

/opt/share/diversion/list

Double click in hostslist

 

[M@rco]

Is that true? I though this remark was about Medium, not Standard?

Well, reading the post @thelonelycoder responded to, makes me think it was concerning Standard, but I could be wrong there.

 

[M@rco]

Use WinSCP for add the host list and go to:

/opt/share/diversion/list

Double click in hostslist

Or just use the sexy UI of Diversion, it works like a charm (unless you decide to add, give or take, 20 separate hosts files...).

 

[HowIFix]

Or just use the sexy UI of Diversion, it works like a charm (unless you decide to add, give or take, 20 separate hosts files...).

Take half an hour adding one by one or 5 seconds through WinSCP...

 

[thelonelycoder]

Open WinSCP and go to:

/opt/share/diversion/list

Double click on hostslist


Add this Custom hosts list:

https://someonewhocares.org/hosts/zero/hosts
https://pgl.yoyo.org/adservers/serverlist.php?hostformat=hosts&mimetype=plaintext&useip=0.0.0.0
https://hosts-file.net/ad_servers.txt
https://hosts-file.net/grm.txt
https://hosts-file.net/emd.txt
https://hosts-file.net/exp.txt
https://hosts-file.net/hjk.txt
https://hosts-file.net/mmt.txt
https://hosts-file.net/psh.txt
https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/fakenews-gambling-porn/hosts
https://raw.githubusercontent.com/notracking/hosts-blocklists/master/hostnames.txt
https://raw.githubusercontent.com/crazy-max/WindowsSpyBlocker/master/data/hosts/spy.txt
https://raw.githubusercontent.com/WindowsLies/BlockWindows/master/hosts
https://raw.githubusercontent.com/hoshsadiq/adblock-nocoin-list/master/hosts.txt
https://zerodot1.gitlab.io/CoinBlockerLists/hosts
https://raw.githubusercontent.com/Clefspeare13/pornhosts/master/0.0.0.0/hosts
https://raw.githubusercontent.com/Sinfonietta/hostfiles/master/pornography-hosts
https://raw.githubusercontent.com/Sinfonietta/hostfiles/master/snuff-hosts
https://raw.githubusercontent.com/Sinfonietta/hostfiles/master/gambling-hosts


Extra host for block Social Media: (I do not use it)
https://raw.githubusercontent.com/Sinfonietta/hostfiles/master/social-hosts

- I use the version of StevenBlack hosts that also blocks fakenews, gambling and porn.
- I deleted adblock.mahakala.is because it gives me problems with facebook.
- I delete the hosts that are already included in StevenBlack hosts, but leave these someonewhocares.org and pgl.yoyo.org, because some of your hosts are not added on the StevenBlack hosts.
- StevenBlack hosts use CoinBlocker version browser (2,500 hosts) and I use the full version (12,000 hosts)

Someonewhocares and pgl.yoyo and the coinblockers list are already in the StevenBlack list included.

 

[thelonelycoder]

I remember seeing the code in the AB3 S80pixelserv file but i don't see it in the diversion S80 file... thats why i asked... just curiosity, and wondering if the had something to so with the issue ppl are having with pixelserv not starting.

That was a delay to wait for services-start to run and add the virtual IP. Now, the virtual IP is added right before pixelserv-tls is started in the S80pixelserv-tls file. Much simpler and more reliable. OP's ps crash or dnsmasq restarting may have other causes, not related directly to Diversion.

 

[thelonelycoder]

Ok... this is as detailed as it will get, log level 5.

perhaps unrelated, there was a pixelserv error, after updating diversion lists, just watching youtube videos in the background: conn_handler shutdown error: Transport endpoint is not connected, this did not appear to cause any issues though I never tested browsing when this occurred. You can see the log shows it was running fine after.
Log: https://pastebin.com/Hd7YyfQs

Later. Ok here is the re-occurring problem that I mentioned, and partly what @kvic was speaking of. Diversion began restarting dnsmasq over and over again after I had processed all lists 3-4 times in a row. Diversion does not report filtering in dnsmasq -f tail, just the restarting services. After hitting apply on LAN in GUI, the dnsmasq issue went away, then pixelserv-tls failed to load properly, however diversion shows it in the green [sometimes its in the red]. I saw zero pixelserv 5-level logs while surfing and ERR_SSL_VERSION_INTERFERENCE in browser which means pixelserv-tls is not running or frozen even though diversion reported it running. I Restarted pixelserv in diversion, the log started again. All is back to normal. This seems to happen on its own from time to time after updating diversions lists.

https://pastebin.com/uEyKsAcN

Here was the log sequence, the first four restart_dnsmasq requests was due to manual diversion list processing. Then rc_service: watchdog 349:notify_rc start_dnsmasq started over and over again. Internet connection issues as well. Applying lan fixed this. I see zero errors reported by pixelserv-tls during the time it was not functioning.

Maybe @kvic has more patience than I do.
@dugaduga How much memory is used? Maybe adding a swap file helps?

 

[kvic]

perhaps unrelated, there was a pixelserv error, after updating diversion lists, just watching youtube videos in the background: conn_handler shutdown error: Transport endpoint is not connected, this did not appear to cause any issues though I never tested browsing when this occurred. You can see the log shows it was running fine after.
Log: https://pastebin.com/Hd7YyfQs

This is a normal debug message. It does not mean something bad. It indicates the client disconnects without saying goodbye.

https://pastebin.com/uEyKsAcN

Here was the log sequence, the first four restart_dnsmasq requests was due to manual diversion list processing. Then rc_service: watchdog 349:notify_rc start_dnsmasq started over and over again. Internet connection issues as well. Applying lan fixed this. I see zero errors reported by pixelserv-tls during the time it was not functioning.

In pixelserv-tls log, if you see "pixelserv-tls[xxxx]: exit on SIGTERM", then it's murdered on purpose (good) or unintentionally (bad). If it's not there until you the following but close "pixelserv listening on", then it's a crash.

Your latest update seems to reveal a different problem than you originally saw. Anyway, thanks for spending time to take the logs.

 

[Zonkd]

All the lists I'm using...
Enable + Plus Hosts
Custom 3 lists:
https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/fakenews-gambling-porn/hosts
https://hosts-file.net/pup.txt
https://hosts-file.net/wrz.txt

Can anybody recommend better lists to block p2p/warez search websites? hosts-file.net isn't very complete.

 

[dugaduga]

Maybe @kvic has more patience than I do.
@dugaduga How much memory is used? Maybe adding a swap file helps?

@thelonelycoder same as always, typically no more than 200, I have always used a swap.

 

[charlie2alpha]

I switched to Diversion today, already problems:

getting hosts file 1 of 4, preprocessing file
 http://someonewhocares.org/hosts/zero/hosts
######################################################################################################################################################################################################################################################### 100.0%
 http://someonewhocares.org/hosts/zero/hosts download failed or not hosts file, no backup found

but if I manually try a wget of the same exact address it retrieves the file just fine.

 

[charlie2alpha]

Ah, perhaps you're using curl? This happens with curl:

# curl http://someonewhocares.org/hosts/zero/hosts
<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>302 Found</title>
</head><body>
<h1>Found</h1>
<p>The document has moved <a href="https://someonewhocares.org/hosts/zero/hosts">here</a>.</p>
</body></html>

 

[menaceinc]

Sorry, what is the correct url of StevenBlack list. I want to add it to "hostlist" file.

Thanks

 

[M@rco]

Sorry, what is the correct url of StevenBlack list. I want to add it to "hostlist" file.

Take your pick... https://github.com/StevenBlack/hosts#list-of-all-hosts-file-variants

Check out the previous posts to see whether it already contains a list from Steven Black (depends on your blocking file type).

 

[Martineau]

Ah, perhaps you're using curl? This happens with curl:

# curl http://someonewhocares.org/hosts/zero/hosts
<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>302 Found</title>
</head><body>
<h1>Found</h1>
<p>The document has moved <a href="https://someonewhocares.org/hosts/zero/hosts">here</a>.</p>
</body></html>

Use the following curl flag:

-L, --location      Follow redirects