Diversion Diversion - the Router Ad-Blocker

[thelonelycoder]

Just a FYI. The YouTube yt_blacklist is updated with the following check interval:
A cron job triggers yt-blocking.div every minute. It will read in the /tmp/div_yt_count file which says where the count is at (use cat /tmp/div_yt_count to see where it's at).
The update code in yt-blocking.div will only run when the couter is at [0-9]|1[0-9]|20|25|30|40|55.
So every minute if the counter is 0-20, then at 25, 30, 40 and 55 counts. At 70 it will get set to 30 to start again from there.
In every case, if at one of these count points a new domain is found, the counter gets set back to 1.

 

[thelonelycoder]

just updated when I enable YT blocking I get "YouTube domain is not valid"

That means the picked up *.googlevideo.com domain did not resolve properly and returned an error.
Try to rerun, if it still fails, you may have to reset the dnsmasq.log files in d.

 

[Ro berto]

just updated when I enable YT blocking I get "YouTube domain is not valid"

same here, i'll try and watch more videos on my laptop using chrome browser.

@thelonelycoder maybe you can update in the diversion's faq that now there's a beta for YouTube ads
https://diversion.ch/faq-reader/can-diversion-block-youtube-ads.html

Sent from my SM-G970F using Tapatalk

 

[thelonelycoder]

same here, i'll try and watch more videos on my laptop using chrome browser.

@thelonelycoder maybe you can update in the diversion's faq that now there's a beta for YouTube ads
https://diversion.ch/faq-reader/can-diversion-block-youtube-ads.html

Sent from my SM-G970F using Tapatalk

No, I want to limit exposure until the YT feature is ready for general release. I can only cope with so much user input.

Reset the dnsmasq.log files in d. Watching more videos does not help at the moment.
I still try to figure out how to better handle these errors instead of quitting right away.

 

[pattiri]

Try to rerun, if it still fails, you may have to reset the dnsmasq.log files in d.

Reset ad counters and Dnsmasq log files and rerun. Than browse some youtube videos and saw some ads but still same error. Btw; I've manually search dnsmasq.log for "googlevideo" and I can find domains as below.

 

[thelonelycoder]

Reset ad counters and Dnsmasq log files and rerun. Than browse some youtube videos and saw some ads but still same error. Btw; I've manually search dnsmasq.log for "googlevideo" and I can find domains as below.

View attachment 23381

Can you do this for me?
First enter this in the terminal:

/opt/bin/grep -a -m 1 "reply.*-.*\.googlevideo.*\..*\..*\..*" /opt/var/log/dnsmasq.log | awk '{print $6}'

It should return one of these googlevideo domains. Post it so I can run it trough the validator.

 

[thelonelycoder]

Reset ad counters and Dnsmasq log files and rerun. Than browse some youtube videos and saw some ads but still same error. Btw; I've manually search dnsmasq.log for "googlevideo" and I can find domains as below.

View attachment 23381

I got this, you have "log-queries=extra" set in ds settings. Let me figure that out. But first I need to do some other stuff.

 

[Jack Yaz]

Could you point me to which file(s) contain that p7zip code you mentioned?
I still have to fix the missing real zip Entware package thing.

if [ ! -f /opt/bin/7z ]; then
            opkg update
            opkg install p7zip
        fi
        /opt/bin/7z a -y -bsp0 -bso0 -tzip "/tmp/""$SCRIPT_NAME_LOWER""data.zip" "$tmpoutputdir/*"

is the snippet I use to zip up a directory silently

 

[thelonelycoder]

Reset ad counters and Dnsmasq log files and rerun. Than browse some youtube videos and saw some ads but still same error. Btw; I've manually search dnsmasq.log for "googlevideo" and I can find domains as below.

View attachment 23381

Can you run this, it should return a valid domain:

/opt/bin/grep -a -m 1 "reply.*-.*\.googlevideo.*\..*\..*\..*" /opt/var/log/dnsmasq.log | awk '{print $(NF-2)}'

 

[Ro berto]

I got this, you have "log-queries=extra" set in ds settings. Let me figure that out. But first I need to do some other stuff.

that was the trick!!
I disabled extra log queries and succeeded with the activation

thanks @thelonelycoder

Sent from my SM-G970F using Tapatalk

 

[thelonelycoder]

Reset ad counters and Dnsmasq log files and rerun. Than browse some youtube videos and saw some ads but still same error. Btw; I've manually search dnsmasq.log for "googlevideo" and I can find domains as below.

View attachment 23381

same here, i'll try and watch more videos on my laptop using chrome browser.

@thelonelycoder maybe you can update in the diversion's faq that now there's a beta for YouTube ads
https://diversion.ch/faq-reader/can-diversion-block-youtube-ads.html

Sent from my SM-G970F using Tapatalk

I pushed a silent Diversion update

- Corrects YT domain error when "log-queries=extra" is enabled in the ds settings.

Now we all should be in business with YouTube video ads blocking experimental feature testing.
Thanks for persistently reporting.

Use uu to force update.

 

[thelonelycoder]

that was the trick!!
I disabled extra log queries and succeeded with the activation

thanks @thelonelycoder

Sent from my SM-G970F using Tapatalk

Update Diversion to the above update and you can turn extra logging back on.

 

[Jack Yaz]

I pushed a silent Diversion update

- Corrects YT domain error when "log-queries=extra" is enabled in the ds settings.

Now we all should be in business with YouTube video ads blocking experimental feature testing.
Thanks for persistently reporting.

Use uu to force update.

log-queres=extra is something I need to consider for uiDivStats 2.0

 

[Ro berto]

wow , that was f*****ing fast
I'll try activating log queries extra and report back

Sent from my SM-G970F using Tapatalk

 

[Ro berto]

success @thelonelycoder!

Activated with log queries extra enabled

Sent from my SM-G970F using Tapatalk

 

[pattiri]

I pushed a silent Diversion update

- Corrects YT domain error when "log-queries=extra" is enabled in the ds settings.

Now we all should be in business with YouTube video ads blocking experimental feature testing.
Thanks for persistently reporting.

Use uu to force update.

All seems working now. thank you. I've started testing

 

[thelonelycoder]

log-queres=extra is something I need to consider for uiDivStats 2.0

Just grab the near field with whatever it is, in uiDivStats and Diversion stats I use $(NF-2), your mileage may vary but it'll be the same as you look for the query\[A.* string.

 

[Jack Yaz]

Just grab the near field with whatever it is, in uiDivStats and Diversion stats I use $(NF-2), your mileage may vary but it'll be the same as you look for the query\[A.* string.

Currently I filter for $5 containing query, and then the other fields with $6 etc. I think filtering the whole line for query regex as you suggest and then using NF-x to grab the other fields will work

 

[thelonelycoder]

log-queres=extra is something I need to consider for uiDivStats 2.0

Do a grep on dnsmasq.conf for the string "log-queries=extra" to check if you have to. But the near field $(NF-2) works with and without that verbose setting.

 

[majnu]

Unfortunately I am still getting ads when watching Peppa Pig on Android. Getting Candy Crush Saga, Pinball, asmr slicing, pokemon go etc ads everytime the Timer on the video hits the small yellow bar. Please note on Desktop this is no problem because I have uBlock Origin installed and the ads don't appear.

I've ran option b and ran through installation again but it still persists.

When setting up Diversion I followed the "
How to use an upstream DNS Server like 8.8.8.8 from Google" So I have no idea if maybe enabling that is causing ads to appear.

Edit - Seems I can't upload more than 2 images so I put everything in an album
https://imgur.com/a/Kmxqqxz