AB-Solution - The Ad Blocking Solution

[thelonelycoder]

The router can ping itself and the ps fine:

thegod@RT-N66U-87F0:/tmp/home/root# ping 192.168.1.1
PING 192.168.1.1 (192.168.1.1): 56 data bytes
64 bytes from 192.168.1.1: seq=0 ttl=64 time=0.348 ms
64 bytes from 192.168.1.1: seq=1 ttl=64 time=0.284 ms
64 bytes from 192.168.1.1: seq=2 ttl=64 time=0.255 ms
64 bytes from 192.168.1.1: seq=3 ttl=64 time=0.255 ms
64 bytes from 192.168.1.1: seq=4 ttl=64 time=0.249 ms
64 bytes from 192.168.1.1: seq=5 ttl=64 time=0.250 ms
64 bytes from 192.168.1.1: seq=6 ttl=64 time=0.255 ms
64 bytes from 192.168.1.1: seq=7 ttl=64 time=0.255 ms

--- 192.168.1.1 ping statistics ---
8 packets transmitted, 8 packets received, 0% packet loss
round-trip min/avg/max = 0.249/0.268/0.348 ms


thesupremebeing@RT-N66U-87F0:/tmp/home/root# ping 192.168.1.2
PING 192.168.1.2 (192.168.1.2): 56 data bytes
64 bytes from 192.168.1.2: seq=0 ttl=64 time=0.291 ms
64 bytes from 192.168.1.2: seq=1 ttl=64 time=0.265 ms
64 bytes from 192.168.1.2: seq=2 ttl=64 time=0.254 ms
64 bytes from 192.168.1.2: seq=3 ttl=64 time=0.250 ms
64 bytes from 192.168.1.2: seq=4 ttl=64 time=0.258 ms
64 bytes from 192.168.1.2: seq=5 ttl=64 time=0.250 ms

--- 192.168.1.2 ping statistics ---
6 packets transmitted, 6 packets received, 0% packet loss
round-trip min/avg/max = 0.250/0.261/0.291 ms

The http://192.168.1.2/servstats is accessible from the browser too (it has always been)
Here is its output:

pixelserv-tls version: v35.HZ12.Kj compiled: May 31 2017 04:30:23 options: 192.168.1.2 -l

uts    0d 00:09    pixelserv uptime
log    1    logging access to syslog (0=disabled 1=enabled)
req    4    total # of requests (HTTP, HTTPS, success, failure etc)
avg    462 bytes    average length of request URL
rmx    477 bytes    maximum length of request URL
tav    2009 ms    average processing time (per request)
tmx    5974 ms    maximum processing time (per request)
slh    0    # of accepted HTTPS requests
slm    0    # of rejected HTTPS requests (missing certificate)
sle    0    # of rejected HTTPS requests (certificate available but bad)
slu    0    # of dropped HTTPS requests (unknown error)
nfe    0    # of GET requests for server-side scripting
gif    0    # of GET requests for GIF
ico    1    # of GET requests for ICO
txt    0    # of GET requests for Javascripts
jpg    0    # of GET requests for JPG
png    0    # of GET requests for PNG
swf    0    # of GET requests for SWF
sta    3    # of GET requests for HTML stats
stt    0    # of GET requests for plain text stats
ufe    0    # of GET requests /w unknown file extension
rdr    0    # of GET requests resulted in REDIRECT response
nou    0    # of GET requests /w empty URL
pth    0    # of GET requests /w malformed URL
204    0    # of GET requests (HTTP 204 response)
pst    0    # of POST requests (HTTP 501 response)
hed    0    # of HEAD requests (HTTP 501 response)
bad    0    # of unknown HTTP requests (HTTP 501 response)
err    0    # of dropped requests (failed to accept client connection)
tmo    0    # of dropped requests (client timeout before connection accepted)
cls    0    # of dropped requests (client disconnect before connection accepted)

What about that wget command from earlier?

 

[|ZeuS|]

theguy@RT-N66U-87F0:/tmp/home/root# wget --tries=6 --retry-connrefused -O
/tmp/servstats.txt 192.168.1.2/servstats.txt
--2017-07-22 12:59:03--  http://192.168.1.2/servstats.txt
Connecting to 192.168.1.2:80... failed: Connection timed out.
Retrying.

--2017-07-22 12:59:49--  (try: 2)  http://192.168.1.2/servstats.txt
Connecting to 192.168.1.2:80...

and so on....

 

[thelonelycoder]

theguy@RT-N66U-87F0:/tmp/home/root# wget --tries=6 --retry-connrefused -O
/tmp/servstats.txt 192.168.1.2/servstats.txt
--2017-07-22 12:59:03--  http://192.168.1.2/servstats.txt
Connecting to 192.168.1.2:80... failed: Connection timed out.
Retrying.

--2017-07-22 12:59:49--  (try: 2)  http://192.168.1.2/servstats.txt
Connecting to 192.168.1.2:80...

and so on....

Check that your firewall or another script does not block wget or somethig within your network.
Disable other scripts to check.

 

[nephilim]

After updating to 3.9 I wanted to check the router stats:

 ---------------------------------------------------

 Current stats info:
 This will compile stats from the dnsmasq.log file.
 Depending on the size of the logfiles, this may
 take some time.
 ---------------------------------------------------

 Continue? [1=Yes e=Exit] 1

/tmp/mnt/Tools/ab-solution.sh: .: line 9: can't open '/tmp/mnt/Tools/adblocking/.config/email.cfg'

After that the front-end crashes.

I then ran through the new "bu" option and entered the required info. This fixed the issue.

 

[|ZeuS|]

Check that your firewall or another script does not block wget or somethig within your network.
Disable other scripts to check.

I m running no other scripts.
In fact checking the scripts in jffs to make sure I saw this:

ultimusfantasticus@RT-N66U-87F0:/jffs/scripts# ls
dnsmasq.postconf  services-start    wan-start
post-mount        services-stop

so I think I may be missing some stuff. Shouldn't some firewall stuff be in there?

Anyway, I was running the ps and so forth fine in the past with the firewall. However, I said "wth I haven't tried disabling it so let's do that". I mean I have tried all sort of random stuff, disabling IPv6, disabling NAT, changing NAT loop from asus to merlin to none and so on. In short I have tried every random thing I could think except "recalibrating the primary conduit through the secondary pathway in the Jefferies tubes and forwarding the central ramistat core while keeping the ontarian manifold within forty thousand KRG" like Miles O'Brien or Geordi La Forge would do... and also I had not turned off the firewall.
So I turned the damn thing off, and voila.... all is fine.
Well not much of a solution of course, and furthermore why suddenly the default bare-bones firewall of the RT-N66U router started blocking the wget ?

In conclusion firewall = no go and no firewall = go ..... bizarre. Reinstalling the latest merlin does not resolve the issue (in case I was missing some sort of firewall script).

 

[thelonelycoder]

After updating to 3.9 I wanted to check the router stats:

 ---------------------------------------------------

 Current stats info:
 This will compile stats from the dnsmasq.log file.
 Depending on the size of the logfiles, this may
 take some time.
 ---------------------------------------------------

 Continue? [1=Yes e=Exit] 1

/tmp/mnt/Tools/ab-solution.sh: .: line 9: can't open '/tmp/mnt/Tools/adblocking/.config/email.cfg'

After that the front-end crashes.

I then ran through the new "bu" option and entered the required info. This fixed the issue.

Thanks, this is fixed now.
The missing check has been added to line #3738 in ab-solution.sh.
Enter 33 if you want to update, no version change.

 

[eighteen]

Hello!

In what folder are the certificates of pixelserv located?

 

[thelonelycoder]

Hello!

In what folder are the certificates of pixelserv located?

/opt/var/cache/pixelserv

 

[Xentrk]

It was probably part of a larger CIDR range. There's no great way to find the exact match unless you wrote a function to do 30 or so checks for every CIDR block size, in Skynet I just print "possible" matches for that reason.

Thanks for the tip @Adamm! I forgot about that.

I found 82.165.0.0/16 in country DE.

 

[Diamond67]

Thanks, this is fixed now.
The missing check has been added to line #3738 in ab-solution.sh.
Enter 33 if you want to update, no version change.

Upgraded to version 3.9 and run this "33" as well.

No issues so far. Even tested the new backup feature.

 

[thelonelycoder]

Upgraded to version 3.9 and run this "33" as well.

In cu, when there are no updates available it has an option to re-download the addon files or the main script, or all of them.
The 33 is a shortcut without prompts to re-download the main script, ab-solution.sh, while 12 re-downloads all addon scripts in use.
1233 re-downloads all of these in one go.
Documented on the website: Hidden commands.

 

[eclp]

Two questions.
If AB-Solution is reinstalled or updated, this message always comes up in Syslog:

dnsmasq: warning: ignoring resolv-file flag because no-resolv is set

Is this a mistake?

And, is there the possibility to set the update times (Tuesdays, 2 am) also half-hourly? So on Tuesdays 1:30 am, for example.
Then the updates of different scripts would not always overlap. (AB-Solution & Skynet, for me)

 

[thelonelycoder]

If AB-Solution is reinstalled or updated, this message always comes up in Syslog:

dnsmasq: warning: ignoring resolv-file flag because no-resolv is set

Is this a mistake?

This is not set by AB.

And, is there the possibility to set the update times (Tuesdays, 2 am) also half-hourly? So on Tuesdays 1:30 am, for example.
Then the updates of different scripts would not always overlap. (AB-Solution & Skynet, for me)

There is one job that AB sets once a week at the full hour.
You can change the day and full hour from 1am to 12 noon.
I'm sure you'll find a convenient time for AB to do the blocking file update without interference from another script.
Since some of the other jobs are tied to that update hour, changing that will make it unnecessary difficult.

Skynet only runs the save function at the full hour.

 

[Adamm]

And, is there the possibility to set the update times (Tuesdays, 2 am) also half-hourly? So on Tuesdays 1:30 am, for example.
Then the updates of different scripts would not always overlap. (AB-Solution & Skynet, for me)

Adding to the comment above, Skynets hourly cron is very minimal, it simply saves the IPSets, prints some stats and exits in 1-4 seconds depending on list size. These two scripts shouldn't interfere (and actually have some features specifically designed to work with each-other). I've been running both for years and its never caused an issue so you can sleep easy.

 

[thelonelycoder]

Adding to the comment above, Skynets hourly cron is very minimal, it simply saves the IPSets, prints some stats and exits in 1-4 seconds depending on list size.

And by that time, the blocking file update has barely started. There are a couple of checks that run before the heavy lifting is done with the download of the hosts files, combining, sorting and removing whitelist(s) and other unwanted stuff.
So, @eclp has no reason to be worried about.

 

[jpdsc]

@thelonelycoder, when I open http://www.ibood.com/nl/nl/ it takes a while to load the page. This only happens with ABS active.
Is there any way to know which url is being blocked? If I follow the log I see no highlighted blocked domain when accessing the site.

 

[skeal]

@thelonelycoder I upgraded to 3.9 but noticed "host 1" was not downloading. I got the ip from the hosts address put into ya-malware-block white list and it solved the update problem. Just thought I would pass the information on to you.

Host 1 winhelp2002.mvps.org
Translates to IP 216.155.126.40

 

[thelonelycoder]

@thelonelycoder I upgraded to 3.9 but noticed "host 1" was not downloading. I got the ip from the hosts address put into ya-malware-block white list and it solved the update problem. Just thought I would pass the information on to you.

Host 1 winhelp2002.mvps.org
Translates to IP 216.155.126.40

From post #1:

- AB-Solution now writes the /jffs/shared-AB-whitelist for other scripts to use.
This list is updated weekly with the blocking file update and whenever the whitelist is edited.
This file includes the whitelist.txt and other domains required for AB to work.
In return, AB-Solution uses every other /jffs/shared-*-whitelist it finds and whitelists these domains. See for more in this discussion.

Skynet and AB happily exchange that info this way already.
It's up to the sccript writers to include it and share theirs.
I have done my part.

 

[skeal]

From post #1:

Skynet and AB happily exchange that info this way already.
It's up to the sccript writers to include it and share theirs.
I have done my part.

Thank you for your prompt reply and diplomacy. I will take this to another thread. Thanks again! Excellent script!!

 

[thelonelycoder]

@thelonelycoder, when I open http://www.ibood.com/nl/nl/ it takes a while to load the page. This only happens with ABS active.
Is there any way to know which url is being blocked? If I follow the log I see no highlighted blocked domain when accessing the site.

That depends on what blocking file type you use. With AdsBeGone! I get these:
www.googletagmanager.com
www.google-analytics.com