AB-Solution 1.07 is out!

[thelonelycoder]

Hello all,

I installed 1.07 on a Asuswrt merlin 380.61 running on an AC87U router. I used uBlock but after installation, clear cache and restart of Chrome, I do still get the same number of blocked items in the uB logo. Is that normal?

Example of the log when I refresh the page (aliexpress)
[/CODE]

Did I miss anything? I would have expect some resolutions to be 0.0.0.0 as per the hosts-adblock file and the number in uB logo to decrease. Therefore I don't feel it worth for me to get rid of uBlock on the navigator.

Did i miss anything?

My goal is to save CPU when watching Youtube videos has my computer lags too much because of the quantities of ads. I did select 3 : shooter40sw file

Merci
XabiX

Opening aliexpress.com blocks about 50 requests when using the Standard hosts files. With shooter's you should see even more blocked ones.
Check your Devices DNS settings, they all need to point to your Asus Router, not anywhere else. A lot of people have set googles 8.8.8.8 and 8.8.4.4.
You may set google's DNS in the WAN settings on the router, but not in the LAN settings. Altough this has been checked during the installation of AB-Solution.
But double check it anyway.

 

[XabiX]

Opening aliexpress.com blocks about 50 requests when using the Standard hosts files. With shooter's you should see even more blocked ones.
Check your Devices DNS settings, they all need to point to your Asus Router, not anywhere else. A lot of people have set googles 8.8.8.8 and 8.8.4.4.
You may set google's DNS in the WAN settings on the router, but not in the LAN settings. Altough this has been checked during the installation of AB-Solution.
But double check it anyway.

Hi thelonelycoder,
Can this be because of the LAN DNS settings being empty? Maybe worth updated the script if that's not allowed.

I have attached screenshots of my configuration for better insight.

Merci

 

[thelonelycoder]

Can this be because of the LAN DNS settings being empty? Maybe worth updated the script if that's not allowed.

That is being checked during install. Your settings for WAN and LAN are correct for AB-Solution to work.
Did you check your computer's, browsers, what have you DNS setting?

Also check the System Log on your router. You should see entries like:
- AB-Solution added entries via ab_dnsmasq_postconf.sh
- AB-Solution added entries via post-mount
- dnsmasq[21168]: read /tmp/mnt/<your device>/adblocking/hosts-adblock - 49488 addresses

 

[XabiX]

On my laptop, I have:

Connection-specific DNS Suffix . :
Description . . . . . . . . . . . : Intel(R) Dual Band Wireless-AC 7260
Physical Address. . . . . . . . . : 48-51-B7-5B-B1-70
DHCP Enabled. . . . . . . . . . . : Yes
Autoconfiguration Enabled . . . . : Yes
Link-local IPv6 Address . . . . . : fe80::d8c9:e44b:3dcd:b421%12(Preferred)
IPv4 Address. . . . . . . . . . . : 10.0.0.3(Preferred)
Subnet Mask . . . . . . . . . . . : 255.255.255.0
Lease Obtained. . . . . . . . . . : mercredi 24 août 2016 20:15:22
Lease Expires . . . . . . . . . . : vendredi 26 août 2016 21:30:44
Default Gateway . . . . . . . . . : 10.0.0.1
DHCP Server . . . . . . . . . . . : 10.0.0.1
DHCPv6 IAID . . . . . . . . . . . : 206066103
DHCPv6 Client DUID. . . . . . . . : 00-01-00-01-1E-C8-03-5C-EC-F4-BB-65-42-44

DNS Servers . . . . . . . . . . . : 10.0.0.1
NetBIOS over Tcpip. . . . . . . . : Enabled

I had a script in the LAN settings (wap.dat) of the internet explorer/chrome. So I changed it to: "Automatic Detect Settings" and restarted Chrome.

1/ Didn't find ab_dnsmasq_postconf.sh
2/ xabix@Router:/jffs/scripts# more post-mount
#!/bin/sh

# generated by AB-Solution 1.07
if [ -d "/tmp/mnt/cle" ];then
sleep 2
service restart_dnsmasq
logger "AB-Solution added entries via post-mount"
fi

3/ In this file dnsmasq.log , I do see such logs:
Aug 25 21:44:11 dnsmasq[17783]: /tmp/mnt/cle/adblocking/hosts-adblock www.google-analytics.com is 0.0.0.0

4/ The host file is pretty heavy with many entries looking good.
-rw-r--r-- 1 xabix root 6162482 Aug 25 16:46 hosts-adblock

5/ now the refresh of aliexpress page gives:

Aug 25 21:50:16 dnsmasq[17783]: query[A] microsoft.com from 10.0.0.4
Aug 25 21:50:16 dnsmasq[17783]: cached microsoft.com is 104.43.195.251
Aug 25 21:50:16 dnsmasq[17783]: cached microsoft.com is 104.40.211.35
Aug 25 21:50:16 dnsmasq[17783]: cached microsoft.com is 23.96.52.53
Aug 25 21:50:16 dnsmasq[17783]: cached microsoft.com is 191.239.213.197
Aug 25 21:50:16 dnsmasq[17783]: cached microsoft.com is 23.100.122.175
Aug 25 21:50:18 dnsmasq[17783]: query[A] fr.aliexpress.com from 10.0.0.3
Aug 25 21:50:18 dnsmasq[17783]: forwarded fr.aliexpress.com to 80.10.246.132
Aug 25 21:50:18 dnsmasq[17783]: forwarded fr.aliexpress.com to 8.8.4.4
Aug 25 21:50:18 dnsmasq[17783]: reply fr.aliexpress.com is <CNAME>
Aug 25 21:50:18 dnsmasq[17783]: reply us-aebridge.aliexpress.com is <CNAME>
Aug 25 21:50:18 dnsmasq[17783]: reply us-aebridge.aliexpress.com.gds.alibabadns.com is 198.11.132.250
Aug 25 21:50:19 dnsmasq[17783]: query[A] i.alicdn.com from 10.0.0.3
Aug 25 21:50:19 dnsmasq[17783]: forwarded i.alicdn.com to 80.10.246.132
Aug 25 21:50:19 dnsmasq[17783]: reply i.alicdn.com is <CNAME>
Aug 25 21:50:19 dnsmasq[17783]: reply wildcard.alicdn.com.edgekey.net is <CNAME>
Aug 25 21:50:19 dnsmasq[17783]: reply e11956.b.akamaiedge.net is 23.43.18.172
Aug 25 21:50:19 dnsmasq[17783]: query[A] ae01.alicdn.com from 10.0.0.3
Aug 25 21:50:19 dnsmasq[17783]: forwarded ae01.alicdn.com to 80.10.246.132
Aug 25 21:50:19 dnsmasq[17783]: reply ae01.alicdn.com is <CNAME>
Aug 25 21:50:19 dnsmasq[17783]: reply wildcard.alicdn.com.edgekey.net is <CNAME>
Aug 25 21:50:19 dnsmasq[17783]: reply e11956.b.akamaiedge.net is 23.43.18.172
Aug 25 21:50:21 dnsmasq[17783]: query[A] message.aliexpress.com from 10.0.0.3
Aug 25 21:50:21 dnsmasq[17783]: forwarded message.aliexpress.com to 80.10.246.132
Aug 25 21:50:21 dnsmasq[17783]: query[A] lighthouse.aliexpress.com from 10.0.0.3
Aug 25 21:50:21 dnsmasq[17783]: forwarded lighthouse.aliexpress.com to 80.10.246.132
Aug 25 21:50:21 dnsmasq[17783]: reply message.aliexpress.com is <CNAME>
Aug 25 21:50:21 dnsmasq[17783]: reply wildcard.alicdn.com.edgekey.net is <CNAME>
Aug 25 21:50:21 dnsmasq[17783]: reply e11956.b.akamaiedge.net is 23.43.18.172
Aug 25 21:50:21 dnsmasq[17783]: reply lighthouse.aliexpress.com is <CNAME>
Aug 25 21:50:21 dnsmasq[17783]: reply wildcard.alicdn.com.edgekey.net is <CNAME>
Aug 25 21:50:21 dnsmasq[17783]: reply e11956.b.akamaiedge.net is 23.43.18.172
Aug 25 21:50:23 dnsmasq[17783]: query[A] atmamos.alicdn.com from 10.0.0.3
Aug 25 21:50:23 dnsmasq[17783]: forwarded atmamos.alicdn.com to 80.10.246.132
Aug 25 21:50:23 dnsmasq[17783]: reply atmamos.alicdn.com is <CNAME>
Aug 25 21:50:23 dnsmasq[17783]: reply us-scproxy.alicdn.com is <CNAME>
Aug 25 21:50:23 dnsmasq[17783]: reply us-scproxy.alicdn.com.gds.alibabadns.com is 198.11.132.117
Aug 25 21:50:24 dnsmasq[17783]: query[A] hotproducts.aliexpress.com from 10.0.0.3
Aug 25 21:50:24 dnsmasq[17783]: forwarded hotproducts.aliexpress.com to 80.10.246.132
Aug 25 21:50:24 dnsmasq[17783]: reply hotproducts.aliexpress.com is <CNAME>
Aug 25 21:50:24 dnsmasq[17783]: reply hotproducts.aliexpress.com.gds.alibabadns.com is <CNAME>
Aug 25 21:50:24 dnsmasq[17783]: reply wildcard.alicdn.com.edgekey.net is <CNAME>
Aug 25 21:50:24 dnsmasq[17783]: reply e11956.b.akamaiedge.net is 23.43.18.172
Aug 25 21:50:26 dnsmasq[17783]: query[A] feedback.aliexpress.com from 10.0.0.3
Aug 25 21:50:26 dnsmasq[17783]: forwarded feedback.aliexpress.com to 80.10.246.132
Aug 25 21:50:26 dnsmasq[17783]: reply feedback.aliexpress.com is <CNAME>
Aug 25 21:50:26 dnsmasq[17783]: reply wildcard.alicdn.com.edgekey.net is <CNAME>
Aug 25 21:50:26 dnsmasq[17783]: reply e11956.b.akamaiedge.net is 23.43.18.172
Aug 25 21:50:26 dnsmasq[17783]: query[A] freight.aliexpress.com from 10.0.0.3
Aug 25 21:50:26 dnsmasq[17783]: forwarded freight.aliexpress.com to 80.10.246.132
Aug 25 21:50:26 dnsmasq[17783]: reply freight.aliexpress.com is <CNAME>
Aug 25 21:50:26 dnsmasq[17783]: reply freight.aliexpress.com.gds.alibabadns.com is <CNAME>
Aug 25 21:50:26 dnsmasq[17783]: reply wildcard.alicdn.com.edgekey.net is <CNAME>
Aug 25 21:50:26 dnsmasq[17783]: reply e11956.b.akamaiedge.net is 23.43.18.172
Aug 25 21:50:26 dnsmasq[17783]: query[A] promotion.aliexpress.com from 10.0.0.3
Aug 25 21:50:26 dnsmasq[17783]: forwarded promotion.aliexpress.com to 80.10.246.132
Aug 25 21:50:26 dnsmasq[17783]: reply promotion.aliexpress.com is <CNAME>
Aug 25 21:50:26 dnsmasq[17783]: reply wildcard.alicdn.com.edgekey.net is <CNAME>
Aug 25 21:50:26 dnsmasq[17783]: reply e11956.b.akamaiedge.net is 23.74.206.140
Aug 25 21:50:27 dnsmasq[17783]: query[A] us.ae.aliexpress.com from 10.0.0.3
Aug 25 21:50:27 dnsmasq[17783]: forwarded us.ae.aliexpress.com to 80.10.246.132
Aug 25 21:50:27 dnsmasq[17783]: query[A] my.aliexpress.com from 10.0.0.3
Aug 25 21:50:27 dnsmasq[17783]: forwarded my.aliexpress.com to 80.10.246.132
Aug 25 21:50:27 dnsmasq[17783]: reply my.aliexpress.com is <CNAME>
Aug 25 21:50:27 dnsmasq[17783]: reply wildcard.alicdn.com.edgekey.net is <CNAME>
Aug 25 21:50:27 dnsmasq[17783]: reply e11956.b.akamaiedge.net is 23.74.206.140
Aug 25 21:50:27 dnsmasq[17783]: reply us.ae.aliexpress.com is <CNAME>
Aug 25 21:50:27 dnsmasq[17783]: reply wildcard.alicdn.com.edgekey.net is <CNAME>
Aug 25 21:50:27 dnsmasq[17783]: reply e11956.b.akamaiedge.net is 23.74.206.140
Aug 25 21:50:27 dnsmasq[17783]: query[A] google.com from 10.0.0.4
Aug 25 21:50:27 dnsmasq[17783]: cached google.com is 172.217.20.46
Aug 25 21:50:38 dnsmasq[17783]: query[A] microsoft.com from 10.0.0.4
Aug 25 21:50:38 dnsmasq[17783]: cached microsoft.com is 23.100.122.175
Aug 25 21:50:38 dnsmasq[17783]: cached microsoft.com is 104.43.195.251
Aug 25 21:50:38 dnsmasq[17783]: cached microsoft.com is 104.40.211.35
Aug 25 21:50:38 dnsmasq[17783]: cached microsoft.com is 23.96.52.53
Aug 25 21:50:38 dnsmasq[17783]: cached microsoft.com is 191.239.213.197

Examples of entries being changed to 0.0.0.0;
Aug 25 21:43:07 dnsmasq[17783]: /tmp/mnt/cle/adblocking/hosts-adblock sb.scorecardresearch.com is 0.0.0.0
Aug 25 21:43:08 dnsmasq[17783]: /tmp/mnt/cle/adblocking/hosts-adblock sb.scorecardresearch.com is 0.0.0.0
Aug 25 21:44:11 dnsmasq[17783]: /tmp/mnt/cle/adblocking/hosts-adblock www.google-analytics.com is 0.0.0.0
Aug 25 21:45:10 dnsmasq[17783]: /tmp/mnt/cle/adblocking/hosts-adblock www.google-analytics.com is 0.0.0.0
Aug 25 21:45:17 dnsmasq[17783]: /tmp/mnt/cle/adblocking/hosts-adblock www.google-analytics.com is 0.0.0.0
Aug 25 21:45:23 dnsmasq[17783]: /tmp/mnt/cle/adblocking/hosts-adblock vortex-win.data.microsoft.com is 0.0.0.0
Aug 25 21:45:23 dnsmasq[17783]: /tmp/mnt/cle/adblocking/hosts-adblock vortex-win.data.microsoft.com is 0.0.0.0
Aug 25 21:45:24 dnsmasq[17783]: /tmp/mnt/cle/adblocking/hosts-adblock vortex-win.data.microsoft.com is 0.0.0.0
Aug 25 21:45:24 dnsmasq[17783]: /tmp/mnt/cle/adblocking/hosts-adblock vortex-win.data.microsoft.com is 0.0.0.0
Aug 25 21:50:57 dnsmasq[17783]: /tmp/mnt/cle/adblocking/hosts-adblock geo.yahoo.com is 0.0.0.0
Aug 25 21:51:00 dnsmasq[17783]: /tmp/mnt/cle/adblocking/hosts-adblock sb.scorecardresearch.com is 0.0.0.0
Aug 25 21:51:11 dnsmasq[17783]: /tmp/mnt/cle/adblocking/hosts-adblock ssl.google-analytics.com is 0.0.0.0

 

[XabiX]

Sorry my message was too long

So it seems it s all working good. I was expecting getting rid of uBlock but will you recommend keeping both. I will do some tests on pages with more ads than aliexpress to see if there is a difference between with or without uBlock.

Thanks a lot for the hard work of supporting this initiative which is really great and smart rather than having extensions in each single laption and navigator.

 

[XabiX]

Hi,

me again . So it seems the all setup works fine but not all the ads blocked by uBlock will be block with the shooter40sw list.
Attached a screenshot of the ad I wanted to block.

I did add "0.0.0.0 beap.gemini.yahoo.com" into the blacklist.txt and it was automatically taken into account which gives in the log:
Aug 25 22:05:16 dnsmasq[17783]: query[A] ir2.beap.gemini.yahoo.com from 10.0.0.3
Aug 25 22:05:16 dnsmasq[17783]: /tmp/mnt/cle/adblocking/hosts-adblock ir2.beap.gemini.yahoo.com is 0.0.0.0
I did clear the cache but I still see the ad so I am wondering why or what I am doing wrong.

Any idea? or are they some ad sites that we can't block by just tweaking the DNS resolution?

Merci

 

[thelonelycoder]

Please, now that it apparently runs fine, give it some time and learn about hosts based blockers.
And read the other posts for answers.
Don't expect your petit router to do the same as what your ordinateur and uBlock can do.

 

[majnu]

Now it working... i found out i have to set DNS point to router's IP... Thanks!

How do you do that?

I changed my DNS to Google's and AB-Solution does not work.

Edit - Found it

but I still get ads in Twitch when I do this.

 

[thelonelycoder]

but I still get ads in Twitch when I do this.

Changing the DNS to google's will not affect ads server. Not at all.

 

[majnu]

Changing the DNS to google's will not affect ads server. Not at all.

Unfortunately it is on my end. I did the above, reset my router. Entered putty and Toogle Logging off and then back on again and I get Spike advertisements in Twitch and when streams start.

 

[thelonelycoder]

@majnu in the post you linked to @alienx2 we never talked about changing the DNS on the router.
We were talking about the computer's DNS settings. Those MAY ONLY point to your routers IP for AB-Solution to work.

 

[majnu]

@majnu in the post you linked to @alienx2 we never talked about changing the DNS on the router.
We were talking about the computer's DNS settings. Those MAY ONLY point to your routers IP for AB-Solution to work.

Ok, so when I installed AB Solution and wanted to use my own DNS settings which were already in my LAN settings. AB Solution gave a prompt that it will remove it and reboot my router and that I should enter my DNS settings in the WAN option (shown in the picture above). I have done all of that and it's not blocking ads.

I have just changed my computers DNS settings to Google's also and used my default gateway address and ads still show. I've obviously done something wrong somewhere.

 

[thelonelycoder]

I have just changed my computers DNS settings to Google's also and used my default gateway address and ads still show. I've obviously done something wrong somewhere.

You obviously don't understand what I wrote in my previous post:
For AB-Solution to work:
- DO NOT set DNS Servers in LAN settings on your router
- DO NOT set any DNS Servers on your LAN devices (e.g. your computer, phone, whatever) to anywhere else than your routers IP Address

If you want Ad-Blocking to work, you must set them to your router IP, how else should my script work if you tell them to go ask google to tell them where a website is?
One more time: If you set the DNS Server on your computer, phone, whatever, to the IP of your router then the router can do it's job and block ads.

 

[majnu]

You obviously don't understand what I wrote in my previous post:
For AB-Solution to work:
- DO NOT set DNS Servers in LAN settings on your router
- DO NOT set any DNS Servers on your LAN devices (e.g. your computer, phone, whatever) to anywhere else than your routers IP Address

If you want Ad-Blocking to work, you must set them to your router IP, how else should my script work if you tell them to go ask google to tell them where a website is?
One more time: If you set the DNS Server on your computer, phone, whatever, to the IP of your router then the router can do it's job and block ads.

I did as you asked and it's working again.

Just to explain why I did that change my WAN DNS setting. When I installed I had this prompt

So I did exactly as it asked unless I misunderstood it. I changed this

to

and left my LAN settings empty.

At that point Ad Blocking wasn't working so I was trying to find the solution by looking at my adapters IP setting and changing it to the default gateway.

So presently my WAN DNS setting is set to Connect to DNS server setting automatically "Yes" with nothing populated in the Server 1/2 fields, just like in the second pic and now everything works.

Edit - The only problem I have is that when I don't use a DNS server that all Twitch streams buffer for me and freeze. It's why I chose a new ISP as mine was up for renewal anyway hoping that it would improve things. Various speedtest sites show my connection and ping being fine. 75/20 10ms latency.

 

[thelonelycoder]

At the time you installed AB-Solution you had DNS Server 1 and DNS Server 2 filled in with Google's DNS: 8.8.8.8 and 8.8.4.4.
My wise script told you nicely that it already has done so [Removing LAN DNS Server(s)].
--> It has removed these settings in LAN/DHCP Server/

Look at my two screenshots, these are settings that work from the routers point of view.
One is for the WAN, I have this router auto connect to it's big brother.
The other is LAN/DHCP Server. Make sure you have these settings exactly as I have (not the IP address of course).
Then make sure your divices get their DNS automatically or if manually set, to set them to your router's IP.

Did you ever check your dnsmasq logfile to look for clues? It's the (f) option in the AB-Solution Menu.

 

[zy_zhao]

why i cant add link to update host file ??

 

[thelonelycoder]

why i cant add link to update host file ??

What do you mean? Add another hosts file to it?
The next version of AB-Solution will have the option to assemble your own hosts to be used.

 

[Zirescu]

@thelonelycoder Thanks for the good work on this!

I missed the line that stated anything that was in post-mount would be removed and happened to reboot the router today and lost my DNS resolution (I'm using dnscrypt with Entware). After some troubleshooting tracked it down to the Entware info getting removed. Added it back in and off to the races again.

 

[thelonelycoder]

@thelonelycoder Thanks for the good work on this!

I missed the line that stated anything that was in post-mount would be removed and happened to reboot the router today and lost my DNS resolution (I'm using dnscrypt with Entware). After some troubleshooting tracked it down to the Entware info getting removed. Added it back in and off to the races again.

And a fact that haunts and bugs me. If a smarter mind than me has code to check if:
- the file exists, has the shebang at the top and is in Unix EOL
- all my entries are all (still) in the file
- previous entries from a older AB-Solution version with different content are in
- the user has manipulated the entries
- maybe some more if's
then I would gladly accept the code and implement it right away.
Until then: Sorry folks, but that's just the way it is.

The upcoming version, AB-Solution 2.0, has a check built in if entries are present when run.

 

[David1973]

I just installed ab-solution and like it was supposed to do it erased my lan dns. I had the lan dns set to opendns and now with the lan dns entries blank, opendns doesn't block malware sites like it use to. Is there something I can do to get opendns back? I still have opendns active on my wan, but if I go to the opendns welcome page, it says that my dns servers are set to opendns, but when I click the test opendns blocking page it says the blocking test failed. Is there any scripts or anything I can do to put opendns dns back into the lan? Thank you for your time, David.