Asus stock/Merlin URL Filter List: (Max Limit : 64), URL too long truncated?

[Ben_]

We have 4 Asus routers, RT-AC68U (bought from Staples), RT-AC1900P (bought from BestBuy) and two given by T-Mobile TM-AC1900.

1) Both the TM-AC1900 have URL Filter List: (Max Limit : 128), whereas the RT-AC68U and RT-AC1900P only have URL Filter List: (Max Limit : 64), is there anyway to increase the Max Limit in RT-AC68U and RT-AC1900P to 128 (just like in TM-AC1900)?

2) Be it running in Asus stock/Merlin or T-Mobile version of firmware, under URL Filter List, " amzdigitaldownloads.edgesuite.net" got truncated to "amzdigitaldownloads.edgesuite.ne", is there anyway to increase the URL length?

3) Maybe I'm trying to do this in the wrong way, I'm trying to block these sites using our routers, list is below:

- Amazon Fire TV Updates
amzdigital-a.akamaihd.net
amzdigitaldownloads.edgesuite.net
softwareupdates.amazon.com
updates.amazon.com
d1s31zyz7dcc2d.cloudfront.net
montoya-ota
bueller-ota

- HOSTS
www.google-analytics.com
www.googleadservices.com
www.googletagservices.com
www-google-analytics.l.google.com
video-stats.video.google.com
video-ad-stats.googlesyndication.com
tpc.googlesyndication.com
tpcnc.googlesyndication.com
ssl.google-analytics.com
pagead.l.google.com
pagead2.googlesyndication.com
partner.googleadservices.com
partnerad.l.google.com
google-analytics.com
googleads.g.doubleclick.net
googleads2.g.doubleclick.net
googleadservices.com
googlesyndication.com
googletagmanager.com
gg.google.com
analytics.google.com
afs.googlesyndication.com
adservice.google.com
ads.google.com
112.2o7.net

- Ads Filter
adsense.com
adblade.com
207.net
247realmedia.com
2mdn.net
2o7.net
33across.com
abmr.net
adbrite.com
adbureau.net
adchemy.com
addthis.com
addthisedge.com
admeld.com
admob.com
adsonar.com
advertising.com
afy11.net
aquantive.com
atdmt.com
atwola.com
channelintelligence.com
cmcore.com
coremetrics.com
crowdscience.com
decdna.net
decideinteractive.com
doubleclick.com
doubleclick.net
esomniture.com
fimserve.com
flingwebads.com
foxnetworks.com
googleadservices.com
googlesyndication.com
google-analytics.com
gravity.com
hitbox.com
imiclk.com
imrworldwide.com
insightexpress.com
insightexpressai.com
intellitxt.com
invitemedia.com
leadback.com
lindwd.net
mookie1.com
myads.com
netconversions.com
nexac.com
nextaction.net
nielsen-online.com
offermatica.com
omniture.com
omtrdc.net
pm14.com
quantcast.com
quantserve.com
realmedia.com
revsci.net
rightmedia.com
rmxads.com
ru4.com
rubiconproject.com
samsungadhub.com
scorecardresearch.com
sharethis.com
shopthetv.com
acoda.net
targetingmarketplace.com
themig.com
trendnetcloud.com
yieldmanager.com
yieldmanager.net
yldmgrimg.net
youknowbest.com
yumenetworks.com

Please point me to the right direction and thanks in advance for your time/help.

 

[L&LD]

We have 4 Asus routers, RT-AC68U (bought from Staples), RT-AC1900P (bought from BestBuy) and two given by T-Mobile TM-AC1900.

1) Both the TM-AC1900 have URL Filter List: (Max Limit : 128), whereas the RT-AC68U and RT-AC1900P only have URL Filter List: (Max Limit : 64), is there anyway to increase the Max Limit in RT-AC68U and RT-AC1900P to 128 (just like in TM-AC1900)?

2) Be it running in Asus stock/Merlin or T-Mobile version of firmware, under URL Filter List, " amzdigitaldownloads.edgesuite.net" got truncated to "amzdigitaldownloads.edgesuite.ne", is there anyway to increase the URL length?

3) Maybe I'm trying to do this in the wrong way, I'm trying to block these sites using our routers, list is below:

- Amazon Fire TV Updates
amzdigital-a.akamaihd.net
amzdigitaldownloads.edgesuite.net
softwareupdates.amazon.com
updates.amazon.com
d1s31zyz7dcc2d.cloudfront.net
montoya-ota
bueller-ota

- HOSTS
www.google-analytics.com
www.googleadservices.com
www.googletagservices.com
www-google-analytics.l.google.com
video-stats.video.google.com
video-ad-stats.googlesyndication.com
tpc.googlesyndication.com
tpcnc.googlesyndication.com
ssl.google-analytics.com
pagead.l.google.com
pagead2.googlesyndication.com
partner.googleadservices.com
partnerad.l.google.com
google-analytics.com
googleads.g.doubleclick.net
googleads2.g.doubleclick.net
googleadservices.com
googlesyndication.com
googletagmanager.com
gg.google.com
analytics.google.com
afs.googlesyndication.com
adservice.google.com
ads.google.com
112.2o7.net

- Ads Filter
adsense.com
adblade.com
207.net
247realmedia.com
2mdn.net
2o7.net
33across.com
abmr.net
adbrite.com
adbureau.net
adchemy.com
addthis.com
addthisedge.com
admeld.com
admob.com
adsonar.com
advertising.com
afy11.net
aquantive.com
atdmt.com
atwola.com
channelintelligence.com
cmcore.com
coremetrics.com
crowdscience.com
decdna.net
decideinteractive.com
doubleclick.com
doubleclick.net
esomniture.com
fimserve.com
flingwebads.com
foxnetworks.com
googleadservices.com
googlesyndication.com
google-analytics.com
gravity.com
hitbox.com
imiclk.com
imrworldwide.com
insightexpress.com
insightexpressai.com
intellitxt.com
invitemedia.com
leadback.com
lindwd.net
mookie1.com
myads.com
netconversions.com
nexac.com
nextaction.net
nielsen-online.com
offermatica.com
omniture.com
omtrdc.net
pm14.com
quantcast.com
quantserve.com
realmedia.com
revsci.net
rightmedia.com
rmxads.com
ru4.com
rubiconproject.com
samsungadhub.com
scorecardresearch.com
sharethis.com
shopthetv.com
acoda.net
targetingmarketplace.com
themig.com
trendnetcloud.com
yieldmanager.com
yieldmanager.net
yldmgrimg.net
youknowbest.com
yumenetworks.com

Please point me to the right direction and thanks in advance for your time/help.

What firmware are you running? The amtm and Diversion scripts by thelonelycoder will do far more than the 128 limit you want.

 

[Ben_]

What firmware are you running? The amtm and Diversion scripts by thelonelycoder will do far more than the 128 limit you want.

Thanks L&LD!

Both RT-AC68U and RT-AC1900P are running the default stock RT-AC68U_3.0.0.4_384_20308. Both of these were manufactured in 2018 and came with RT-AC68U_3.0.0.4_384_20308.

I'm very interested in the scripts by thelonelycoder you mentioned, how difficult is it for an ordinary guy to get the router to run/execute the above scripts?

 

[L&LD]

You're welcome Ben_,

This isn't difficult, but it will take some time and effort on your part to bring your routers up to speed.

Note that for both your routers ('68U and '1900P), the same RMerlin firmware can be applied to both.

In the instructions to follow, I assume you are using a Windows computer. Please make adjustments as necessary if using another os.

Executive overview:

1. Flash the latest RMerlin firmware, currently 384.10_2.
2. Do a full M&M Config to bring the new firmware and your hardware to a good/known state.
3. Enable JFFS custom scripts and configs option.
4. Enable SSH access to the router.
5. Install amtm on the jffs partition.
   1. Install USB drive, format and label it using amtm.
   2. Create a swap file on the drive.
6. Install Diversion.
7. Customize it for your needs as necessary.

This can be a multi-part response if you're interested. Should I continue with more detailed instructions for you?

Or, is this enough to get you going for now?

 

[Ben_]

You're welcome Ben_,

This isn't difficult, but it will take some time and effort on your part to bring your routers up to speed.

Note that for both your routers ('68U and '1900P), the same RMerlin firmware can be applied to both.

In the instructions to follow, I assume you are using a Windows computer. Please make adjustments as necessary if using another os.

Executive overview:

1. Flash the latest RMerlin firmware, currently 384.10_2.
2. Do a full M&M Config to bring the new firmware and your hardware to a good/known state.
3. Enable JFFS custom scripts and configs option.
4. Enable SSH access to the router.
5. Install amtm on the jffs partition.
   1. Install USB drive, format and label it using amtm.
   2. Create a swap file on the drive.
6. Install Diversion.
7. Customize it for your needs as necessary.

This can be a multi-part response if you're interested. Should I continue with more detailed instructions for you?

Or, is this enough to get you going for now?

Thanks again and I'll read up on JFFS/jffs partition.

All good for now and will be back when I'm ready to install Diversion!

 

[L&LD]

Thanks again and I'll read up on JFFS/jffs partition.

All good for now and will be back when I'm ready to install Diversion!

Just a couple of key points to the overview above.

Use USB 2 for the drive, even if plugged into the USB 3.0 port. It won't make a difference in how it runs, but it will also not interfere with the WiFi.

Use the Ext4 format option in amtm, and enable the journalling too.

I always create the maximum allowed swap file with amtm (2GB), but at the minimum, you want it to match the router's RAM.

https://sourceforge.net/projects/asuswrt-merlin/files/RT-AC68U/Release/

https://diversion.ch/amtm.html

 

[Ben_]

Just a couple of key points to the overview above.

Use USB 2 for the drive, even if plugged into the USB 3.0 port. It won't make a difference in how it runs, but it will also not interfere with the WiFi.

Use the Ext4 format option in amtm, and enable the journalling too.

I always create the maximum allowed swap file with amtm (2GB), but at the minimum, you want it to match the router's RAM.

https://sourceforge.net/projects/asuswrt-merlin/files/RT-AC68U/Release/

https://diversion.ch/amtm.html

Hi buddy (my guru)!

I'm ready!
Done - Flashed RMerlin v384.10_2/NVRAM reset/Router reset

Please confirm the following steps:
1) Enable JFFS custom scripts and configs option
2) Enable SSH access to the router
3) Open PuTTY (Select SSH)
4) Paste "curl -Os https://raw.githubusercontent.com/decoderman/amtm/master/amtm && sh amtm" (Is this the same as - Install amtm on the jffs partition?)
5) After installation, start amtm with this command "/jffs/scripts/amtm"
6) Insert USB drive into USB 2.0 port
7) Select Ext4 format option in amtm (enable the journalling) & create swap file with amtm 2GB
8) Open PuTTY (Select SSH) and paste "curl -Os https://diversion.ch/install && sh install"
9) Select Diversion Lite or Diversion Standard?
10) To use/start Diversion - Open PuTTY (Select SSH) paste "/jffs/scripts/amtm" to start amtm and paste "diversion" to start Diversion?

Few questions:
1) My current JFFS is showing 1.68/ 62.72 MB, Google is telling me JFFS is a small storage memory, (RT-AC68U has 128 MB Flash and 256 MB RAM, is this JFFS using 62.72 MB of 128 MB Flash or 62.72 MB of 256 MB RAM?)
2) As it is now (before installation of amtm/Diversion) what is in my JFFS? (should be 0 instead of 1.68, right?)
3) There is an option "Format JFFS partition at next boot", does that mean I can remove/uninstall amtm/Diversion by simply selecting that option?
4) Once amtm & Diversion are installed, do I always leave "Enable JFFS custom scripts and configs" and "Enable SSH" (LAN only) permanently ON?
5) Once Diversion is installed, I don't want to block the whole internet, can I simply have Diversion to only block my own list in text file format loaded on the USB drive? or?


Oh boy, what am I getting myself into, lol!

 

[Ronald Schwerer]

Since this discussion seems to have gone to both generic Merlin questions and how to install Diversion, it should be moved to the Merlin subforum.

 

[RMerlin]

Asus has a hardcoded limit of 32 chars per URL.

 

[L&LD]

Hi buddy (my guru)!

Ben_,

I'm trying to reply to you but am not able to. There is a huge pop up that says I'm being blocked for 'malicious code'.

I'll try to edit my reply and see if it works with links removed.

 

[L&LD]

Hi buddy (my guru)!

Ben_, hello! You're doing great! Make sure to note the few changes below:

• 4) Yes, this is the same as installing amtm to the jffs partition.
• 6) You can install the USB drive into either the USB 3.0 or the USB 2.0 port. But I recommend changing the USB 3.0 mode to 2.0 for less interference with the 2.4GHz band if you use the USB 3.0 port.
• 8) The beauty of amtm is that you don't need to look up the installers individually for the included scripts! Instead, start amtm and choose '1' and it will walk you through installing Diversion. I recommend you start with the lite version, you can always change back and forth as you wish.
• 10) Once Diversion is installed, it is running. But if you want to see or adjust any of its parameters, then start amtm, choose '1' and you will be in the Diversion menu.

Bonus additional questions:

1. JFFS is its own storage, as far as I know. It doesn't need to borrow from either of the others.
2. It shouldn't be zero, no. But I've never looked at what is in there either! Never had to.
3. Formatting the JFFS partition at next boot is the first thing I would do before anything above! This way, you will be ensured you have started on a clean slate. But once things are installed and running, you want to use the amtm menus to uninstall the scripts or even amtm itself. You can 'format the jffs partition on next boot' of course, but that is equivalent of using a nuclear device to get rid of a few bugs.
4. Yes, leave those options on. If you turn off the 'enable jffs custom scripts and configs' you will 'break' all your scripts installed. If you disable SSH (make sure it is set to LAN only!), you will not be able to enter the 'shell' to control your scripts using PuTTY.

For your last question (5), I will let @thelonelycoder, the script's developer, to guide you properly there.

​

 

[L&LD]

Hi buddy (my guru)!

Oh boy, what am I getting myself into, lol!

Okay, you should be able to see my response in post 11, above.

 

[Ben_]

Asus has a hardcoded limit of 32 chars per URL.

Not only that, the MAX limit actually is 1024 kbs and NOT 64 entries/URLs.

I could only enter about 42 entries/URLs and it wouldn't accept anymore and I could see in the log files saying something MAX limit reached 1024 kbs or something like that.

This is the same as Access Restriction Rules in Tomato, except in Tomato one could create multiple Rules provided each rule is under 1024 kbs.

Thanks for having the options to turn off the LED and update checker, couldn't stand the constant flashing icon in the stock firmware! Canadian ehh!

 

[RMerlin]

Not only that, the MAX limit actually is 1024 kbs and NOT 64 entries/URLs.

With the 382_xxxx firmware release, Asus implemented strict nvram size validation in the firmware to better protect against security exploits tied to buffer overruns. Unfortunately, this means some of the chosen limits might not be 100% in-line with the limits at the webui level, when they limit things by number of entries there, without validating the total length.

 

[Ben_]

Okay, you should be able to see my response in post 11, above.

You are a great instructor L& LD.

Successfully implemented amtm and Diversion. Do you use Diversion yourself? I'm asking because I think Diversion is working like http://winhelp2002.mvps.org/hosts.htm in Windows and that sometimes is over killed.

I couldn't turn-off uBlock Origin in my FireFox because Diversion doesn't block "elements" and I don't see the option to include my own list?

Reading your reply..." using a nuclear device to get rid of a few bugs" is very entertaining, I'm sure you would be a great professor in college.

 

[L&LD]

You are a great instructor L& LD.

Successfully implemented amtm and Diversion. Do you use Diversion yourself? I'm asking because I think Diversion is working like http://winhelp2002.mvps.org/hosts.htm in Windows and that sometimes is over killed.

I couldn't turn-off uBlock Origin in my FireFox because Diversion doesn't block "elements" and I don't see the option to include my own list?

Reading your reply..." using a nuclear device to get rid of a few bugs" is very entertaining, I'm sure you would be a great professor in college.

I do use Diversion, but not FireFox or uBlock Origin. Don't think Diversion is overkill in today's overly monetized internet.

The way I see it, if Diversion doesn't show me something, I don't really need to see it.

Seriously, I have not had Diversion block anything of importance that I do on the web. I try to be good and Diversion helps me do so.

I have been many things but not a college professor (yet!). Thank you for your kind words.

I hope that @thelonelycoder can help you directly to get your custom list included soon.

 

[Ben_]

The way I see it, if Diversion doesn't show me something, I don't really need to see it.

This is a good one.

About the USB drive, mine is 128GB and I don't think amtm or Diversion will use more than 10GB, can I create a folder and drop media files in it as network share provided Windows 7/10 or my android devices can read from EXT4.

In the future, should I decide to use another smaller USB drive, do I just yank out the current one and redo from step 7) Select Ext4 format option in amtm (enable the journalling) & create swap file with amtm 2GB...?

Thanks again.

P/s When you have the time please review my 2.4GHZ and 5GHZ settings under a new thread, thanks.

 

[L&LD]

This is a good one.

About the USB drive, mine is 128GB and I don't think amtm or Diversion will use more than 10GB, can I create a folder and drop media files in it as network share provided Windows 7/10 or my android devices can read from EXT4.

In the future, should I decide to use another smaller USB drive, do I just yank out the current one and redo from step 7) Select Ext4 format option in amtm (enable the journalling) & create swap file with amtm 2GB...?

Thanks again.

P/s When you have the time please review my 2.4GHZ and 5GHZ settings under a new thread, thanks.

I'm using a spare 256GB USB stick, lots of unused capacity! Not recommended to use it for other things though? (I may be wrong about that).

I wouldn't just 'yank it out'! I would actually save a backup of the contents (if you want it for reference?) and then uninstall all the scripts you've used with Diversion being last (make sure to say yes to uninstall Entware) and finally, amtm too. Then I would 'format jffs partition on next boot', reboot 3 times in the next 15 minutes and then start from install amtm again.

Make sure you are not using the jffs partition for other data like OpenVPN files and such first!

I'll be sure to see the new thread soon.

 

[Ben_]

I'm using a spare 256GB USB stick, lots of unused capacity! Not recommended to use it for other things though? (I may be wrong about that).

I wouldn't just 'yank it out'! I would actually save a backup of the contents (if you want it for reference?) and then uninstall all the scripts you've used with Diversion being last (make sure to say yes to uninstall Entware) and finally, amtm too. Then I would 'format jffs partition on next boot', reboot 3 times in the next 15 minutes and then start from install amtm again.

Make sure you are not using the jffs partition for other data like OpenVPN files and such first!

I'll be sure to see the new thread soon.

Ok, thanks, will do as the Doc ordered!

 

[thelonelycoder]

I hope that @thelonelycoder can help you directly to get your custom list included soon

There's a dedicated thread for Diversion on this board.