Kamoj Kamoj Addon 5.5 Beta for Netgear R7800/R8900/R9000 with Voxel FW

[blueliner]

I thought this option would only add bypass rules for all traffic FROM the specified IPs.
The solution that blueliner needed, was to add bypass rules for all traffic TO the specified IPs. didn't yet look at b17 though, to see how you changed it.

Hello,

Good point. I haven't checked out the new bypass list yet, but you are right about bypassing traffic TO the specified ip's is what I needed. Thanks again.

Kamoj, while I haven't had a change to check out the bypass list, the my router with 5.5b17 is still running great - no other issues have cropped up.

Best wishes,
BL

 

[Heriberto Silva Alves]

After I installed the last version ADguard is not working anymore. What Am I missing? Logs:

[2022-02-02 16:56:54] [ADGUARD] Log erased by operator trigged addon
2022-02-02 16:57:01 83908.71 [ADGUARD] addon_adguard.sh 9403: Install called
2022-02-02 16:57:01 83908.73 [ADGUARD] addon_adguard.sh 9403: *INFO:No usable USB device found.
2022-02-02 16:57:01 83908.74 [ADGUARD] addon_adguard.sh 9403: Device DEV=, Mounted as USB at=/, with label=
2022-02-02 16:57:01 83908.74 [ADGUARD] addon_adguard.sh 9403: Information: Check that time is synchronized
2022-02-02 16:57:01 83908.75 [ADGUARD] addon_adguard.sh 9403: Information: NTP time service is working. (N)
2022-02-02 16:57:01 83908.76 [ADGUARD] addon_adguard.sh 9403: Information: Time is OK
2022-02-02 16:57:01 83908.77 [ADGUARD] addon_adguard.sh 9403: INSTALL: Time is set.
2022-02-02 16:57:01 83908.78 [ADGUARD] addon_adguard.sh 9403: INSTALL: Download Release info.
2022-02-02 16:57:01 83908.91 [ADGUARD] addon_adguard.sh 9403: INSTALL: Release info found.
2022-02-02 16:57:01 83908.93 [ADGUARD] addon_adguard.sh 9403: INSTALL: Download Release archive:/tmp/AdGuardHome_linux_armv7.tar.gz
2022-02-02 16:57:01 83908.94 [ADGUARD] addon_adguard.sh 9403: ERROR: Release tar-file not found: exit


EDIT: It's working now after I checked "Use BETA version"

My box and current FW are:
R9000
Voxel V1.0.4.57.1HF
Kamoj Add-on V5.5b17

 

[kamoj]

After I installed the last version ADguard is not working anymore. What Am I missing? Logs:

[2022-02-02 16:56:54] [ADGUARD] Log erased by operator trigged addon
2022-02-02 16:57:01 83908.71 [ADGUARD] addon_adguard.sh 9403: Install called
2022-02-02 16:57:01 83908.73 [ADGUARD] addon_adguard.sh 9403: *INFO:No usable USB device found.
2022-02-02 16:57:01 83908.74 [ADGUARD] addon_adguard.sh 9403: Device DEV=, Mounted as USB at=/, with label=
2022-02-02 16:57:01 83908.74 [ADGUARD] addon_adguard.sh 9403: Information: Check that time is synchronized
2022-02-02 16:57:01 83908.75 [ADGUARD] addon_adguard.sh 9403: Information: NTP time service is working. (N)
2022-02-02 16:57:01 83908.76 [ADGUARD] addon_adguard.sh 9403: Information: Time is OK
2022-02-02 16:57:01 83908.77 [ADGUARD] addon_adguard.sh 9403: INSTALL: Time is set.
2022-02-02 16:57:01 83908.78 [ADGUARD] addon_adguard.sh 9403: INSTALL: Download Release info.
2022-02-02 16:57:01 83908.91 [ADGUARD] addon_adguard.sh 9403: INSTALL: Release info found.
2022-02-02 16:57:01 83908.93 [ADGUARD] addon_adguard.sh 9403: INSTALL: Download Release archive:/tmp/AdGuardHome_linux_armv7.tar.gz
2022-02-02 16:57:01 83908.94 [ADGUARD] addon_adguard.sh 9403: ERROR: Release tar-file not found: exit


EDIT: It's working now after I checked "Use BETA version"

My box and current FW are:
R9000
Voxel V1.0.4.57.1HF
Kamoj Add-on V5.5b17

Good you supplied the log!
Maybe you internet connection was slow at that moment? (The AdGuard install file is quite big!)
If it happens again, you should try to increase the download timeouts in the Supervision form: DOWNLOAD SETTINGS.

 

[Heriberto Silva Alves]

Good you supplied the log!
Maybe you internet connection was slow at that moment? (The AdGuard install file is quite big!)
If it happens again, you should try to increase the download timeouts in the Supervision form: DOWNLOAD SETTINGS.

Hi Kamoj!

The internet connection was working fine. I ran Ookla Speed test and it was ok.

I'll try to increase download timeouts.

 

[Heriberto Silva Alves]

I doubled the downlaod timeouts and it`s not working. It's only woring using beta version. Is there any other log I can check and send here? I downgraded to version 5.5b15 and the problem was the same... This means that is not the version itself where the problem lies... Maybe the internet address where the adguard file is hosted?

 

[n1llam1]

I doubled the downlaod timeouts and it`s not working. It's only woring using beta version. Is there any other log I can check and send here? I downgraded to version 5.5b15 and the problem was the same... This means that is not the version itself where the problem lies... Maybe the internet address where the adguard file is hosted?

@Heriberto Silva Alves,
Your theory proves to be correct about where the release version of AdGuardHome_linux_armv7.tar.gz is being retrieved from.


@kamoj,

Through trial and error, I saw that the beta download works because it is retrieved using the URL starting with https://static.adguard.com/adguardhome/beta

I was able to get the release download to work by updating the addon_adguard.sh script to use the combination of DL_URL2="https://static.adguard.com/adguardhome/release" and AGH_tar="AdGuardHome_linux_armv7.tar.gz"
After that update I was able to use the "Download Latest Version" button to download the current release v0.107.3

It does not work if the script attempts to download from https://github.com/AdguardTeam/AdGuardHome/releases/download/v0.107.3/AdGuardHome_linux_armv7.tar.gz because the response is not the actual download file itself, as shown below:

root@R7800:/usr/bin$ curl --insecure --connect-timeout 5 --max-time 30 -o /tmp/AdGuardHome_linux_armv7.tar.gz https://github.com/AdguardTeam/AdGuardHome/releases/download/v0.107.3/AdGuardHome_linux_armv7.tar.gz
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   667  100   667    0     0   5728      0 --:--:-- --:--:-- --:--:--  6063

root@R7800:/usr/bin$ cat /tmp/AdGuardHome_linux_armv7.tar.gz
<html><body>You are being <a href="https://objects.githubusercontent.com/github-production-release-asset-2e65be/62712899/18748da5-ed3b-4af1-8eed-61d47b948949?X-Amz-Algorithm=AWS4-HMAC-SHA256&amp;X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20220204%2Fus-east-1%2Fs3%2Faws4_request&amp;X-Amz-Date=20220204T050424Z&amp;X-Amz-Expires=300&amp;X-Amz-Signature=88b779f0df361b079c8481edba430b7cb13bf8c7f34b9e9a24359bc02a899656&amp;X-Amz-SignedHeaders=host&amp;actor_id=0&amp;key_id=0&amp;repo_id=62712899&amp;response-content-disposition=attachment%3B%20filename%3DAdGuardHome_linux_armv7.tar.gz&amp;response-content-type=application%2Foctet-stream">redirected</a>.</body></html>root@R7800:/usr/bin$

 

[kamoj]

@Heriberto Silva Alves,
Your theory proves to be correct about where the release version of AdGuardHome_linux_armv7.tar.gz is being retrieved from.


@kamoj,

Through trial and error, I saw that the beta download works because it is retrieved using the URL starting with https://static.adguard.com/adguardhome/beta

I was able to get the release download to work by updating the addon_adguard.sh script to use the combination of DL_URL2="https://static.adguard.com/adguardhome/release" and AGH_tar="AdGuardHome_linux_armv7.tar.gz"
After that update I was able to use the "Download Latest Version" button to download the current release v0.107.3

It does not work if the script attempts to download from https://github.com/AdguardTeam/AdGuardHome/releases/download/v0.107.3/AdGuardHome_linux_armv7.tar.gz because the response is not the actual download file itself, as shown below:

root@R7800:/usr/bin$ curl --insecure --connect-timeout 5 --max-time 30 -o /tmp/AdGuardHome_linux_armv7.tar.gz https://github.com/AdguardTeam/AdGuardHome/releases/download/v0.107.3/AdGuardHome_linux_armv7.tar.gz
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   667  100   667    0     0   5728      0 --:--:-- --:--:-- --:--:--  6063

root@R7800:/usr/bin$ cat /tmp/AdGuardHome_linux_armv7.tar.gz
<html><body>You are being <a href="https://objects.githubusercontent.com/github-production-release-asset-2e65be/62712899/18748da5-ed3b-4af1-8eed-61d47b948949?X-Amz-Algorithm=AWS4-HMAC-SHA256&amp;X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20220204%2Fus-east-1%2Fs3%2Faws4_request&amp;X-Amz-Date=20220204T050424Z&amp;X-Amz-Expires=300&amp;X-Amz-Signature=88b779f0df361b079c8481edba430b7cb13bf8c7f34b9e9a24359bc02a899656&amp;X-Amz-SignedHeaders=host&amp;actor_id=0&amp;key_id=0&amp;repo_id=62712899&amp;response-content-disposition=attachment%3B%20filename%3DAdGuardHome_linux_armv7.tar.gz&amp;response-content-type=application%2Foctet-stream">redirected</a>.</body></html>root@R7800:/usr/bin$

AdGuard changes their URL now and then of no apparent reason.
It's happened a couple of times before.

 

[primitivo]

Is anyone else having issues with random R9000 reboots? I run V1.0.4.57 + Kamoj 5.5b17 (running Wireguard) + Adguard Home v0.108.0-b.2.

I don't know which logs should I provide as they don't seem to survive router reboot, they all seem to log from boot up time. I have a fairly default setup everywhere, except that on Adguard Home I have "optimistic caching" enabled. I believe the issue with random reboots must be due to Adguard Home because once the router is up from reboot, DNS queries counter is basically reset to 0.

 

[kamoj]

Is anyone else having issues with random R9000 reboots? I run V1.0.4.57 + Kamoj 5.5b17 (running Wireguard) + Adguard Home v0.108.0-b.2.

I don't know which logs should I provide as they don't seem to survive router reboot, they all seem to log from boot up time. I have a fairly default setup everywhere, except that on Adguard Home I have "optimistic caching" enabled. I believe the issue with random reboots must be due to Adguard Home because once the router is up from reboot, DNS queries counter is basically reset to 0.

I suggest you run without AdGuard and see if that helps.

(You can also save system logs to USB with the setting in Settings:
Save the system logs to USB. (or /opt/kamoj/logs if no USB detected
Logs can also be saved eg by logging in with ssh and save the output from e.g.: tail -f )

 

[n1llam1]

@primitivo, is your R9000 configured with swap space? I've found that the memory usage on my R7800 with AdGuard can sometimes exceed the amount available from just physical RAM. Since my R7800 has swap space enabled, it can accommodate those brief times when memory usage is exceedingly high. If swap space had not been available at those times, the OS would probably panic and reboot the router. Voxel's readme document has info on how swap space can be enabled. I hope that helps with your usage of AdGuard on your R9000.

 

[primitivo]

@primitivo, is your R9000 configured with swap space? I've found that the memory usage on my R7800 with AdGuard can sometimes exceed the amount available from just physical RAM. Since my R7800 has swap space enabled, it can accommodate those brief times when memory usage is exceedingly high. If swap space had not been available at those times, the OS would probably panic and reboot the router. Voxel's readme document has info on how swap space can be enabled. I hope that helps with your usage of AdGuard on your R9000.

Thanks. I have enabled it I hope (?), because after inserting the following command for R9000:
dd if=/dev/zero of=swap bs=1024 count= 2097152
there was kind of no response , had to press ctrl+c and followed with:
mkswap swap
chmod 0600 swap
swapon swap

 

[primitivo]

I suggest you run without AdGuard and see if that helps.

Is it normal that AdGuard DNS stats / queries are reset every time you reboot the router?

 

[n1llam1]

Thanks. I have enabled it I hope (?), because after inserting the following command for R9000:
dd if=/dev/zero of=swap bs=1024 count= 2097152
there was kind of no response , had to press ctrl+c and followed with:
mkswap swap
chmod 0600 swap
swapon swap

It does not sound right that you would have to press ctrl+c to interrupt the dd command. It does take some time to create the swap file, depending on the speed of your USB device. Double check to see if the file of the expected size exists:

root@R7800:~$ ls -l /mnt/sda1/swap
-rw-------    1 root     root    1073741824 Mar  3  2021 /mnt/sda1/swap

For example, my R7800 swap file is 1 GB in size (1 x 1024 x 1024 x 1024 = 1073741824 bytes). Your R9000 swap file should be at 2GB in size based upon the command-line that you used (2 x 1024 x 1024 x 1024 = 2147483648 bytes)

After swap is enabled, you can see it listed similarly to the following:

root@R7800:~$ free
              total         used         free       shared      buffers
  Mem:       483524       376372       107152            0        11792
Swap:      1048572         3420      1045152
Total:      1532096       379792      1152304

The example above shows my R7800 is using around 3MB of swap space.

 

[n1llam1]

Is it normal that AdGuard DNS stats / queries are reset every time you reboot the router?

Yes, my experience has been that the stats / queries are reset if AdGuard is restarted (including router reboot).

 

[primitivo]

It does not sound right that you would have to press ctrl+c to interrupt the dd command. It does take some time to create the swap file, depending on the speed of your USB device. Double check to see if the file of the expected size exists:

You are right. It took 3mins to create it. It shows 2GB swap file now. I have USB 2.0 64GB and i wonder if USB 2.0 won't cause too much slowness if swap file is used? Again I never had such problems with R9000 rebooting so will observe it further.

Yes, my experience has been that the stats / queries are reset if AdGuard is restarted (including router reboot).

Is there any way to preserve the stats / cache of AGH, so that everything is there after reboot?

 

[n1llam1]

You are right. It took 3mins to create it. It shows 2GB swap file now. I have USB 2.0 64GB and i wonder if USB 2.0 won't cause too much slowness if swap file is used? Again I never had such problems with R9000 rebooting so will observe it further.


Is there any way to preserve the stats / cache of AGH, so that everything is there after reboot?

Glad to hear the 2GB swap file is created properly.

USB 3.0 speed can be up to 10x faster compared USB 2.0 speed. It would be good if you can upgrade to a USB 3.0 thumb drive. To make the move, you will need to disable swap on the USB 2.0 first, copy data to the new USB 3.0 drive, then re-create / re-enable swap.

I am not aware of any way to preserve the stats other than keeping the router up and running AGH nonstop. The max logs/stats retention is 90 days, but that can eat up a lot of memory. My R7800 is configured to keep only 1 day's worth of AGH logs and stats.

 

[primitivo]

Glad to hear the 2GB swap file is created properly.

USB 3.0 speed can be up to 10x faster compared USB 2.0 speed. It would be good if you can upgrade to a USB 3.0 thumb drive. To make the move, you will need to disable swap on the USB 2.0 first, copy data to the new USB 3.0 drive, then re-create / re-enable swap.

What would be the steps to disable and remove the swap created?

Also going forward wouldn't it be better to use swap dedicated 2GB partition on the USB 3.0 instead of file?

Also wouldn't it be better to use exFAT instead of fat32 system? I saw there is parted available, which I guess could do the job without having to use pc/mac?

 

[n1llam1]

What would be the steps to disable and remove the swap created?

Also going forward wouldn't it be better to use swap dedicated 2GB partition on the USB 3.0 instead of file?

Also wouldn't it be better to use exFAT instead of fat32 system? I saw there is parted available, which I guess could do the job without having to use pc/mac?

I followed this instruction from Voxel for disabling / removing the old swap file.

I use ext4 file system for the USB drive on my R7800 (refer to Voxel's readme step 1 under Setup of Entware section)

1. Prepare new USB stick or disk with ext2 or ext3 or ext4 filesystem from console. Label it “optware”. Ext4 is highly recommended for USB HDD. Example to create ext4 filesystem with label “optware” ...

I don't think that a separate swap partition would provide noticeably better performance. Using USB 3.0 and ext4 FS would go a long way for best performance (in hopefully brief instances of temporary use of swap space).

 

[R. Gerrits]

Is there any way to preserve the stats / cache of AGH, so that everything is there after reboot?

untested:
If you have an USB inserted in the router, you could edit /usr/bin/addon_adguard.sh and change the tmpdir path in this line so that it points to a folder on your USB stick:

tmpdir="/tmp/addons/adguard_home"; [ ! -d "$tmpdir" ] && \mkdir -p "$tmpdir"

 

[n1llam1]

untested:
If you have an USB inserted in the router, you could edit /usr/bin/addon_adguard.sh and change the tmpdir path in this line so that it points to a folder on your USB stick:

tmpdir="/tmp/addons/adguard_home"; [ ! -d "$tmpdir" ] && \mkdir -p "$tmpdir"

That seems very promising:

root@R7800:~$ ls -lrt /tmp/addons/adguard_home/data/
-rw-r--r--    1 root     root     71848601 Feb  8 00:48 querylog.json.1
drwxr-xr-x    2 root     root          160 Feb  8 11:53 filters
-rw-r--r--    1 root     root        32768 Feb  8 12:15 sessions.db
-rw-r--r--    1 root     root       262144 Feb  8 16:00 stats.db
-rw-r--r--    1 root     root     45541752 Feb  8 16:25 querylog.json

I gave this a try and found that the UI stops working the way it did previously.

1. The Kamoj Menu->Adguard Home link does not automatically go to http://<router_ip_address>:8080/login.html anymore.

2. After accessing into http://<router_ip_address>:8080/ and logging into AGH, the stats and graphs in the AGH dashboard remain empty or listed with zeroes.

I've reverted back to the previous setting of tmpdir and AGH is back to normal.