uiDivStats uiDivStats - WebUI for Diversion statistics

[Jack Yaz]

Shouldn't uiDivstats be pulled from the Available Scripts listing under ASUSWRT-Merlin Terminal Menu until the script is stabilized?

A few users are having teething issues, but I believe a greater number of users have updated without any problems whatsoever.

I spent close to 3 months of my free time developing 2.0.0, involving testers along the way. I'm glad to see my efforts appreciated.

 

[SomeWhereOverTheRainBow]

A few users are having teething issues, but I believe a greater number of users have updated without any problems whatsoever.

I spent close to 3 months of my free time developing 2.0.0, involving testers along the way. I'm glad to see my efforts appreciated.

I concur, I have been running it since beta with no problems.

 

[doczenith1]

Probably best to uninstall, delete the database and install fresh on 2.1.0

rm /opt/share/uiDivStats/dnsqueries.db

Got a path not found with the rm command. I enabled samba so I could navigate the flash drive (Linux noob) and found the dnsqueries.db in this folder:\\RT-AC86U-7650\Diversion\entware\share\uiDivStats.d

I deleted the folder which had the .db file and a csv folder. We'll give 2.1.0 a try.

 

[Jack Yaz]

Got a path not found with the rm command. I enabled samba so I could navigate the flash drive (Linux noob) and found the dnsqueries.db in this folder:\\RT-AC86U-7650\Diversion\entware\share\uiDivStats.d

I deleted the folder which had the .db file and a csv folder. We'll give 2.1.0 a try.

Yes, sorry, i messed up the path.

rm -f /opt/share/uiDivStats.d/dnsqueries.db

 

[no_name]

I’ve been using 2.10 version since you made it available without any problems. My CPU’s are pretty much behaving as normal

Many thanks for your time and effort creating this new version of uiDivStats [emoji846]


Sent from my iPad using Tapatalk

 

[Jack Yaz]

I concur, I have been running it since beta with no problems.

I’ve been using 2.10 version since you made it available without any problems. My CPU’s are pretty much behaving as normal

Many thanks for your time and effort creating this new version of uiDivStats [emoji846]


Sent from my iPad using Tapatalk

Thanks both. Which router do each of you use? I wonder if there's a common factor with those with issues, but I'm at a loss to what in the code could behave so differently

 

[no_name]

My router is the RT-AC86U using 384.17 firmware


Sent from my iPad using Tapatalk

 

[SomeWhereOverTheRainBow]

Thanks both. Which router do each of you use? I wonder if there's a common factor with those with issues, but I'm at a loss to what in the code could behave so differently

My main currently active use is on a RT-AX88U no issues yet. I am running it with RT-AC5300 for as well with no issues, this was the branch i originally updated from the old version on. Btw I have also tested with use with Dnscrypt-proxy and Unbound as well. Neither cause any functionality issues with using your stats script @Jack Yaz

 

[SomeWhereOverTheRainBow]

The only potential issues I could think might be occurring is with users who have not updated their scripts in a while. Note i have no substantial evidence to support this claim, but only offer it as a reference to examine when asking users for feed back. Make sure they are not restoring from old configurations before updating to the newest branch.

 

[Dan Ljungberg]

Thanks both. Which router do each of you use? I wonder if there's a common factor with those with issues, but I'm at a loss to what in the code could behave so differently

Version 2.10 working great here without any problems with 20+ active clients!

 

[SomeWhereOverTheRainBow]

Version 2.10 working great here without any problems with 20+ active clients!

I concur with 45-52 clients- I have no issues to report either.

 

[Jack Yaz]

My main currently active use is on a RT-AX88U no issues yet. I am running it with RT-AC5300 for as well with no issues, this was the branch i originally updated from the old version on. Btw I have also tested with use with Dnscrypt-proxy and Unbound as well. Neither cause any functionality issues with using your stats script @Jack Yaz

Version 2.10 working great here without any problems with 20+ active clients!

OK so I had thought "maybe non-HND routers struggle" but your 5300 is a point against that theory.

FWIW I just ran the below command from a Linux client with the cachetotmp branch, and saw no CPU and DSK spiking from uiDivStats. Unbound's stat generation kicked in at 59 and spun up the CPU, but it dropped down to near idle afterwards.

With the standard "master" branch, I did see DSK usage in atop max out at 100%, and CPU usage climbed to around 30%. I can see the value for busier networks with this caching, but I need to figure out how to adapt the query log feature (currently it pulls the last 5000 records from the database)

while true; do nslookup google.com. 10.14.16.1; done

This code creates an infinite loop to spam my router with DNS requests for google.com . I don't have any caching on the client or dnsmasq on the router itself.


I wonder if affected users are running other scripts that rely on a USB heavily, so when DSK activity shoots up, other processes start to stall

 

[grifo]

FWIW no issues here with uiDivStats v2.1.0 (same as with v2.0.0 updated from the previous version) on an RT-AC87U running 384.13_8 and an old (bought in 2012) Kingston DT 100 G2 16GB USB2 stick formatted as ext2 with a 2GB swap file and several other scripts and entware programs on it.

 

[Jack Yaz]

That's a point. What filesystem and number of partitions do people have on their USB drive?

admin@RT-AC86U:/tmp/home/root# df -Th | grep mnt | grep dev
/dev/sda3            ext4            6.3G      2.7G      3.2G  46% /tmp/mnt/entware
/dev/sda1            tfat            7.9G      1.3M      7.9G   0% /tmp/mnt/data

 

[Dan Ljungberg]

Here is mine (SanDisk Ultra USB 3.0 on USB 2 port

/dev/sda1            ext4           28.1G      2.1G     24.5G   8% /tmp/mnt/Asus

 

[SomeWhereOverTheRainBow]

That's a point. What filesystem and number of partitions do people have on their USB drive?

admin@RT-AC86U:/tmp/home/root# df -Th | grep mnt | grep dev
/dev/sda3            ext4            6.3G      2.7G      3.2G  46% /tmp/mnt/entware
/dev/sda1            tfat            7.9G      1.3M      7.9G   0% /tmp/mnt/data

all mine are on ext4 ssd.

 

[SomeWhereOverTheRainBow]

Since we are considering all the demographics, we should examine diversion demographics i.e. block file size or number of domains blocked. I am using the highest diversion list with no issues.

 

[SomeWhereOverTheRainBow]

here is an example of memory usage.

dev/sda1                46.8G      2.2G     42.2G   5%

 

[pattiri]

I'm not sure exactly why but uiDivStats increases the CPU usage dramatically during high usage of dnsmasq, which means during heavy web surfing between multiple web pages but I guess this is expected but I'm not sure this is caused by uiDivstats directly.

This is with uiDivStats;

This is without;

maybe this is because of USB Stick write processes of uiDivStats I'm not sure but this is what I see.

On the other side; I can't feel any problems like web pages stuck or any other slowness.

 

[no_name]

That's a point. What filesystem and number of partitions do people have on their USB drive?

admin@RT-AC86U:/tmp/home/root# df -Th | grep mnt | grep dev
/dev/sda3            ext4            6.3G      2.7G      3.2G  46% /tmp/mnt/entware
/dev/sda1            tfat            7.9G      1.3M      7.9G   0% /tmp/mnt/data

I use 1 partition, ext4 on a SanDisk 2.0


Sent from my iPad using Tapatalk