uiDivStats uiDivStats - WebUI for Diversion statistics

[JemTheWire]

Absolutely. No problem.

 

[Jack Yaz]

Absolutely. No problem.

Please run

/usr/sbin/curl --retry 3 "https://raw.githubusercontent.com/jackyaz/uiDivStats/a-aaaa-only/uiDivStats.sh" -o "/jffs/scripts/uiDivStats" && chmod 0755 /jffs/scripts/uiDivStats && /jffs/scripts/uiDivStats

And then use option uf to get the updated taildns. uiDivStats will now only write A or AAAA queries to the database

 

[EmeraldDeer]

I've just disabled GlassWire and rebooted my PC, no difference to anything. Having connected all my devices back, I am seeing the same spikes, and USB being thrashed.

I cannot reproduce CPU spiking on an RT-AX88U
10 network devices
GlassWire on one PC
Entware USB is Samsung T5

 

[JemTheWire]

Done, but has issues.
When I chose option 1 to update stats i get the following error:

Also the GUI tab looks empty. This is all that is displayed. no other display:

 

[Jack Yaz]

Done, but has issues.
When I chose option 1 to update stats i get the following error:

View attachment 23990

Also the GUI tab looks empty. This is all that is displayed. no other display:

View attachment 23991

Scratch that, I made a mistake - bare with!

 

[JemTheWire]

OK. I have uninstalled it and removed the db.

I'm back to a clear playing field.

 

[Jack Yaz]

OK. I have uninstalled it and removed the db.

I'm back to a clear playing field.

Thanks for being patient!

/usr/sbin/curl --retry 3 "https://raw.githubusercontent.com/jackyaz/uiDivStats/a-aaaa-only/uiDivStats.sh" -o "/jffs/scripts/uiDivStats" && chmod 0755 /jffs/scripts/uiDivStats && /jffs/scripts/uiDivStats install

Once its installed, check the awk scripts are right this time:

cat /jffs/addons/uiDivStats.d/taildns.d/dnsmasqtotal.awk
cat /jffs/addons/uiDivStats.d/taildns.d/dnsmasqtotalextra.awk

 

[JemTheWire]

OK. Installed When i run the two awk commands all i get is:

and

 

[JemTheWire]

However, at the moment, NO CPU SPIKES!!!

I need to take a break now. I have got to prepare dinner.

 

[Jack Yaz]

OK. Installed When i run the two awk commands all i get is: View attachment 23992

and

View attachment 23992

Looks good! Now I need to consider if I make this a configurable option - currently working on another branch that will log all record types but cache it via tmpfs. This approach has implications on the query log feature amongst other considerations

 

[JemTheWire]

Spoke too soon. Just come back to my PC and core 3 & 4 are having a merry dance 0 > 100%

Not as often though.

I does appear to have improved things.

 

[dave14305]

Looks good! Now I need to consider if I make this a configurable option - currently working on another branch that will log all record types but cache it via tmpfs. This approach has implications on the query log feature amongst other considerations

If you limit the database to A and AAAA records, it's in line with the current Diversion stats logic. And you can get rid of the dnssec check in the awk scripts.

 

[Jack Yaz]

Spoke too soon. Just come back to my PC and core 3 & 4 are having a merry dance 0 > 100%

Not as often though.

I does appear to have improved things.

Does top still show that io is the culprit for CPU usage?

 

[Jack Yaz]

If you limit the database to A and AAAA records, it's in line with the current Diversion stats logic. And you can get rid of the dnssec check in the awk scripts.

I'm inclined to include "A/AAAA only mode" with separate awk files as a user-configurable option. In my somewhat quieter environment, it's nice seeing the other query types. I have no idea why @JemTheWire has so many PTR queries flying around

 

[JemTheWire]

Occasionally DSK hits 100%, but TBH it is much improved. Not back to the uiDivStats v1 stage, but much better than the original v2

I have no idea what PTR is.

I can follow instructions and follow commands, but my actual network knowledge is not very good.

On the whole, Jack, this version seems a good improvement.

 

[JemTheWire]

I have just read up on PTR.

Why would I have so many? Is it something an IoT device would do?

 

[Wishmaster1965]

@Jack Yaz ,trying to update using amtm seems to stick

Enter option j5
Downloading http://bin.entware.net/armv7sf-k2.6/Packages.gz
Updated list of available packages in /opt/var/opkg-lists/entware
Package grep (3.4-1) installed in root is up to date.
Package sqlite3-cli (3310100-1) installed in root is up to date.
Package procps-ng-pkill (3.3.15-4) installed in root is up to date.


Stuck for the last 24hrs

 

[dave14305]

I have just read up on PTR.

Why would I have so many? Is it something an IoT device would do?

Any time a machine wants to resolve an IP into a name it would perform a PTR query. Like a monitoring tool maybe wanting to show you things in a nice friendly format.

grep -E " query\[PTR]" /opt/var/log/dnsmasq.log | awk ' { print $NF } ' | sort | uniq -c | sort -rn | head -10

This will show you the top 10 machines issuing PTR queries since early this morning. If most are coming from one machine, check that machine.

 

[Sonyrolfy]

No Spikes here, although i had to reset the router yesterday after i installed the new WEBUI when the page was empty. The first few hours i had a lot PTR records flying arround. Now its calming down with around 10 PTR records a hour. Most of them belong to iot devices, probably due to different vpn clients and router as dns. what do i know. Anyway very nice to see the new page with lots of info i never seen before Tnx!

 

[Jack Yaz]

@Jack Yaz ,trying to update using amtm seems to stick

Enter option j5
Downloading http://bin.entware.net/armv7sf-k2.6/Packages.gz
Updated list of available packages in /opt/var/opkg-lists/entware
Package grep (3.4-1) installed in root is up to date.
Package sqlite3-cli (3310100-1) installed in root is up to date.
Package procps-ng-pkill (3.3.15-4) installed in root is up to date.


Stuck for the last 24hrs

Ctrl-C out then

uiDivStats uninstall
rm /opt/share/uiDivStats.d/dnsqueries.db

then install from scratch.