Menu
What's new
By:
Filters Better Search

uiDivStats uiDivStats - WebUI for Diversion statistics

  • SNBForums Code of Conduct

    SNBForums is a community for everyone, no matter what their level of experience.

    Please be tolerant and patient of others, especially newcomers. We are all here to share and learn!

    The rules are simple: Be patient, be nice, be helpful or be gone!

pattiri said:
Code: 
Choose an option:    2

awk: cmd. line:1: Division by zero
awk: cmd. line:1: Division by zero
awk: cmd. line:1: Division by zero
uiDivStats: Stats updated successfully

Press enter to continue...

I've just disabled extra query logging for dnsmasq and here is my current dnsmasq settings if it helps;


Code: 
Dnsmasq settings:

 See the Dnsmasq man page what these options do:
 http://www.thekelleys.org.uk/dnsmasq/docs/dnsmasq-man.html

 1. Disable Dnsmasq settings
 2. log-async         20
 3. cache-size        2500
 4. bogus-priv        on
 5. domain-needed     on
 6. log-queries=extra
Click to expand...
taildns seemed to be using the correct awk script for you. What do you get if you run:
Code: 
sqlite3 /opt/share/uiDivStats.d/dnsqueries.db
.tables
select * from dnsqueries;
 
Dan Ljungberg said:
Code: 
dana@RT-AC2900-72D8:/tmp/home/root# cat /etc/dnsmasq.conf | grep log
log-async
log-queries=extra
log-facility=/opt/var/log/dnsmasq.log
dana@RT-AC2900-72D8:/tmp/home/root#
thanks!
Click to expand...
Can you try restarting taildns?
Code: 
/opt/etc/init.d/S90taildns stop
sleep 5
/opt/etc/init.d/S90taildns start
ps | grep taildns
 
Jack Yaz said:
Code:
sqlite /opt/share/uiDivStats.d/dnsqueries.db
.tables
select * from dnsqueries;
Click to expand...

I guess I run them in wrong place? :D

Code: 
admin@FaTiii:/tmp/home/root# sqlite /opt/share/uiDivStats.d/dnsqueries.db
-sh: sqlite: not found
admin@FaTiii:/tmp/home/root# sqlite /opt/share/uiDivStats.d/dnsqueries.db
-sh: sqlite: not found
admin@FaTiii:/tmp/home/root# .tables
-sh: .tables: not found
admin@FaTiii:/tmp/home/root# select * from dnsqueries;
-sh: select: not found
admin@FaTiii:/tmp/home/root#
 
pattiri said:
I guess I run them in wrong place? :D

Code: 
admin@FaTiii:/tmp/home/root# sqlite /opt/share/uiDivStats.d/dnsqueries.db
-sh: sqlite: not found
admin@FaTiii:/tmp/home/root# sqlite /opt/share/uiDivStats.d/dnsqueries.db
-sh: sqlite: not found
admin@FaTiii:/tmp/home/root# .tables
-sh: .tables: not found
admin@FaTiii:/tmp/home/root# select * from dnsqueries;
-sh: select: not found
admin@FaTiii:/tmp/home/root#
Click to expand...
sorry, it should be sqlite3
 
Jack Yaz said:
sorry, it should be sqlite3
Click to expand...

No problem :)

Code: 
admin@FaTiii:/tmp/home/root# sqlite3 /opt/share/uiDivStats.d/dnsqueries.db
SQLite version 3.31.1 2020-01-27 19:55:54
Enter ".help" for usage hints.
sqlite> .tables
dnsqueries         dnsqueriesmonthly  dnsqueriesweekly
sqlite> select * from dnsqueries;
sqlite>
 
Jack Yaz said:
OK so it looks like you have extra query logging for dnsmasq enabled, but taildns is using the standard awk script. Can you send the output of:
Code: 
cat /etc/dnsmasq.conf | grep log
please?
Click to expand...

Code: 
dana@RT-AC2900-72D8:/tmp/home/root# cat /etc/dnsmasq.conf | grep log
log-async
log-queries=extra
log-facility=/opt/var/log/dnsmasq.log
dana@RT-AC2900-72D8:/tmp/home/root#
than
Jack Yaz said:
Can you try restarting taildns?
Code: 
/opt/etc/init.d/S90taildns stop
sleep 5
/opt/etc/init.d/S90taildns start
ps | grep taildns
Click to expand...

Code: 
dana@RT-AC2900-72D8:/tmp/home/root# /opt/etc/init.d/S90taildns stop
 Checking taildns...              alive.
 Shutting down taildns...              done.
dana@RT-AC2900-72D8:/tmp/home/root# sleep 5
dana@RT-AC2900-72D8:/tmp/home/root# /opt/etc/init.d/S90taildns start
 Starting taildns...              done.
dana@RT-AC2900-72D8:/tmp/home/root# ps | grep taildns
21966 dana      3368 S    {taildns} /bin/sh /opt/bin/taildns
21969 dana      3368 S    {taildnstotal} /bin/sh /jffs/addons/uiDivStats.d/taildns.d/taildnstotal
21974 dana      3368 S    {dnsmasqtotalext} /usr/bin/awk -f /jffs/addons/uiDivStats.d/taildns.d/dnsmasqtotalextra.awk
21975 dana      3368 S    {taildnstotal} /bin/sh /jffs/addons/uiDivStats.d/taildns.d/taildnstotal
22029 dana      5432 S    grep taildns
dana@RT-AC2900-72D8:/tmp/home/root#
 
pattiri said:
No problem :)

Code: 
admin@FaTiii:/tmp/home/root# sqlite3 /opt/share/uiDivStats.d/dnsqueries.db
SQLite version 3.31.1 2020-01-27 19:55:54
Enter ".help" for usage hints.
sqlite> .tables
dnsqueries         dnsqueriesmonthly  dnsqueriesweekly
sqlite> select * from dnsqueries;
sqlite>
Click to expand...
Well that confirms the data isn't making it into the database for some reason. Please try restarting taildns (using the steps I posted earlier) and then run:
Code: 
tail -F /opt/var/log/dnsmasq.log /opt/var/log/dnsmasq.log3 | /jffs/addons/uiDivStats.d/taildns.d/dnsmasqtotal.awk
assuming you still have extra query logging turned off
 
Dan Ljungberg said:
Code: 
dana@RT-AC2900-72D8:/tmp/home/root# cat /etc/dnsmasq.conf | grep log
log-async
log-queries=extra
log-facility=/opt/var/log/dnsmasq.log
dana@RT-AC2900-72D8:/tmp/home/root#
than


Code: 
dana@RT-AC2900-72D8:/tmp/home/root# /opt/etc/init.d/S90taildns stop
 Checking taildns...              alive.
 Shutting down taildns...              done.
dana@RT-AC2900-72D8:/tmp/home/root# sleep 5
dana@RT-AC2900-72D8:/tmp/home/root# /opt/etc/init.d/S90taildns start
 Starting taildns...              done.
dana@RT-AC2900-72D8:/tmp/home/root# ps | grep taildns
21966 dana      3368 S    {taildns} /bin/sh /opt/bin/taildns
21969 dana      3368 S    {taildnstotal} /bin/sh /jffs/addons/uiDivStats.d/taildns.d/taildnstotal
21974 dana      3368 S    {dnsmasqtotalext} /usr/bin/awk -f /jffs/addons/uiDivStats.d/taildns.d/dnsmasqtotalextra.awk
21975 dana      3368 S    {taildnstotal} /bin/sh /jffs/addons/uiDivStats.d/taildns.d/taildnstotal
22029 dana      5432 S    grep taildns
dana@RT-AC2900-72D8:/tmp/home/root#
Click to expand...
OK so taildns is using the right awk script now. Hopefully you'll see your database file growing/modified:
Code: 
ls -lah /opt/share/uiDivStats.d/dnsqueries.db
 
Jack Yaz said:
Well that confirms the data isn't making it into the database for some reason. Please try restarting taildns (using the steps I posted earlier) and then run:
Code: 
tail -F /opt/var/log/dnsmasq.log /opt/var/log/dnsmasq.log3 | /jffs/addons/uiDivStats.d/taildns.d/dnsmasqtotal.awk
assuming you still have extra query logging turned off
Click to expand...

here;

Code: 
admin@FaTiii:/tmp/home/root# /opt/etc/init.d/S90taildns stop
 Checking taildns...              alive.
 Shutting down taildns...              done.
admin@FaTiii:/tmp/home/root# sleep 5
admin@FaTiii:/tmp/home/root# /opt/etc/init.d/S90taildns start
 Starting taildns...              done.
admin@FaTiii:/tmp/home/root# ps | grep taildns
28269 admin     1420 S    {taildns} /bin/sh /opt/bin/taildns
28272 admin     1420 S    {taildnstotal} /bin/sh /jffs/addons/uiDivStats.d/taildns.d/taildnstotal
28278 admin     1444 S    {dnsmasqtotal.aw} /usr/bin/awk -f /jffs/addons/uiDivStats.d/taildns.d/dnsmasqtotal.awk
28279 admin     1424 S    {taildnstotal} /bin/sh /jffs/addons/uiDivStats.d/taildns.d/taildnstotal
28335 admin     4656 S    grep taildns
admin@FaTiii:/tmp/home/root# tail -F /opt/var/log/dnsmasq.log /opt/var/log/dnsmasq.log3 | /jffs/addons/uiDivStats.d/taildns.d/dnsmasqtotal.awk
tail: can't open '/opt/var/log/dnsmasq.log3': No such file or directory
1591453572,172.24.5.2,spclient.wg.spotify.com,A,allowed
1591453618,172.24.5.8,chat.cdn.whatsapp.net,A,allowed
1591453648,172.24.5.15,mapi.speedtest.net,A,allowed
1591453648,127.0.1.1,speedtest.net,dnssec-DS,allowed
1591453649,172.24.5.2,mix.com,A,allowed
1591453649,172.24.5.2,mix.com,A,allowed
1591453649,127.0.1.1,mix.com,dnssec-DS,allowed
1591453649,172.24.5.2,mix.com,A,allowed
1591453649,172.24.5.2,mix.com,AAAA,allowed
1591453649,172.24.5.2,us.hola.com,A,allowed
1591453650,127.0.1.1,hola.com,dnssec-DS,allowed
1591453650,172.24.5.2,e13750.a.akamaiedge.net,A,allowed
1591453650,172.24.5.2,e13750.a.akamaiedge.net,AAAA,allowed
1591453650,172.24.5.2,tagger.opecloud.com,A,blocked (blocking list)
1591453650,172.24.5.2,amplifypixel.outbrain.com,A,blocked (blocking list)
1591453650,172.24.5.2,tagger.opecloud.com,A,blocked (blocking list)

I can see new logs as I browse internet. so I've chosen option 2 and here we have the happy result :) Thank you very much :)

Screenshot_1.jpg
 
uninstalled existing version, and then installed new version.
install stuck at "Creating database table indexes..."
 
Jack Yaz said:
OK so taildns is using the right awk script now. Hopefully you'll see your database file growing/modified:
Code: 
ls -lah /opt/share/uiDivStats.d/dnsqueries.db
Click to expand...
Jack Yaz said:
OK so taildns is using the right awk script now. Hopefully you'll see your database file growing/modified:
Code: 
ls -lah /opt/share/uiDivStats.d/dnsqueries.db
Click to expand...

Still no growing database file and no stats :confused:
Is it easier if I uninstall and reinstall, or are you interested in troubleshooting more?
 
fresh new install:

cromo@RT-AX88U-8158:/tmp/home/root# /usr/sbin/curl --retry 3 "https://raw.githubusercontent.com/jackyaz/uiDivStats/maste
r/uiDivStats.sh" -o "/jffs/scripts/uiDivStats" && chmod 0755 /jffs/scripts/uiDivStats && /jffs/scripts/uiDivStats instal
l
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 43273 100 43273 0 0 355k 0 --:--:-- --:--:-- --:--:-- 449k
uiDivStats: Welcome to uiDivStats v2.0.0, a script by JackYaz

uiDivStats: Checking your router meets the requirements for uiDivStats

Downloading http://bin.entware.net/aarch64-k3.10/Packages.gz
Updated list of available packages in /opt/var/opkg-lists/entware
Package grep (3.4-1) installed in root is up to date.
Package sqlite3-cli (3310100-1) installed in root is up to date.
Package procps-ng-pkill (3.3.15-4) installed in root is up to date.
uiDivStats: New version of uidivstats_www.asp downloaded

uiDivStats: Mounting uiDivStats WebUI page as user3.asp

uiDivStats: New version of taildns.tar.gz downloaded

Downloading http://bin.entware.net/aarch64-k3.10/Packages.gz
Updated list of available packages in /opt/var/opkg-lists/entware
Package grep (3.4-1) installed in root is up to date.
Package sqlite3-cli (3310100-1) installed in root is up to date.
Package procps-ng-pkill (3.3.15-4) installed in root is up to date.
uiDivStats: Creating database table and enabling write-ahead logging...

uiDivStats: Creating database table indexes...

Error: near line 1: index idx_dns_domains already exists
Error: near line 1: index idx_dns_time already exists
Error: near line 1: index idx_dns_clients already exists
uiDivStats: Database ready, starting services...

uiDivStats: Starting first run of stat generation...

uiDivStats: Stats updated successfully



After this, the UI page is missing. even after a reboot
 
Last edited:
Dan Ljungberg said:
did an


Thanks for quick and good response with my troubleshooting.
I tested and uninstalled and deleted db from CLI, restarted the router and then reinstalled from CLI.
But still no stats :mad:

I'm also stumped :confused:
Click to expand...
at this stage, would you be up for a screensharing session using Teamviewer or VNC or something?
 
RT-AX88U on RT-AX88U_384.18_alpha1-g6368a955e8 firmware.

I had the previous uiDivStats version running before but uninstalled it for other troubleshooting issues (and waited for v2.00 to become available before I re-installed it again).

Just installed v2.00 with router currently 'up' 8 days and 9 hours. No issues, Tab shows in LAN, and everything running normally with no reboot needed (although I will probably do one in an hour or so, as per my 'normal' after any change in the GUI).

Thank you very much @Jack Yaz! Another solid release.
 
This is a great upgrade! A lot of complexity behind the scenes to make it look so cool. :cool:

Noticed this today that when dnssec is enabled there are extra lines in the log that probably want to be filtered out. I had dnssec disabled during beta testing. :oops:

upload_2020-6-6_12-13-43.jpeg


Code: 
Jun  6 12:08:13 dnsmasq[9727]: dnssec-query[DS] asuswrt-merlin.net to 9.9.9.11
Jun  6 12:08:13 dnsmasq[9727]: dnssec-query[DNSKEY] asuswrt-merlin.net to 9.9.9.11
 
You must log in or register to reply here.

Similar threads

314eter
uiDivStats uiDivStats development version compatible with Diversion 5.0
2 3 4
Replies
66
Views
10K
martinr
M
Jack Yaz
uiDivStats uiDivStats 3.x
2 3 4
Replies
64
Views
17K
SomeWhereOverTheRainBow
SomeWhereOverTheRainBow
Jack Yaz
YazFi YazFi v4.x - continued
6 7 8
Replies
147
Views
25K
fotingo
F
Jack Yaz
uiDivStats - WebUI for Diversion statistics
Replies
3
Views
3K
Jack Yaz
Jack Yaz
Viktor Jaep
BACKUPMON BACKUPMON v1.8.20 -Oct 12, 2024- Backup/Restore your Router: JFFS + NVRAM + External USB Drive! CIFS/SMB/NFS! (Now available in AMTM!)
23 24 25
Replies
487
Views
61K
ExtremeFiretop
ExtremeFiretop
Similar threads
Thread starter Title Forum Replies Date
thelonelycoder uiDivStats uiDivstats 4.0.3 - WebUI Stats for Diversion, November 19, 2024 Asuswrt-Merlin AddOns 40
C uiDivStats Web browsing completely impacted nightly apparently by uiDivStats record trimming? Asuswrt-Merlin AddOns 5
Ripshod uiDivStats Updated Asuswrt-Merlin AddOns 12
314eter uiDivStats uiDivStats development version compatible with Diversion 5.0 Asuswrt-Merlin AddOns 66
RMerlin Incoming webui changes in 3006 Asuswrt-Merlin AddOns 3
A Addon tabs not propagating correctly in WebUI of GT-BE98_Pro on F/W v3006.102.1 Asuswrt-Merlin AddOns 2
kernol Diversion AC Merlinware 386.14 introduces screen scrolling problem on MANY [but not all] webui add-ons! Asuswrt-Merlin AddOns 35
HUNited vnStat WebUI page not found vnStat & connmon Asuswrt-Merlin AddOns 3
Mogsy Skynet Skynet WebUI as scMerlin sitemap Asuswrt-Merlin AddOns 7
J Diversion [SOLVED] DNS Director with Diversion 5.0+? Asuswrt-Merlin AddOns 2

Similar threads

Latest threads

Support SNBForums w/ Amazon

If you'd like to support SNBForums, just use this link and buy anything on Amazon. Thanks!

Sign Up For SNBForums Daily Digest

Get an update of what's new every day delivered to your mailbox. Sign up here!

Members online

Total: 790 (members: 17, guests: 773)
Top