uiDivStats uiDivStats 3.x

[JT Strickland]

I wonder if I need to generate weekly stats manually.
And, fwiw, I got this warning message from diversion when sending test email:

*** WARNING : deprecated key derivation used.
Using -iter or -pbkdf2 would be better.
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 700 0 0 100 700 0 401 0:00:01 0:00:01 --:--:-- 411

 

[JT Strickland]

sorry, click the Console tab

oops, my bad., full of these:

 

[Jack Yaz]

oops, my bad., full of these:
View attachment 34786

great, thanks. in ssh (not in any script menu, just plain ssh) please run:

/opt/bin/find /opt/share/diversion/stats -name "Diversion_Stats*" -printf "%C@ %p\n"| sort

 

[JT Strickland]

great, thanks. in ssh (not in any script menu, just plain ssh) please run:

/opt/bin/find /opt/share/diversion/stats -name "Diversion_Stats*" -printf "%C@ %p\n"| sort

Done. It didn't return anything.

 

[Jack Yaz]

Done. It didn't return anything.

ok, then that sounds like diversion isn't saving the file. try

ls -al /opt/share/diversion/stats

 

[JT Strickland]

ok, then that sounds like diversion isn't saving the file. try

ls -al /opt/share/diversion/stats

returned: (may not be appropriate for code, but it looks better)

ASUSWRT-Merlin RT-AX86U 386.2_6 Sun Jun  6 16:34:16 UTC 2021
Surveyor@RT-AX86U-D598:/tmp/home/root# ls -al /opt/share/diversion/stats
drwxrwxrwx    2 Surveyor root          4096 Jun 30 01:30 .
drwxrwxrwx   10 Surveyor root          4096 Jun  9 00:42 ..
Surveyor@RT-AX86U-D598:/tmp/home/root#

 

[Jack Yaz]

returned: (may not be appropriate for code, but it looks better)

ASUSWRT-Merlin RT-AX86U 386.2_6 Sun Jun  6 16:34:16 UTC 2021
Surveyor@RT-AX86U-D598:/tmp/home/root# ls -al /opt/share/diversion/stats
drwxrwxrwx    2 Surveyor root          4096 Jun 30 01:30 .
drwxrwxrwx   10 Surveyor root          4096 Jun  9 00:42 ..
Surveyor@RT-AX86U-D598:/tmp/home/root#

ok, so it looks like you probably have Diversion set to email only. Open diversion, do options c, 2, 1, 2 and pick option 3 or 5
then push diversion to compile a new report c, 2, 2

 

[JT Strickland]

BTW, coffee is on me. That's not an attempt to repay you, because I could never do that, but I want to buy a round anyway.

 

[JT Strickland]

ok, so it looks like you probably have Diversion set to email only. Open diversion, do options c, 2, 1, 2 and pick option 3 or 5
then push diversion to compile a new report c, 2, 2

Man, I can't believe I did something that rookie. I thought because I had it enabled that was good, but it had to be set to save also. It was emailing in the body, but not saving it.
Thanks again. I feel like a new rookie now instead of an old one.

 

[Jack Yaz]

Man, I can't believe I did something that rookie. I thought because I had it enabled that was good, but it had to be set to save also. It was emailing in the body, but not saving it.
Thanks again. I feel like a new rookie now instead of an old one.

BTW, coffee is on me. That's not an attempt to repay you, because I could never do that, but I want to buy a round anyway.

no problem at all, and thanks!

 

[Jack Yaz]

v3.0.1 is now available
Changelog:

• CHANGED: service-event hook is more selective when it calls uiDivStats

 

[Jack Yaz]

Bugger! I always get them mixed up!

I'll move it over there ... sorry @Jack Yaz

Haha no worries, I was just checking i wasn't going mad

 

[Stephen Harrington]

Haha no worries, I was just checking i wasn't going mad

@Jack Yaz Now moved to correct topic ...

 

[davidwford]

Hey Jack, don’t know if this has been asked before? As a possible future enhancement would it be possible to display the client name rather than IP address in the GUI query log? Maybe toggle between the two? When looking at blocked domains, i find i have to keep going to the client list on the network map to lookup which client it is to help understand where all the blocks are coming from.

 

[RKSX]

I can't seem to get any data to show in graphs. I see the Diversions Statistics Data report is populated, however the graph does not load any data.

I pressed f12 and opened console and am getting spammed with a 404 error. See attached.

on RT-N66U with latest fork from John

Edit: line: 44 in my user2.asp is sending the 404 error.

edit2: I should also mention that the SQLData.js exists where it says it should.

 

[Jack Yaz]

v3.0.2 is now available
Changelog:

• FIXED: Wildcard blocking was not reported correctly

 

[Jack Yaz]

I can't seem to get any data to show in graphs. I see the Diversions Statistics Data report is populated, however the graph does not load any data.

I pressed f12 and opened console and am getting spammed with a 404 error. See attached.

on RT-N66U with latest fork from John

Edit: line: 44 in my user2.asp is sending the 404 error.

edit2: I should also mention that the SQLData.js exists where it says it should.

This should be fixed in the latest Fork firmware

 

[RKSX]

Darn. Still no graph. The Diversion Statistics Report did populate.

Seeing the following in console:

Uncaught ReferenceError: SetuiDivStatsTitle is not defined
    at Object.success (user2.asp:44)
    at c (jquery.js:2)
    at Object.fireWith [as resolveWith] (jquery.js:2)
    at l (jquery.js:2)
    at XMLHttpRequest.<anonymous> (jquery.js:2)
success @ user2.asp:44
c @ jquery.js:2
fireWith @ jquery.js:2
l @ jquery.js:2
(anonymous) @ jquery.js:2
load (async)
send @ jquery.js:2
ajax @ jquery.js:2
get_sqldata_file @ user2.asp:44
initial @ user2.asp:44
onload @ user2.asp:47

 

[ZebMcKayhan]

For the last couple of months I have not been able to see any graphs in the uiDivStats tab. Im running RT-AC86U with 386.4 (but it was the same under 386.3 at least). it did function properly earlier.

I get empty graphs, but the query log looks ok, so does the diversion statistics.

have tried to wipe all stats, but that didnt change anything.

uninstall and install of UiDivStats does not make any difference either.

tried to manually generate the stats and it completes without issues or error messages.

checking /share/uiDivStats.d/csv and it looks updated and the files seem to contain relevant info:

admin@RT-AC86U-D7D8:/tmp/mnt/UsbDrv/entware/share/uiDivStats.d/csv# ls -al
drwxrwxrwx    2 admin    root          4096 Jan 26 12:49 .
drwxrwxrwx    3 admin    root          4096 Jan 26 12:49 ..
-rw-rw-rw-    1 admin    root           770 Jan 26 12:00 Blockeddaily.htm
-rw-rw-rw-    1 admin    root          4524 Jan 26 12:00 Blockeddailyclients.htm
-rw-rw-rw-    1 admin    root          2182 Jan 26 12:00 Blockeddailytime.htm
-rw-rw-rw-    1 admin    root           748 Jan 26 00:01 Blockedmonthly.htm
-rw-rw-rw-    1 admin    root          8258 Jan 26 00:01 Blockedmonthlyclients.htm
-rw-rw-rw-    1 admin    root           838 Jan 26 00:01 Blockedmonthlytime.htm
-rw-rw-rw-    1 admin    root           748 Jan 26 00:01 Blockedweekly.htm
-rw-rw-rw-    1 admin    root          8258 Jan 26 00:01 Blockedweeklyclients.htm
-rw-rw-rw-    1 admin    root          2379 Jan 26 00:01 Blockedweeklytime.htm
-rw-rw-rw-    1 admin    root        465757 Jan 26 12:49 SQLQueryLog.htm
-rw-rw-rw-    1 admin    root          4264 Jan 26 12:00 TotalBlockeddailytime.htm
-rw-rw-rw-    1 admin    root          1650 Jan 26 00:01 TotalBlockedmonthlytime.htm
-rw-rw-rw-    1 admin    root          4650 Jan 26 00:01 TotalBlockedweeklytime.htm
-rw-rw-rw-    1 admin    root           814 Jan 26 12:00 Totaldaily.htm
-rw-rw-rw-    1 admin    root         13123 Jan 26 12:00 Totaldailyclients.htm
-rw-rw-rw-    1 admin    root          2056 Jan 26 12:00 Totaldailytime.htm
-rw-rw-rw-    1 admin    root           699 Jan 26 00:01 Totalmonthly.htm
-rw-rw-rw-    1 admin    root         34789 Jan 26 00:01 Totalmonthlyclients.htm
-rw-rw-rw-    1 admin    root           786 Jan 26 00:01 Totalmonthlytime.htm
-rw-rw-rw-    1 admin    root           699 Jan 26 00:01 Totalweekly.htm
-rw-rw-rw-    1 admin    root         34789 Jan 26 00:01 Totalweeklyclients.htm
-rw-rw-rw-    1 admin    root          2245 Jan 26 00:01 Totalweeklytime.htm
-rw-rw-rw-    1 admin    root          1465 Jan 26 12:00 ipdistinctclients.js

looking at the console looks like there is some issue with d3.js:

I'm finding it here:

admin@RT-AC86U-D7D8:/jffs/addons/shared-jy# ls -al
drwxr-xr-x    2 admin    root             0 Sep  3 23:52 .
drwxr-xr-x   13 admin    root             0 Jan 26 05:20 ..
-rwxr-xr-x    1 admin    root          2120 Feb  9  2020 addons.png
-rwxr-xr-x    1 admin    root        173077 Feb 14  2021 chart.js
-rwxr-xr-x    1 admin    root         13748 Jan  3  2020 chartjs-plugin-annotation.js
-rwxr-xr-x    1 admin    root         10753 Jan 28  2020 chartjs-plugin-datasource.js
-rwxr-xr-x    1 admin    root          4430 Mar  7  2020 chartjs-plugin-deferred.js
-rwxr-xr-x    1 admin    root          2209 Jul 18  2021 chartjs-plugin-trendline.js
-rwxr-xr-x    1 admin    root          9752 Feb 14  2021 chartjs-plugin-zoom.js
-rwxr-xr-x    1 admin    root         98304 Sep  3 23:52 d3.js
-rwxr-xr-x    1 admin    root          3444 Apr 10  2020 detect.js
-rwxr-xr-x    1 admin    root         20727 Feb 14  2021 hammerjs.js
-rwxr-xr-x    1 admin    root         89476 Feb 14  2021 jquery.js
-rwxr-xr-x    1 admin    root         58957 Feb 14  2021 moment.js
-rwxr-xr-x    1 admin    root          8489 Mar 17  2021 redirect.htm
-rw-rw-rw-    1 admin    root        225861 Sep  3 23:52 shared-jy.tar.gz
-rw-rw-rw-    1 admin    root            33 Sep  3 23:52 shared-jy.tar.gz.md5

looking at d3.js is really one looong line of code (line:2 as to no suprise)

is it really that bad that d3.js has become corrupted? or could there be some better explanation?

Zeb

Edit: Checked d3.js and it ended with:

;p.push(new Iu(g[3],y,v,a,u),new Iu(g[2],i,v,y,u),new Iu(g[1],y,o,

which doesnt seem proper, looking at @Jack Yaz github this part could be found 1/3-way through the line... something has cut the file??? wierd...

ok, replaced the file with this one:
shared-jy/d3.js at master · jackyaz/shared-jy (github.com)

and there is a considerable size difference:

-rwxrwxrwx    1 admin    root        269303 Jan 26 13:37 d3.js
-rwxr-xr-x    1 admin    root         98304 Sep  3 23:52 d3.js.old

but now it works!

wonder if some (dirty) firmware upgrade migrated JFFS partition and this got capped... but there are even longer files in the same directly (like "chart.js") and these are unaffected... strange....

 

[jrichard326]

I am running fully updated Merlin 386.4 on an AX86U with Diversion and UIStats. I have an issue in that Blocked Domains on the Diversion Tab (correct) does not match Domains currently on blocklist (it is doubled for some odd reason) on UIDivStats Tab. How can I fix this?