uiDivStats uiDivStats - WebUI for Diversion statistics

[Asad Ali]

Almost feature complete now...

Hey is this "Cable Modem Stats" script public? Can we get a sneak peak....

 

[Jack Yaz]

Hey is this "Cable Modem Stats" script public? Can we get a sneak peak....

It is, search for modmon

 

[Jack Yaz]

Are there any willing beta/power users that want to give uiDivStats 2.0 a spin? It's been in testing with a few selected users for the last week or so and feedback so far is positive!

You'll need a 2GB+ USB drive, as the DNS database can get quite hefty depending on your network's traffic. 2-3 weeks' worth of queries on my relatively quiet network is just shy of 200MB. The database will keep at most 30 days' of queries.

Message me if interested!

 

[heslo]

24 hours in of testing and it seems damned good on my end. Haven't come across any issues so far

 

[Jack Yaz]

24 hours in of testing and it seems damned good on my end. Haven't come across any issues so far

Good stuff!

 

[QuikSilver]

@Jack Yaz Any idea why the chart isn't displaying info. Pie chart shows info though.

 

[Jack Yaz]

@Jack Yaz Any idea why the chart isn't displaying info. Pie chart shows info though.

View attachment 23812

Check for browser console errors, but also check the contents of the "time" htm/csv files in /opt/share/uiDivStats.d/csv

 

[QuikSilver]

Check for browser console errors, but also check the contents of the "time" htm/csv files in /opt/share/uiDivStats.d/csv

Ah, might not have waited long enough. Strangely though all the scripts which had graphs didn't show/update unless I force a manual update. That's what lead to the reboot and apparently I hadn't waited long enough for it to auto update the stats. Still odd though.

Computers...

 

[Jack Yaz]

Ah, might not have waited long enough. Strangely though all the scripts which had graphs didn't show/update unless I force a manual update. That's what lead to the reboot and apparently I hadn't waited long enough for it to auto update the stats. Still odd though.

Computers...

As the db grows the standard refreshes do take marginally longer, but if I've coded it correctly you shouldn't end up in a state without data while the refresh is in progress.

A full refresh that updates weekly and monthly can take AGES which is why it only runs once overnight. The hourly cron job refreshes the "daily" stats

 

[Jack Yaz]

Ah, might not have waited long enough. Strangely though all the scripts which had graphs didn't show/update unless I force a manual update. That's what lead to the reboot and apparently I hadn't waited long enough for it to auto update the stats. Still odd though.

Computers...

Welp, actually there's a bug...

Just testing a fix now

 

[Jack Yaz]

Any testers of uiDivStats 2.0 please note if you upgrade there is an intended delay after the updated while the database re-creates some indexes. Depending on your database size, this may be very slow. PM me if you run into any issues.

Subsequent updates and launches of uiDivStats should return to normal

 

[heslo]

@Jack Yaz Any idea why the chart isn't displaying info. Pie chart shows info though.

View attachment 23812

I fixed this by changing the 24 hour setting to 7 days and then back again, worked like a charm!

 

[thelonelycoder]

Any testers of uiDivStats 2.0 please note if you upgrade there is an intended delay after the updated while the database re-creates some indexes. Depending on your database size, this may be very slow. PM me if you run into any issues.

Subsequent updates and launches of uiDivStats should return to normal

Mine's taking half an hour so far. I'll let it run to see if it exits cleanly.

 

[Jack Yaz]

Mine's taking half an hour so far. I'll let it run to see if it exits cleanly.

Hm, there's a chance that it gets stuck for reasons unknown. I suspect that I asked too much of sqlite in one go without explicitly declaring a transaction. (I'll split the commands up in my next commit to deal with one index at a time)

If you need me to, I'll PM you the commands to manually drop and create the new indexes, otherwise the recent commits show them .

 

[thelonelycoder]

Hm, there's a chance that it gets stuck for reasons unknown. I suspect that I asked too much of sqlite in one go without explicitly declaring a transaction. (I'll split the commands up in my next commit to deal with one index at a time)

If you need me to, I'll PM you the commands to manually drop and create the new indexes, otherwise the recent commits show them .

All four cores are busy, I'll let it heat up the office for the time being.

 

[heslo]

Hm, there's a chance that it gets stuck for reasons unknown. I suspect that I asked too much of sqlite in one go without explicitly declaring a transaction. (I'll split the commands up in my next commit to deal with one index at a time)

If you need me to, I'll PM you the commands to manually drop and create the new indexes, otherwise the recent commits show them .

I'm having issues even getting into uiDivStats from the amtm menu now. Any ideas of where to go from here?

 

[thelonelycoder]

Still busy:

 

[Jack Yaz]

Still busy:

Ok it's obviously got stuck

Ctrl-C out of it, then run

touch /jffs/addons/uiDivStats.d/.upgraded2

This will let you open up uiDivStats without it trying to re-index. Update to the latest version I have just pushed which runs these commands 1 at a time, thus making it a lot less likely for the whole block to fail/retry.

Once updated, run

rm /jffs/addons/uiDivStats.d/.upgraded2

then launch uiDivStats again. It will again take a little time, but it should be under 10 minutes (roughly how long it took for my 300MB db)

 

[Jack Yaz]

I'm having issues even getting into uiDivStats from the amtm menu now. Any ideas of where to go from here?

You may have been struck by the same bug/issue - follow the steps in https://www.snbforums.com/threads/u...iversion-statistics.56393/page-31#post-589694 please

 

[thelonelycoder]

Ok it's obviously got stuck

Ctrl-C out of it, then run

touch /jffs/addons/uiDivStats.d/.upgraded2

This will let you open up uiDivStats without it trying to re-index. Update to the latest version I have just pushed which runs these commands 1 at a time, thus making it a lot less likely for the whole block to fail/retry.

Once updated, run

rm /jffs/addons/uiDivStats.d/.upgraded2

then launch uiDivStats again. It will again take a little time, but it should be under 10 minutes (roughly how long it took for my 300MB db)

No luck, still sitting there, barely idling.