uiDivStats uiDivStats - WebUI for Diversion statistics

[JemTheWire]

I do have a lot of IoT devices.

37 devices connected at the moment.

 

[JemTheWire]

With uiDivStats installed DSK was hitting 101% on occasion.

I have uninstalled it again, and now DSK ranged from 0 > 52% but very infrequently.

Never had this problem with v1.x

 

[Jack Yaz]

I do have a lot of IoT devices.

37 devices connected at the moment.

Can you run the tail command I provided and let me know how many rows you see appear? Perhaps I should look into a way of buffering the entries somewhere in memory/jffs and periodically flush to USB.

The problem I have is that I can't tamper with the original dnsmasq.log file without impacting on Diversion's functions - otherwise I would simply vacuum out log lines on a regular basis

 

[Jack Yaz]

With uiDivStats installed DSK was hitting 101% on occasion.

I have uninstalled it again, and now DSK ranged from 0 > 52% but very infrequently.

Never had this problem with v1.x

1.0 would quite often lock up the CPU for long periods of time running grep queries on large log files.
2.0 runs a constant parser of dns logs into a db, as I said a couple of posts back.

 

[JemTheWire]

I have run the tail command.

The output scrolls off the top of the screen. Not sure how to screen grab as it just scrolls up.

 

[Jack Yaz]

I have run the tail command.

The output scrolls off the top of the screen. Not sure how to screen grab as it just scrolls up.

is it rapidly scrolling, or in bursts (in line with when you see spikes), or quite slow?

 

[JemTheWire]

It comes in bursts.

I have a split screen so I can watch the CPU usage as the tail command runs.

There does not appear to be a connection. When the tail scrolls, the CPU does not always follow, if you see what i mean?

 

[JemTheWire]

 

[Diamond67]

I had a similar experience with my AC86U, CPU pegged at 100% io. But then my USB stick connected to the router failed and I replaced it with a newer and faster one, that made the problem disappear for me.

Coincidence or not, but my Entware usb flash drive just died the night after I had installed uiDivStats 2.0.

 

[Jack Yaz]

It comes in bursts.

I have a split screen so I can watch the CPU usage as the tail command runs.

There does not appear to be a connection. When the tail scrolls, the CPU does not always follow, if you see what i mean?

uiDivStats logging to sqlite may run a little behind the tail, so i would expect it to be a little staggered. I suspect you're seeing the issues due to the number of clients on your network. Are you able to bring down the number of clients temporarily to confirm or deny this theory?

 

[Jack Yaz]

Coincidence or not, but my Entware usb flash drive just died the night after I had installed uiDivStats 2.0.

Coincidence, it was probably nearing EOL and would have died with any other application writing to it.

People cheap out on USB drives assuming they're all the same. They're not. Flash chip quality matters

 

[JemTheWire]

I have reduced my devices count temporarily down to 7. I have just rebooted the router and am just waiting for things to settle before i do anything else...

 

[JemTheWire]

OK, after 15 minutes since reboot, things have settled.

CPU does seem calmer. Occasionally cores hit 100%, but doesn't appear to be as often. DSK (aTop). occasionally hits 101% too, but again it has calmed down considerably.

So, do I take it that it's connected (no pun intended) to the number of devices on my network?

Tail command is also very light now to, not too much at all.

 

[JemTheWire]

Apart for the obvious. What can I do?

 

[dave14305]

You seemed to have a lot of PTR (reverse lookup) queries from your devices. Would it break anyone’s heart it Jack only shows query[A] or [AAAA]? It might lighten the load.

 

[JemTheWire]

I have a program called GlassWire installed. That keeps a eye on my network when my PC is switched on. Could that have anything to do with the extra traffic?

 

[L&LD]

@JemTheWire, Ding! Ding! Ding! We may have a winner?!

 

[JemTheWire]

I've just disabled GlassWire and rebooted my PC, no difference to anything. Having connected all my devices back, I am seeing the same spikes, and USB being thrashed.

 

[JemTheWire]

Quite frankly, my head is spinning with it all. I'm going to remove uiDivStats for now.

 

[Jack Yaz]

You seemed to have a lot of PTR (reverse lookup) queries from your devices. Would it break anyone’s heart it Jack only shows query[A] or [AAAA]? It might lighten the load.

@JemTheWire would you be willing to test this if i create a special version?