uiScribe uiScribe - Custom System Log page for "scribed" logs

[Jack Yaz]

Am I the only one cringing here?

Why not just disable it via the Diversion menu?

Depends what you want to do - disable pixelserv logging completely, or just parsing it to a specific file using syslog-ng

 

[no_name]

Parsing it to a specific file using syslog-ng is something new to learn about [emoji4]


Sent from my iPad using Tapatalk

 

[elorimer]

Whoa. Deleting the pixelserv config from syslog.d just means whatever it is logging go into messages. So if the size of the pixelserv log is a problem, it will just reappear in messages. You would want the config to drop the message, and you are still going to have the pixelserv ui box, but with nothing in it. I want to keep the log, but drop the ui box.

My pixelserv-tls is logging at level 2, which is why it generates so much. From that a script generates a daily email (also a sign of life) like so:

= SUMMARY (Jun 23) ==========

      Unknown CA (uca): 3461
   Unknown certs (uce):102859
       Bad certs (ucb):    0
       Shutdowns (ush): 1119
   Reached max retries:    6
     Socket I/O errors:    0
 ---------------------: ----
                 Total:107445
            Suppressed:  524
 ---------------------: ----
            New breaks:106921
       New certs (slm):    0

= Breaking Clients =========

  192.168.0.104  Chromebook
  192.168.0.113  Her-Echo
  192.168.0.115  HerPixel3
  192.168.0.127  Netflix-Streaming-Stick
  192.168.0.191  MyPixel3
  192.168.0.202  Her-iPad
  192.168.0.230  My_Echo_Show
    192.168.0.3  -sso.anbtr.com

= Unique New Breaks ========

    136 shutdown after ServerHello. 192.168.0.202 aax-us-east.amazon-adsystem.com
      2 shutdown after ServerHello. 192.168.0.202 aax.amazon-adsystem.com
     795 shutdown after ServerHello. 192.168.0.202 www.googleadservices.com
      2 shutdown after ServerHello. 192.168.0.202 www.googletagmanager.com
   3441 unknown CA. 192.168.0.113 device-metrics-us.amazon.com
   5275 unknown cert. 192.168.0.115 reports.crashlytics.com
     89 unknown cert. 192.168.0.115 settings.crashlytics.com
    515 unknown cert. 192.168.0.115 ssl.google-analytics.com
      5 unknown cert. 192.168.0.115 www.google-analytics.com
  95951 unknown cert. 192.168.0.230 device-metrics-us.amazon.com

The client information is generated by digg.

 

[elorimer]

Parsing it to a specific file using syslog-ng is something new to learn about [emoji4]

That is exactly what scribe is doing:

destination d_pixelserv-tls { 
    file("/opt/var/log/pixelserv-tls.log");
};
filter f_pixelserv-tls {
    program("pixelserv-tls");
};
# final flag stops processing of messages matching the f_skynet filter
log {
    source(src);
    filter(f_pixelserv-tls);
    destination(d_pixelserv-tls);
    flags(final);
};
#eof

The first block defines the file, the second block defines what is being selected to be sent to that destination, and the third actually sifts out of the log those messages and sends it to the file.

 

[no_name]

That is exactly what scribe is doing:

destination d_pixelserv-tls { 
    file("/opt/var/log/pixelserv-tls.log");
};
filter f_pixelserv-tls {
    program("pixelserv-tls");
};
# final flag stops processing of messages matching the f_skynet filter
log {
    source(src);
    filter(f_pixelserv-tls);
    destination(d_pixelserv-tls);
    flags(final);
};
#eof

The first block defines the file, the second block defines what is being selected to be sent to that destination, and the third actually sifts out of the log those messages and sends it to the file.

Thank you, your explanation is very helpful [emoji4]


Sent from my iPad using Tapatalk

 

[elorimer]

@Jack Yaz :

Two things. One, it might be convenient for the script to have an enable/disable function. At the moment it is install/uninstall only.

Second, I solved my problem by changing line 159 so that the part of the piping removing "messages" now reads "-vf /jffs/scripts/uiScribe.d/uiScribeBlacklist", and in that file I have

messages
pixelserv
wlceventd

being those logs I don't want to be added by uiScribe. (Except for messages, but that is separate).

I will have to remember to change that line each time the script updates. Or--this is up to you--you could do that and populate that file just with messages

 

[Jack Yaz]

@Jack Yaz :

Two things. One, it might be convenient for the script to have an enable/disable function. At the moment it is install/uninstall only.

Second, I solved my problem by changing line 159 so that the part of the piping removing "messages" now reads "-vf /jffs/scripts/uiScribe.d/uiScribeBlacklist", and in that file I have

messages
pixelserv
wlceventd

being those logs I don't want to be added by uiScribe. (Except for messages, but that is separate).

I will have to remember to change that line each time the script updates. Or--this is up to you--you could do that and populate that file just with messages

Or you could try out v1.1.0 ;-)

Make sure to open uiScribe at least once after updating

 

[elorimer]

Now that's the cat's meow! Very elegant.

Did I miss this? I swear it wasn't there an hour ago.

 

[Jack Yaz]

Now that's the cat's meow! Very elegant.

Did I miss this? I swear it wasn't there an hour ago.

Nope, I was silently working on it while discussions went on about cutting out log files. It was probably about time I implemented it after all!

 

[no_name]

Your a star [emoji93] thank you [emoji3060]


Sent from my iPad using Tapatalk

 

[QuikSilver]

Now that's the cat's meow! Very elegant.

Did I miss this? I swear it wasn't there an hour ago.

@Jack Yaz is good about predicting what we want in the future, we just don't know it yet!

 

[kernol]

Just a quick {Thumbs Up} for this add-on.
Been in the bush - Central Kalahari - for past 2 weeks and returned to find yet another piece of wizardry from Jack.
Works a treat on my AC5300 with 384.12 release .

 

[Xentrk]

@Jack Yaz

Sometimes I need to search for a word in the System Messages Log. If I scroll up or search for the words and pause to view the message, the screen refreshes and reverts to the last lines in the log file about one second later. The issue still occurs if I keep the scroll button held down using a mouse. Can this be changed?

 

[Swistheater]

@Jack Yaz

Sometimes I need to search for a word in the System Messages Log. If I scroll up or search for the words and pause to view the message, the screen refreshes and reverts to the last lines in the log file about one second later. The issue still occurs if I keep the scroll button held down using a mouse. Can this be changed?

Un-toggle the refresh option.

 

[Xentrk]

Un-toggle the refresh option.

Thank you. That fixed the behavior. It was in front of me the whole time!

 

[Swistheater]

Thank you. That fixed the behavior. It was in front of me the whole time!

Don't feel bad, I only know because I have been there .

 

[Jack Yaz]

Don't feel bad, I only know because I have been there .

@cmkelley found that during pre-release testing so we added the checkboxes

 

[Swistheater]

I found it when I was trying to access logs from 11 hours earlier. I kept thinking I was making progress, but really I was constantly starting all over.

 

[elorimer]

I wanted to note that uiScribe seems to cause the System Log page to freeze on my 87U with 13.1. This happened a while ago, and I uninstalled it; I forgot why I uninstalled it and reinstalled it. No errors in the log though. Uninstalled it and I'm back to normal. I assume it is working fine for others. I customized the logs displayed to delete the crash log and the wclevent log (not important for), and when I opened the syslog segment it froze.

 

[Butterfly Bones]

I wanted to note that uiScribe seems to cause the System Log page to freeze on my 87U with 13.1. This happened a while ago, and I uninstalled it; I forgot why I uninstalled it and reinstalled it. No errors in the log though. Uninstalled it and I'm back to normal. I assume it is working fine for others. I customized the logs displayed to delete the crash log and the wclevent log (not important for), and when I opened the syslog segment it froze.

I have the same lag and eventual freeze on my AC86U. The lag is immediate on installation, takes a few seconds for any mouse or keyboard input to respond. After a few hours it will freeze and I have to use the "service restart_httpd" in an SSH terminal to get webgui access.

I disable all but messages, skynet, and afpd (Apple Time Machine backup). Merlin 384.13.0

I removed uiScribe, and I'm back to Loggly to monitor.