pixelserv pixelserv - A Better One-pixel Webserver for Adblock

[Asad Ali]

Ah ok then

 

[JaimeZX]

OK I am clearly doing something wrong. Admittedly a n00b at this stuff.
Asus RT-AC3100 running Merlin 384.3.

Per the 1st post, in the SSH at /tmp# I tried opkg install pixelserv-tls
Response:
Unknown package 'pixelserv-tls'.
Collected errors:
* opkg_install_cmd: Cannot install package pixelserv-tls.

Was I supposed to download something first? If so, where to save it?

Elsewhere I saw there was an Entware installer. After 20 minutes of reading I found that now Entware is built-into Merlin, it just needs to be activated. I did this.

Next, per a post on page 5x of this thread, I tried: sh -c "$(wget -qO - https://kazoo.ga/pixelserv-tls/install-beta.sh)"
Pleasingly, it asked what kind of architecture I had. After trying armv8 and being told that was wrong, I tried armv7 (option 1).

Response:
/opt/bin/pixelserv-tls missing or non-executable.

Your system doesn't seem to have pixelserv-tls installed.
Please install the prod version from Entware-ng first.

opkg install pixelserv-tls

So. Back to step 1. What am I missing here? I spent some time looking at the Github page. Unfortunately it just suggested both of the above commands. Help!

 

[kvic]

I still get these nasty crashes after a couple of hours with the latest PS beta on 86U (Merlin's 384.3)

@kvic, is there any chance to isolate this issue? Thank you.

Mar 15 14:48:48 kernel: pixelserv-tls[19008]: unhandled level 2 translation fault (11) at 0x00000020, esr 0x92000006
Mar 15 14:48:48 kernel: pgd = ffffffc010c84000
Mar 15 14:48:48 kernel: [00000020] *pgd=000000000a0b8003, *pud=000000000a0b8003, *pmd=0000000000000000
Mar 15 14:48:48 kernel: CPU: 0 PID: 19008 Comm: pixelserv-tls Tainted: P           O    4.1.27 #2
Mar 15 14:48:48 kernel: Hardware name: Broadcom-v8A (DT)
Mar 15 14:48:48 kernel: task: ffffffc015124b80 ti: ffffffc010ce0000 task.ti: ffffffc010ce0000
Mar 15 14:48:48 kernel: PC is at 0x7f7c062284
Mar 15 14:48:48 kernel: LR is at 0x7f7c062428
Mar 15 14:48:48 kernel: pc : [<0000007f7c062284>] lr : [<0000007f7c062428>] pstate: 60000000
Mar 15 14:48:48 kernel: sp : 0000007fcad42d10
Mar 15 14:48:48 kernel: x29: 0000007fcad42d60 x28: 0000000000000000
Mar 15 14:48:48 kernel: x27: 0000000000000009 x26: 0000007f5400ceb0
Mar 15 14:48:48 kernel: x25: 000000003dee8b00 x24: 0000000000000002
Mar 15 14:48:48 kernel: x23: 0000000000000000 x22: 0000000000000009
Mar 15 14:48:48 kernel: x21: 0000007f5400d950 x20: 0000007f5400d950
Mar 15 14:48:48 kernel: x19: 0000000000000000 x18: fb80c3101c40c78e
Mar 15 14:48:48 kernel: x17: 0000000000000000 x16: 000000000000003f
Mar 15 14:48:48 kernel: x15: 0000000000000020 x14: 0000000000000002
Mar 15 14:48:48 kernel: x13: 00000000000004f0 x12: 000000003c27d268
Mar 15 14:48:48 kernel: x11: 0000000000000007 x10: 0000000000000000
Mar 15 14:48:48 kernel: x9 : 000000000000270f x8 : 00000000000000de
Mar 15 14:48:49 kernel: x7 : 0000000000000000 x6 : 0000000000000001
Mar 15 14:48:49 kernel: x5 : 0000007fcad42d2c x4 : 0000007f7bf2e0b0
Mar 15 14:48:49 kernel: x3 : 0000007fcad42d2c x2 : 0000007f5400d950
Mar 15 14:48:49 kernel: x1 : 0000007f5400d950 x0 : 0000000000000000

Interesting. You're the first reported case of crash on 64-bit ARMv8. Note that the 64-bit build is relatively new for pixelserv-tls (and I believe Entware as a whole as well).

I wonder if other RT-AC86 users experience the same. Pls all running the 64-bit version help to keep an eye on crashes and report back..

At the moment, I've no clue to what might have caused the crash. I'll see if some traces could be added later for diagnosis.

 

[kvic]

OK I am clearly doing something wrong. Admittedly a n00b at this stuff.
Asus RT-AC3100 running Merlin 384.3.

Per the 1st post, in the SSH at /tmp# I tried opkg install pixelserv-tls
Response:
Unknown package 'pixelserv-tls'.
Collected errors:
* opkg_install_cmd: Cannot install package pixelserv-tls.

Was I supposed to download something first? If so, where to save it?

It could be your Entware not properly installed or the Entware repository is temporarily unavailable. Pls review how you installed Entware and then try again.

Btw, in case you're using AB-Solution to manage your block files. You'll be better off using ABS to install and configure Entware and pixelserv-tls too.

 

[JaimeZX]

It could be your Entware not properly installed or the Entware repository is temporarily unavailable. Pls review how you installed Entware and then try again.
Btw, in case you're using AB-Solution to manage your block files. You'll be better off using ABS to install and configure Entware and pixelserv-tls too.

Glorious! I clearly overlooked it in the ABS menu. May I humbly recommend editing post #1 to suggest just that? Thanks very much for the assist!

 

[ThanksForThis]

Glorious! I clearly overlooked it in the ABS menu. May I humbly recommend editing post #1 to suggest just that? Thanks very much for the assist!

While I'm not trying to play devils advocate, it states in the first post:

Installation
pixelserv-tls is now (circa April 2016) available from Entware-ng.

Note "entware-ng".
Additionally, it is standard practice to always update the repositories after installing any package manager on any platform, as they always require fetching the actual list of software they are capable of installing.

Lastly, you might want to check out:
https://github.com/decoderman/amtm

 

[JaimeZX]

While I'm not trying to play devils advocate, it states in the first post:

Note "entware-ng".
Additionally, it is standard practice to always update the repositories after installing any package manager on any platform, as they always require fetching the actual list of software they are capable of installing.

Sure! But I would say that I'm not the only person here with extremely limited LINUX/UNIX experience, and most of that was in college 20 years ago. So I'm almost starting from zero here. It's totally fair that everyone needs to assume a certain level of knowledge on the part of readers, but at the same time I researched in circles for 90 minutes before asking the above question. I'm fortunate that some Linux commands are the same as DOS ( cd .. ) and that I remembered others like more and ls. On one hand I'd agree that it's too much to ask for "then type XYZ in the SSH" level of detail; but OTOH the ABS thread includes essentially copy-and-paste commands.

Post one took me to a variety of guides and the Github page for pixelserv-tls. I saw the Entware-ng, a discussion about Entware-ng-3x, went to that Github page, saw that it had merged with Entware-ng into just plain Entware. Read more about that. Found that Merlin now includes Entware by default, you just have to activate it with a certain command in SSH. Did that. Tried to run the pixelserv-tls command via entware software now installed in the Merlin in SSH, got errors... you see where I'm going with this?

PLEASE don't get me wrong. I know it's much easier for me to be on this side of the keyboard pointing these things out; I am not a programmer or a developer. I am ABSOLUTELY grateful for the efforts other people have put forward to build these tools to make my life easier. I'm just suggesting that some of us come to this forum with very little in the way of previous knowledge. I'm very happy to do some research and reading... I just feel like this one led me in a recursive loop. haha

 

[heysoundude]

Lastly, you might want to check out:
https://github.com/decoderman/amtm

I'll emphatically second this motion.

Once you get this all sorted out, you're going to fall in love with the internet all over again.

 

[JaimeZX]

Lastly, you might want to check out:
https://github.com/decoderman/amtm

 

[heysoundude]

lol the dance of joy?

 

[Protik]

This is 1d 15 hours later. Before this there was no active devices for a while.

pixelserv-tls 2.1.0-test.7 (compiled: Mar 14 2018 21:00:59) options: 192.168.2.2 -c 150

uts    1d 14:59    process uptime
log    1    critical (0) error (1) warning (2) notice (3) info (4) debug (5)
kcc    6    number of active service threads
kmx    41    maximum number of service threads
kvg    5.10    average number of requests per service thread
krq    14779    max number of requests by one service thread
req    20103    total # of requests (HTTP, HTTPS, success, failure etc)
avg    864 bytes    average size of requests
rmx    5729 bytes    largest size of request(s)
tav    24 ms    average processing time (per request)
tmx    3142 ms    longest processing time (per request)
slh    15636    # of accepted HTTPS requests
slm    1    # of rejected HTTPS requests (missing certificate)
sle    0    # of rejected HTTPS requests (certificate available but bad)
slc    551    # of dropped HTTPS requests (client disconnect without sending any request)
slu    3538    # of dropped HTTPS requests (unknown error)
sct    144    cert cache: # of certs in cache
sch    2849    cert cache: # of reuses of cached certs
scm    32    cert cache: # of misses to find a cert in cache
scp    0    cert cache: # of purges to give room for a new cert
sst    1    sess cache: # of cached TLS sessions (for older non-RFC5077 clients)
ssh    174    sess cache: # of reuses of cached TLS sessions
ssm    130    sess cache: # of misses to find a TLS session in cache
ssp    0    sess cache: # of purges to give room for a new TLS session

 

[kvic]

@Protik

Very nice. sst drops down to 1, meaning expired sessions had been cleared. What's MEM% reading at the moment?

 

[Protik]

@Protik

Very nice. sst drops down to 1, meaning expired sessions had been cleared. What's MEM% reading at the moment?

Right now, 6.25MB of 250MB.

Sent from my Moto G (5) Plus using Tapatalk

 

[kvic]

Right now, 6.25MB of 250MB.

Sent from my Moto G (5) Plus using Tapatalk

Thank you. 6.25MB is in very good shape.

 

[Raphie]

pixelserv-tls 2.1.0-test.7 (compiled: Mar 14 2018 21:00:59) options: 192.168.1.2
135758 uts, 1 log, 1 kcc, 32 kmx, 6.37 kvg, 2678 krq, 13384 req, 1203 avg, 20260 rmx, 20 tav, 5037 tmx, 10250 slh, 102 slm, 0 sle, 1046 slc, 1785 slu, 96 sct, 4263 sch, 46 scm, 0 scp, 16 sst, 1072 ssh, 71 ssm, 0 ssp, 8420 nfe, 76 gif, 1 ico, 432 txt, 14 jpg, 9 png, 0 swf, 12 sta, 2 stt, 93 ufe, 20 opt, 418 pst, 0 hed, 86 rdr, 0 nou, 0 pth, 0 204, 12 bad, 18 tmo, 1049 cls, 836 cly, 0 clt, 0 err

 

[kvic]

@Raphie that's another very good run.

People shall also look at kvg, which registers the average number of requests serviced in a single connection. Km-test.6 onwards, kvg shall be much higher than in previous versions, meaning on average pixelserv-tls is more efficient in re-using HTTP/1.1 persistent connections.

In both runs from @Protik and @Raphie, kvg > 5! The maximum requests by one connection (krq) is a terrific 14,779 requests in Protik's case, and 2,678 in Raphie's!

very nice.

 

[kvic]

Also worth pointing out that kvg is another counter that shares the exponential moving average behind tav as discussed in this post: https://www.snbforums.com/threads/p...bserver-for-adblock.26114/page-60#post-388017

I would find chances to gradually highlight some of the inner workings of pixelserv-tls. Hopefully people will start to appreciate a bit of the sophistications in there.

 

[elorimer]

But first, Easter is just around the corner, and we haven't forgotten about cascading hash tables...

 

[kvic]

But first, Easter is just around the corner, and we haven't forgotten about cascading hash tables...

lol. You still haven't forgotten about that. My last count after x'mas the number stood around 60. So you have 40 more to work on

 

[elorimer]

Okay, team! Make sure you have "liked" post #608 in this thread. I looked at the list and we are at exactly 60. I know there are more pixelserv users!

@Asad Ali and @ThanksForThis, I'm looking at you...and now thanks!

+7 today. 33 to go. I've dm'd 7 recent posters in this thread. Sometimes ocd is a good thing.