Month: July 2015

Results of more memory
The main question is: Did this memory expansion any good? It should be visible in the output of the performance tools.
First: Hyperspy++ (that comes with WASD): It does show memory usage is much lower, but consistent with the prevous size (about a quarter) and paging hasn’t changed much:

T4 output shows similar freelist size but the modified page list has increased:

and here as well, paging statistics haven’t changed much:

which is to be expected, since memory utilization is pretty much the same:

Seems odd, but is to be expected: Since I still have to do a reconfiguration of the paging parameters – that’s what AUTOGEN is all about. It is planned to be done somewhere next week.

But on the subjective side, there are improvements: it is obvious that the increased size of the modified page list allows faster execution of PHP code. No ACCVIO or stack overflows so far; just a few:

%HTTPD-W-NOTICED, 22-JUL-2015 19:52:40, CGI:1997, not a strict CGI response
-NOTICED-I-SERVICE, http://www.grootersnet.nl:80
-NOTICED-I-CLIENT, 82.161.236.244
-NOTICED-I-URI, GET (100 bytes) /sysblog/wp-admin/admin-ajax.php?action=dashboard-widgets&widget=dashboard_primary&pagenow=dashboard
-NOTICED-I-SCRIPT, /sysblog/wp-admin/admin-ajax.php sysblog:[wp-admin]admin-ajax.php (phpwasd:) SYSBLOG:[WP-ADMIN]admin-ajax.php
-NOTICED-I-CGI, 504850205761726E696E673A20204D6F64756C652027646F (2048 bytes) PHP Warning: Module 'dom' already loaded in Unknown on line 0.
-NOTICED-I-RXTX, err:0/0 raw:1154/0 net:1154/0


yesterday from the workstation, and one today. But it all seems to work without problems.

SCSI hardware is already present
When changing the memory, I also realized there are two SCSI cards in the box: One serves the internal disk (that holds the page- and swap files), and the other connects to the external storage unit. The second is surely a KZPBA, the first one probably is as well, it too has an 68-pin outlet at the back. So there is no real need to install another KZPBA – it’s all there.
The one thing to find out is to see whether terminators are there, or not. Access is not that easy so I didn’t check last night. So there well be another (short) outage, probably in a weekend.

Hot, hot, hot
Tonight everything was stalled. Not even the console triggered a reaction. Normally, if the screen has gone blank, there are two leds flashing on the keyboard but even these were unlit. The reset button that would normally invoke ^P, had no response. So I stopped the machine the hard way (powered it off) and powered it o again, and there I found the system temperature was 44 degrees. So the machine was probably halted due to high temps. Restarted it (and found a bug in WASD?), cooled it somewhat by pushing air through the vents in front. Now hoping it won’t get that hot. (Yes, I know. I need airco in here. As soon as I have the bucks, I’ll get one)

Server errors
Sometimes it seems impossible to acess the blogs, and the WATCH output shows 500 errors – with no particular text. The server log however does.
Fairly often there is:

%HTTPD-W-NOTICED, 22-JUL-2015 08:21:54, CGI:1997, not a strict CGI response
-NOTICED-I-SERVICE, http://www.grootersnet.nl:80
-NOTICED-I-CLIENT, 68.180.229.122
-NOTICED-I-URI, GET (20 bytes) /sysblog/?m=20110727
-NOTICED-I-SCRIPT, /sysblog/index.php sysblog:[000000]index.php (phpwasd:) SYSBLOG:[000000]index.php
-NOTICED-I-CGI, 504850205761726E696E673A20204D6F64756C652027646F (2048 bytes) PHP Warning: Module 'dom' already loaded in Unknown on line 0.
-NOTICED-I-RXTX, err:0/0 raw:196/0 net:196/0

and once in a while:

%HTTPD-W-NOTICED, 15-JUL-2015 00:12:17, CGI:2107, not a strict CGI response
-NOTICED-I-SERVICE, http://www.grootersnet.nl:80
-NOTICED-I-CLIENT, 89.248.167.137
-NOTICED-I-URI, POST (19 bytes) /sysblog/xmlrpc.php
-NOTICED-I-SCRIPT, /sysblog/xmlrpc.php sysblog:[000000]xmlrpc.php (phpwasd:) SYSBLOG:[000000]xmlrpc.php
-NOTICED-I-CGI, 2553595354454D2D462D53544B4F56462C20737461636B20 (66 bytes) %SYSTEM-F-STKOVF, stack overflow, PC=FFFFFFFF8083B42C, PS=0000001B
-NOTICED-I-RXTX, err:0/0 raw:462/0 net:462/0
or

%HTTPD-W-NOTICED, 22-JUL-2015 08:51:37, CGI:2107, not a strict CGI response
-NOTICED-I-SERVICE, http://www.grootersnet.nl:80
-NOTICED-I-CLIENT, 192.3.154.170
-NOTICED-I-URI, POST (19 bytes) /sysblog/xmlrpc.php
-NOTICED-I-SCRIPT, /sysblog/xmlrpc.php sysblog:[000000]xmlrpc.php (phpwasd:) SYSBLOG:[000000]xmlrpc.php
-NOTICED-I-CGI, 2553595354454D2D462D41434356494F2C20616363657373 (118 bytes) %SYSTEM-F-ACCVIO, access violation, reason mask=00, virtual address=000000003B22676E, PC=FFFFFFFF8083B42C, PS=0000001B

that occurs in different places within the PHP engine.

I restarted the server and for now, the blogs can be accessed again.
The problems have been signaled but I didn’t get an answer yet. Stack overflow and Access violations may be related to the lack of memory – which is to be handled shortly.

Update
On posting an update, I got a complete stackdump on screen (without formatting, of course). This may help[ to solve the issue:


%SYSTEM-F-ACCVIO, access violation, reason mask=00, virtual address=000000002D70772F, PC=00000000003F6870, PS=0000001B%TRACE-F-TRACEBACK, symbolic stack dump follows image module routine line rel PC abs PC PHPSHR 0 00000000003A4870 00000000003F6870 PHPSHR 0 00000000003A9E74 00000000003FBE74 PHPSHR 0 00000000003E3894 0000000000435894 PHPSHR 0 00000000003A43B8 00000000003F63B8 PHPSHR 0 00000000003B58A4 00000000004078A4 PHPSHR 0 0000000000370B8C 00000000003C2B8C PHP52-13WASD PHPWASD ProcessRequest 47240 00000000000020F8 00000000000320F8 PHP52-13WASD PHPWASD main 46824 0000000000000728 0000000000030728 PHP52-13WASD PHPWASD __main 46717 000000000000006C 000000000003006C PTHREAD$RTL 0 0000000000057718 FFFFFFFF80A77718 PTHREAD$RTL 0 0000000000030444 FFFFFFFF80A50444 0 FFFFFFFF8037FC44 FFFFFFFF8037FC44%TRACE-I-END, end of TRACE stack dumpPHP Warning: Module 'dom' already loaded in Unknown on line 0 PHP Warning: Module 'session' already loaded in Unknown on line 0 PHP Warning: Module 'SimpleXML' already loaded in Unknown on line 0 PHP Warning: require(/sysblog/000000/wp-includes/author-template.php) [function.require]: failed to open stream: not enough core in /sysblog/000000/wp-settings.php on line 126 PHP Fatal error: require() [function.require]: Failed opening required '/sysblog/000000/wp-includes/author-template.php' (include_path='.:/php_root/000000') in /sysblog/000000/wp-settings.php on line 126 PHP Fatal error: Maximum execution time of 60 seconds exceeded in Unknown on line 0 PHP Fatal error: Cannot redeclare redirect_post() (previously declared in ðÅCblog/wp-admin/SYSBLOG:[WP-ADMIN]post.php:41) in /sysblog/wp-admin/SYSBLOG:[WP-ADMIN]post.php on line 83
Update 2
Didn’t want to wait. The 2Gb memory has arrived and I decided to install it right away.

$ sho mem
System Memory Resources on 22-JUL-2015 20:20:41.50

Physical Memory Usage (pages):     Total        Free      In Use    Modified
Main Memory (2.00GB)              262144      168149       87963        6032


Far better figures than before!
All in all it took less than half an hour. After restart, it became clear that the startup needed to be adapted as well, wasn’t done yet, so it took several more minutes to get it all up and running again. There were a few issues, mainly logicals that needed to be redefined. But once that was done, all went well.
It seems to be quite an improvement: the blogs loads faster (once the runtime environment is loaded and initialized) and since there is much more memory, my guess is that paging – especially hard faults – will be less. But that will show within a few days.
To get things even better, the system has to run for some time after which I could do an autogen to re-configure the system – memory in particular.
Time will also tell whether ACCVIO’s and stack overflows are now a thing of the past.

Maintenance
The log of the maintenance job shows no real surprises:
PMAS statistics for June
Total messages    :   1552 = 100.0 o/o
DNS Blacklisted   :      0 =    .0 o/o (Files:  0)
Relay attempts    :    105 =   6.7 o/o (Files: 30)
Accepted by PMAS  :   1447 =  93.2 o/o (Files: 30)
  Handled by explicit rule
         Rejected :    725 =  50.1 o/o (processed),  46.7 o/o (all)
         Accepted :    323 =  22.3 o/o (processed),  20.8 o/o (all)
  Handled by content
        Discarded :    180 =  12.4 o/o (processed),  11.5 o/o (all)
     Quarantained :    183 =  12.6 o/o (processed),  11.7 o/o (all)
        Delivered :     36 =   2.4 o/o (processed),   2.3 o/o (all)

and in the logfiles, it shows just on 7th, 16th and 26th of June more relay attempts than usual; the files are 8 blocks (4K) in size, so not that big.

However, I have AkisMet running on the blog and that shows over 800 spam messages for June – just these few days, and almost 800 for today alone; however, it may be related to the installation of the new version of the software installed tonight.

Fot the blog: I downloaded a number of themes that I like on first glance, and installed them. It’s now a matter of determining which one will be applied. It may take a few switches in the coming weeks. For the time being, I customized the twentyFifteen theme that comes with WordPress. Next I encountered a number of issues with the editor screen when enabling the excerpt form: but this is admin only so I don’t bother too much – for now.