DaemonForums  

Go Back   DaemonForums > OpenBSD > OpenBSD General

OpenBSD General Other questions regarding OpenBSD which do not fit in any of the categories below.

Reply
 
Thread Tools Display Modes
Old 17th November 2016
jggimi's Avatar
jggimi jggimi is offline
More noise than signal
 
Join Date: May 2008
Location: USA
Posts: 7,977
Default

Thank you for the detailed explanation.

(I will guess that you will not see significant performance gain by having virtual multiprocessor guests. Even thought MP performance improvements have been made and are continuing, the kernel uses Big Lock serialization.)
Reply With Quote
Old 18th November 2016
MatthiasKoch MatthiasKoch is offline
Real Name: Matthias Koch
Port Guard
 
Join Date: Mar 2016
Location: Germany
Posts: 37
Default

Rebooted the machine in question once more with the option "Check and upgrade VMware Tools before each power on" (I am positive that this had been checked all the time anyway). This time the panel is displaying

Code:
VMware Tools: Running, version:2147483647 (Guest Managed)
DNS name: <machine's FQDN>
IP Addresses: <machine's IP>
correctly - VMware Tools are running now, for whatever reason (no log entrys whatsoever, though). Anyway the behaviour is unchanged - ntpd starts, corrects the time, and then breaks (running and claiming to correct the system time by ever growing amounts of seconds while not doing anything).

I now have stopped all services on the defector manually, putting it in the same state as the reference machine as shown per ps ax and lo - it's finally working. For the first time I see ntpd populating and updating /var/db/ntp.drift, alongside the message

Code:
Nov 18 13:11:40 n2 ntpd[52657]: adjusting clock frequency by -0.294265 to 22.404ppm
This has been the last ntpd message in /var/log/daemon in three hours, and the clock is still perfectly in sync.

I will keep it like this over the weekend and check on Monday. Then I'll re-activate the services one by one and attempt to reproduce the error.

Stopped services were:
  • Nagios 4.2.2 (built from the latest downloaded version)
  • Apache (apache-httpd-2.4.23 from packages)
  • php70_fpm (php-7.0.8p0 from packages)
  • NPCD (pnp4nagios-0.6.25p3 from packages)

Hope I'll be able to narrow the problem further down.
Reply With Quote
Old 21st November 2016
MatthiasKoch MatthiasKoch is offline
Real Name: Matthias Koch
Port Guard
 
Join Date: Mar 2016
Location: Germany
Posts: 37
Default

OK - looks like I've finally found something.

First off - the clock has been running over the weekend, drifting no more than 0.00x seconds.

I have gradually re-enabled the stopped services one by one and have found that it is NPCD (a pnp4nagios daemon) that causes the problem. It is reproducable. Whether it's running alone or in conjunction with others makes no difference. At the moment NPCD starts, the system time is slowed down until it reaches a point (normally within minutes) where ntpd cannot fix it any longer. As soon as it stops, the time is slowly corrected until it eventually reaches it's normal drift window.

EDIT: Nagios, too, is making the clock drift. Apache and php70_fpm are not affecting it.

Last edited by MatthiasKoch; 21st November 2016 at 11:47 AM.
Reply With Quote
Old 21st November 2016
jggimi's Avatar
jggimi jggimi is offline
More noise than signal
 
Join Date: May 2008
Location: USA
Posts: 7,977
Default

A quick Google search found me this:

https://support.nagios.com/forum/vie...hp?f=7&t=36275

Within this thread is a comment (from user "jolson") that I believe describes pnp4nagios as a clock-adjusting application. If so, then perhaps you can change the application operating mode to eliminate the problem?

http://docs.pnp4nagios.org/pnp-0.6/modes

The OpenBSD port of pnp4nagios has a Maintainer you can contact for OpenBSD-specific application support, though it is not clear to me if this is an OpenBSD-specific problem. The Maintainer's Email address can be found with:

$ pkg_info pnp4nagios
Reply With Quote
Old 21st November 2016
MatthiasKoch MatthiasKoch is offline
Real Name: Matthias Koch
Port Guard
 
Join Date: Mar 2016
Location: Germany
Posts: 37
Default

Quote:
Originally Posted by jggimi View Post
Within this thread is a comment (from user "jolson") that I believe describes pnp4nagios as a clock-adjusting application.
I agree that jolson seems to believe it is. There is however no hint in neither the description nor the corresponding conf-files that gives me a reason to believe that pnp4nagios sets the system clock. On top of that, it wouldn't make any sense. After all this isn't Linux, where systemd reconfigures your core daemons.

I admit I am unfamiliar with pnp4nagios, but I've used (and am currently using) Nagios installations on Linux machines both on physical machines and VMware virtual machines). And Nagios itself, too, is slowing down the system clock (although not as drastic as npcd), and I've never seen anything only close to that on Linux.

I'll drop jolson a message and ask for clarification.
Reply With Quote
Old 21st November 2016
jggimi's Avatar
jggimi jggimi is offline
More noise than signal
 
Join Date: May 2008
Location: USA
Posts: 7,977
Default

Test your pnp4nagios system on real hardware.
  • If the problem recurs, then you have have an application problem or an OpenBSD problem.
  • If the problem does not recur, then you have a virtual machine problem, either with VMWare, the OpenBSD kernel implementation of VMWare Tools, or with the virtualization technology of the underlying hardware.

Last edited by jggimi; 21st November 2016 at 05:23 PM. Reason: added vmt() to the list of possiblitites
Reply With Quote
Reply

Tags
clock, ntpd, virtual machine

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Attack code exploiting critical bugs in net time sync(NTP) puts servers at risk J65nko News 15 31st December 2014 06:59 PM
DoS attacks that took down big game sites abused Web’s time-sync protocol J65nko News 0 9th January 2014 07:34 PM
How to know if the system is in sync sepuku OpenBSD Installation and Upgrading 29 8th September 2011 12:24 PM
vBulletin date/time system Beastie Feedback and Suggestions 6 24th March 2010 01:57 AM
GENERIC.MP kernel failing to boot AMD dual-core system < 75% of the time JMJ_coder NetBSD General 3 9th June 2008 01:54 PM


All times are GMT. The time now is 02:24 PM.


Powered by vBulletin® Version 3.8.4
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Content copyright © 2007-2010, the authors
Daemon image copyright ©1988, Marshall Kirk McKusick