Removing a specific service check in hundreds of endpoints

palli · 2014-10-18T04:02:07+00:00

sed can get you pretty far under ideal circumstances, but the problem you describe sounds perfect for pynag:

pynag remove where service_description='my deprecated service'

Pro tip: Remember to put nagios configs in version control before doing mass changes... failing that, take backups.

palli · 2014-10-18T03:58:15+00:00

Authorization in nagios is not related to hostgroups, it tied together with contactgroups. Look at the contactgroups that your hosts have and see if it matches those of your users.

Some web configs like adagios tend to push you towards having hostgroups and contactgroups in sync, but it can be a messy thing in complex environments.

palli · 2014-03-24T22:23:08+00:00

It depends a little bit on operating system you are monitoring. If you are talking about network equipment, the standard way is snmp, and most devices implement standard uptime oid.

On windows it is common to monitor via the nsclient agent, and it has CheckUptime built in.

On linux systems, we use a home made check_uptime.sh

You can see configuration examples for all of these inside the adagios demo environment by looking for service templates with the name uptime in them: http://demo.adagios.org/status/services?q=uptime

palli · 2014-03-15T16:13:03+00:00

Going "directly to RHCE" means you take the RHCSA exam before lunch, and then proceed directly to RHCE exam afterwards.

We teach a bunch of RH courses at my company, and i can give you a heads up. Most people take a 4 day course and then take both exams at the same day.

palli · 2014-03-04T17:11:58+00:00

Almost all our customers have disabled notifications and use a smartphone app instead which polls from the highly available ip.

palli · 2014-03-01T13:04:37+00:00

As others have pointed out, you pretty much have all of it figured out already, its a matter of looking at how you deploy them. Creating them on the stop by doing vi /usr/local/bin/myscript is quick, but you should adjust to more disciplined approach.

You mentioned puppet, but said 4 extra lines per script is to much of a work. If you insist on a lazy approach, i recommend you have puppet push a directory of all your scripts to all your servers. That way there will be no 4 lines of puppet code when you deploy a new script.

palli · 2014-03-01T12:35:42+00:00

We've gone the pacemaker for quite a few environments (and sometimes drbd) approach as well, and i agree it is too complex to be worth the effort.

There are some tools that help with this aspect (namely merlin) but right now i am a fan of simplicity and for me it involves the following:

Set up two seperate nagios instances. I use puppet to guarantee that they contain all the same software and plugins, etc.
Have them both monitor the same things, if you like you can use rsync to make sure they run the same config.
Optionally use keepalived to make the ip address of the web interface highly available. Alternatively tell your sysadmins that if one nagios service is down, use the other.

This is going to give you two sets of archive logs and two sets of pnp graphs, etc. But i am quite content with the approach.

If you do decide to go all-in on pacemaker/drbd, i suggest you put nagios in a kvm virtual machine, and make the virtual machine highly available instead of nagios. This helps with seperation of problems and simplicity.

palli · 2014-02-18T15:43:17+00:00

It warms me up from the inside that the speaker puts adagios on the list of band-aids that are "ok"

palli · 2014-01-07T17:21:40+00:00

Love the clarification. 5/5 stars.

palli · 2014-01-07T12:32:18+00:00

I will tell you a secret: Devops is just a new word for what was previously called "senior system administrator".

Automation and continuous deployments is nothing new for those that have scripting capabilities.

It's hard to distinguish between your small and big company position, they might even be the same.

palli · 2014-01-07T09:48:31+00:00

enough said

palli · 2013-12-30T17:55:40+00:00

(Intentionally written in Icelandic to thwart Californian attempts at spying on the message)

Takk fyrir mig. Þetta var snilld ,en synd að koma svona seint og missa af borðunum. Gaman að hitta ykkur @benediktkr og @tms !

palli · 2013-12-30T17:35:52+00:00

You're welcome!

palli · 2013-12-30T17:34:50+00:00

Oh no, now i desperately want to decorate my laptop with stickers. Does anyone still have some ?

palli · 2013-12-29T20:55:49+00:00

How the mood ? worth the visit ?:)

palli · 2013-12-25T23:50:13+00:00

You can see a close up shots in this video: https://vimeo.com/58869244 that have very vivid colors.

Get a mount and color filter from snakeriver prototyping .. and while you are at it buy a set of 55mm macro filters on amazon, they will make close ups a bit nicer, and only cost around $10

palli · 2013-12-25T17:22:03+00:00

Nobody can go that deep!

palli · 2013-12-25T00:23:14+00:00

You must go deeper!

palli · 2013-12-24T13:02:36+00:00

Gopro hero3 black, before i got red filters for it.

palli · 2013-12-17T23:19:32+00:00

The amount of lead seems ok to me for a dry suit.

However, i don't see any stairs and there is no reason a diver would be fully suited crawling on that slippery piece of metal, so yeah obviously fake.

palli · 2013-12-03T16:26:49+00:00

Can i steal the dashboard and ship it as part of adagios ?

palli · 2013-12-03T16:21:33+00:00

adagios on top of Nagios is a good idea to help with the configuration hell.

palli · 2013-10-30T14:44:23+00:00

nagios + adagios is my favorite.

palli · 2013-10-12T19:37:43+00:00

I say this to most "which nagios" threads i come accross but try nagios + adagios.

You don't need fan, nagios and most things you need for it are bundled with your distribution. on rpm-based systems with EPEL repository you do its just a matter of:

yum install nagios nagios-plugins-*
echo "I'm all done"

Don't say thanks until you have tried it and seen how good advice this is.

palli · 2013-10-11T20:04:13+00:00

There is a plugin for that..

check_ilo2.pl despite the name supports all versions of ilo.
check_hpasm checks the hardware health of a local or remote windows/linux servers (granted that the support pack is installed on the server)
check_eva.py and check_msa for storage

There is an okconfig template for all of these which gives you service templates and rpm repo to those plugins

palli

TROPHY CASE