Cluster resource agents fail to run because of missing /var/run/resource-agents directory

Bug #751344 reported by Eric Williams
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
cluster-agents (Ubuntu)
Invalid
Low
Andres Rodriguez
corosync (Ubuntu)
Fix Released
High
Unassigned
heartbeat (Ubuntu)
Fix Released
High
Unassigned

Bug Description

Binary package hint: cluster-agents

## Issue

* Cluster IP resource cannot be started

* Error messages in /var/log/syslog:

  Apr 5 13:38:32 natty2 lrmd: [1199]: info: RA output: (virtual-ip:start:stderr) touch:
  Apr 5 13:38:32 natty2 lrmd: [1199]: info: RA output: (virtual-ip:start:stderr) cannot touch `/var/run/resource-agents/IPaddr-eth0'
  Apr 5 13:38:32 natty2 lrmd: [1199]: info: RA output: (virtual-ip:start:stderr) : No such file or directory
  Apr 5 13:38:32 natty2 lrmd: [1199]: info: RA output: (virtual-ip:start:stderr)

## Environment

* Natty Narwhale 11.04 (all architectures)

## Resolution

* (Workaround) Create /var/run/resource-agents manually

## Root Cause

Package does not create directory under /var/run. Some resource agents
check it, and will create it if necessary.

## Diagnostic Steps

# grep lrmd /var/log/syslog:

Apr 5 13:38:25 natty1 lrmd: [1534]: info: RA output: (virtual-ip:start:stderr) touch:
Apr 5 13:38:25 natty1 lrmd: [1534]: info: RA output: (virtual-ip:start:stderr) cannot touch `/var/run/resource-agents/IPaddr-eth0'
Apr 5 13:38:25 natty1 lrmd: [1534]: info: RA output: (virtual-ip:start:stderr) : No such file or directory
Apr 5 13:38:25 natty1 lrmd: [1534]: info: RA output: (virtual-ip:start:stderr)
Apr 5 13:38:30 natty1 lrmd: [1534]: info: rsc:virtual-ip:8: stop

# crm status
[...]
Failed actions:
    virtual-ip_start_0 (node=natty1, call=18, rc=1, status=complete): unknown error

# mkdir /var/run/resource-agents/ # (all nodes)
# crm cleanup web-1
# crm status
 Resource Group: web-1
     apache (ocf::heartbeat:apache): Started natty1
     virtual-ip (ocf::heartbeat:IPaddr): Started natty1

ProblemType: Bug
DistroRelease: Ubuntu 11.04
Package: cluster-agents 1:1.0.4-0ubuntu1
ProcVersionSignature: Ubuntu 2.6.38-7.39-generic 2.6.38
Uname: Linux 2.6.38-7-generic x86_64
Architecture: amd64
Date: Tue Apr 5 13:46:35 2011
ProcEnviron:
 PATH=(custom, no user)
 LANG=en_US.UTF-8
 SHELL=/bin/bash
SourcePackage: cluster-agents
UpgradeStatus: No upgrade log present (probably fresh install)

Revision history for this message
Eric Williams (eric-canonical) wrote :
Revision history for this message
Andres Rodriguez (andreserl) wrote :

Hi Eric,

Thank you for reporting bugs and trying to make Ubuntu Server better.

I'll look into this. It seems that you are using IPaddr RA. Have you tried using the IPaddr2 by any chance and see if you are experiencing something similar?

Thank you!

Revision history for this message
Eric Williams (eric-canonical) wrote :

Hi, Andres

actually, I came across this after I used the "apache" template for the web resource group, /usr/share/pacemaker/templates .

I'll see if IPAddr2 has the same issue.

Eric

Revision history for this message
Eric Williams (eric-canonical) wrote :

When configured as an IPaddr2 resource, the directory is created automatically when the resource is started. I haven't yet figured out exactly where this occurs, however.

Eric

Revision history for this message
Andres Rodriguez (andreserl) wrote :

Hi Eric,

Yes I've encountered the same situation. I have various groups of test clusters on which the rundir (/var/run/resource-agents) is present. However, I'm about to install a fresh cluster with IPaddr and see if that's the problem

Cheers,

Changed in cluster-agents (Ubuntu):
status: New → Confirmed
importance: Undecided → Low
Revision history for this message
Andres Rodriguez (andreserl) wrote :

A bug has been filed upstream that relates to this bug at [1]. However, this bug has been re-opened to address the recent issues discovered on the fix proposed in [1].

[1]: http://developerbugs.linux-foundation.org/show_bug.cgi?id=2378

Changed in cluster-agents (Ubuntu):
assignee: nobody → Andres Rodriguez (andreserl)
Changed in cluster-agents (Ubuntu):
status: Confirmed → Invalid
Changed in corosync (Ubuntu):
status: New → Confirmed
Changed in heartbeat (Ubuntu):
status: New → Confirmed
Changed in corosync (Ubuntu):
importance: Undecided → High
Changed in heartbeat (Ubuntu):
importance: Undecided → High
Revision history for this message
Andres Rodriguez (andreserl) wrote :
Revision history for this message
Andres Rodriguez (andreserl) wrote :
Changed in corosync (Ubuntu):
status: Confirmed → Fix Committed
Changed in heartbeat (Ubuntu):
status: Confirmed → Fix Committed
tags: added: patch
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package corosync - 1.2.1-4ubuntu1

---------------
corosync (1.2.1-4ubuntu1) natty; urgency=low

  * debian/corosync.init: Ensure that '/var/run/resource-agents' is created;
    otherwise cluster operations will fail as RA's expect it (LP: #751344).
 -- Andres Rodriguez <email address hidden> Fri, 15 Apr 2011 13:21:30 -0700

Changed in corosync (Ubuntu):
status: Fix Committed → Fix Released
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package heartbeat - 1:3.0.4-1ubuntu3

---------------
heartbeat (1:3.0.4-1ubuntu3) natty; urgency=low

  * debian/patches/create_ra_rundir.patch: Ensure that init script creates
    '/var/run/resource-agents'; otherwise cluster operations will fail as
    RA's expect it (LP: #751344).
 -- Andres Rodriguez <email address hidden> Fri, 15 Apr 2011 13:26:23 -0700

Changed in heartbeat (Ubuntu):
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.