Tests in merge 8.6.5-1ubuntu2 from latest Debian failing

Bug #1806005 reported by Christian Ehrhardt 
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
kopanocore (Debian)
Fix Released
Unknown
kopanocore (Ubuntu)
New
Undecided
Unassigned

Bug Description

Example:
https://objectstorage.prodstack4-5.canonical.com/v1/AUTH_77e2ada1e7a84929a74ba3b87153c0ac/autopkgtest-disco/disco/amd64/k/kopanocore/20181114_215803_4fc0b@/log.gz

Ends with:
[...]
Check that we have a running server and can create users...
Unable to open Admin store: logon failed (0x80040111)
Using the -v option (possibly multiple times) may give more hints.

Note: This reproduces locally in autopkgtest.

Debian CI perma-fails on it as well: https://ci.debian.net/packages/k/kopanocore/testing/amd64/
So this is not an Ubuntu-only issue.

When logging in the bit I found initially were:

Nov 30 10:16:30 autopkgtest systemd[1]: Started Kopano Server.
Nov 30 10:16:30 autopkgtest kopano-server[3886]: Fri Nov 30 10:16:30 2018: [=======] Starting kopano-server version 8.6.5 (pid 3886)
Nov 30 10:16:30 autopkgtest kopano-server[3886]: Fri Nov 30 10:16:30 2018: [warning] setrlimit(RLIMIT_NOFILE, 8192) failed, you will only be able to connect up to 1024 sockets.
Nov 30 10:16:30 autopkgtest kopano-server[3886]: Fri Nov 30 10:16:30 2018: [warning] WARNING: Either start the process as root, or increase user limits for open file descriptors.
Nov 30 10:16:30 autopkgtest kopano-server[3886]: Fri Nov 30 10:16:30 2018: [error ] KDatabase::Connect(): database missing -2147483616
Nov 30 10:16:30 autopkgtest kopano-server[3886]: Fri Nov 30 10:16:30 2018: [warning] F_DUPFD yielded EINVAL

Well there seems to be more, it is unclear if/how it gets installed at all as the test depends are very short, I'll need to debug further.

Revision history for this message
Christian Ehrhardt  (paelzer) wrote :

Also apparmor Denies:
[ 57.617995] audit: type=1107 audit(1543569390.209:16): pid=502 uid=105 auid=4294967295 ses=4294967295 subj==unconfined msg='apparmor="DENIED" operation="dbus_method_call" bus="system" path="/org/freedesktop/systemd1" interface="org.freedesktop.systemd1.Manager" member="GetDynamicUsers" mask="send" name="org.freedesktop.systemd1" pid=3886 label="/usr/sbin/kopano-server" peer_pid=1 peer_label="unconfined"
                exe="/usr/bin/dbus-daemon" sauid=105 hostname=? addr=? terminal=?'
[ 57.959436] audit: type=1107 audit(1543569390.549:17): pid=502 uid=105 auid=4294967295 ses=4294967295 subj==unconfined msg='apparmor="DENIED" operation="dbus_method_call" bus="system" path="/org/freedesktop/systemd1" interface="org.freedesktop.systemd1.Manager" member="LookupDynamicUserByName" mask="send" name="org.freedesktop.systemd1" pid=3886 label="/usr/sbin/kopano-server" peer_pid=1 peer_label="unconfined"
                exe="/usr/bin/dbus-daemon" sauid=105 hostname=? addr=? terminal=?'
[ 57.967647] audit: type=1107 audit(1543569390.557:18): pid=502 uid=105 auid=4294967295 ses=4294967295 subj==unconfined msg='apparmor="DENIED" operation="dbus_method_call" bus="system" path="/org/freedesktop/systemd1" interface="org.freedesktop.systemd1.Manager" member="LookupDynamicUserByName" mask="send" name="org.freedesktop.systemd1" pid=3886 label="/usr/sbin/kopano-server" peer_pid=1 peer_label="unconfined"
                exe="/usr/bin/dbus-daemon" sauid=105 hostname=? addr=? terminal=?'

Revision history for this message
Christian Ehrhardt  (paelzer) wrote :

Note: this is a universe package

It also depends on mariadb which might be an issue in Ubuntu.
Just (trying to) install it in a fresh Disco VM fails.

It fails to set up the DB correctly on install.

And that is exactly the error we see in the log of the autopkgtest system.

Nov 30 09:38:10 disco-zfstest kopano-server[8290]: Fri Nov 30 09:38:10 2018: [=======] Starting kopano-server version 8.6.5 (pid 8290)
Nov 30 09:38:10 disco-zfstest kopano-server[8290]: Fri Nov 30 09:38:10 2018: [warning] setrlimit(RLIMIT_NOFILE, 8192) failed, you will only be able to connect up to 1024 sockets.
Nov 30 09:38:10 disco-zfstest kopano-server[8290]: Fri Nov 30 09:38:10 2018: [warning] WARNING: Either start the process as root, or increase user limits for open file descriptors.
Nov 30 09:38:10 disco-zfstest kopano-server[8290]: Fri Nov 30 09:38:10 2018: [error ] KDatabase::Connect(): database access error Unknown error code (0x80000007), mysql error: Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)
Nov 30 09:38:10 disco-zfstest kopano-server[8290]: Fri Nov 30 09:38:10 2018: [crit ] Unable to connect to database: MYSQL not initialized
Nov 30 09:38:10 disco-zfstest kopano-server[8290]: An error occurred (80000007). Please check logfile "-" for details.

Revision history for this message
Christian Ehrhardt  (paelzer) wrote :
Download full text (4.5 KiB)

Trying with mysql (preferred on Ubuntu) instead of mariadb.

Dependencies:
Depends: kopano-libs (>= 8.6.1), libc6 (>= 2.14), libgcc1 (>= 1:3.0), libgsoap-2.8.60, libicu63 (>= 63.1-1~), libldap-2.4-2 (>= 2.4.7), libssl1.1 (>= 1.1.0), libstdc++6 (>= 5.2), debconf (>= 0.5) | debconf-2.0, dbconfig-common, kopano-common (= 8.6.5-1ubuntu2), lsb-base (>= 3.0-6), mariadb-client | default-mysql-client | virtual-mysql-client
Recommends: mariadb-server | default-mysql-server

Lets install these upfront:
$ sudo apt install default-mysql-server default-mysql-client

Then the install works:
After that the kopano-server install is "only":
The following NEW packages will be installed:
  dbconfig-common kopano-common kopano-libs kopano-server libgsasl7 libgsoap-2.8.60 libical3 libicu63 libmysqlclient20 libntlm0 libpython2.7 libpython2.7-minimal libpython2.7-stdlib libvmime1
Unpacking kopano-server (8.6.5-1ubuntu2) ...
Setting up kopano-common (8.6.5-1ubuntu2) ...
Adding group `kopano' (GID 117) ...
Done.
Setting up libicu63:amd64 (63.1-4) ...
Setting up libgsoap-2.8.60:amd64 (2.8.60-2build1) ...
Setting up libntlm0:amd64 (1.5-1) ...
Processing triggers for libc-bin (2.28-0ubuntu1) ...
Processing triggers for systemd (239-7ubuntu10) ...
Processing triggers for man-db (2.8.4-2build1) ...
Setting up libical3:amd64 (3.0.4-0ubuntu4) ...
Setting up libmysqlclient20:amd64 (5.7.24-2) ...
Setting up libpython2.7-minimal:amd64 (2.7.15-5) ...
Setting up dbconfig-common (2.0.10) ...
Creating config file /etc/dbconfig-common/config with new version
Setting up libpython2.7-stdlib:amd64 (2.7.15-5) ...
Setting up libgsasl7:amd64 (1.8.0-8ubuntu3) ...
Setting up libvmime1:amd64 (0.9.2-5build3) ...
Setting up libpython2.7:amd64 (2.7.15-5) ...
Setting up kopano-libs:amd64 (8.6.5-1ubuntu2) ...
Setting up kopano-server (8.6.5-1ubuntu2) ...
Determining localhost credentials from /etc/mysql/debian.cnf: succeeded.
dbconfig-common: writing config to /etc/dbconfig-common/kopano-server.conf
Creating config file /etc/dbconfig-common/kopano-server.conf with new version
Creating config file /etc/kopano/debian-db.cfg with new version
checking privileges on database kopanoserver for kopano-server@localhost: user creation needed.
granting access to database kopanoserver for kopano-server@localhost: success.
verifying access for kopano-server@localhost: success.
creating database kopanoserver: success.
verifying database kopanoserver exists: success.
dbconfig-common: flushing administrative password
Processing triggers for libc-bin (2.28-0ubuntu1) ...
Processing triggers for systemd (239-7ubuntu10) ...

After that installing the remaining build dependency: python-nose

The smoke test explicitly installs mariadb-server and then breaks.
Running the remaining calls of the test with my mysql based install

1. new guest
2. enable proposed
3. pull-lp-source kopanocore
4. install python-nose (test dep)
 < snapshot VM to iterate from here >
5. fix mariadb -> default-mysql-server default-mysql-client
6. run test step by step
6.1 install mysql
6.2 define debconf for kopanocore
6.3 install with DEBIAN_FRONTEND=noninteractive
  Setting up kopano-server (8.6.5-1ubuntu2) ...
  Determining localhost creden...

Read more...

Revision history for this message
Christian Ehrhardt  (paelzer) wrote :

With enough debugging switched on I got this error:
[error ] virtual HRESULT M4LMAPISession::OpenMsgStore(ULONG_PTR, ULONG, const ENTRYID*, LPCIID, ULONG, IMsgStore**): msp->Logon failed: logon failed (80040111)

And once I had that I found https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=907396
Resolving that was blocked on libicu >=61 which we are on now (current is 63.1-4).

Revision history for this message
Christian Ehrhardt  (paelzer) wrote :

I'm reading through git in Debian if/what the fix there would be.

Revision history for this message
Christian Ehrhardt  (paelzer) wrote :

The TL;DR after this trip though the package:
- fixed by latest upstream/Debian
- upstream didn't release yet (debian at upstream/8.6.90 for now in git)
- Debian didn't release the upload with the fix yet
- package is "only" in Universe

I'd assume we should just wait for the new Debian upload.
I'll ping Doko about it as the only Delta we ahve was from him on the try to build:
Delta:
+ * Build-depend on libsystemd-dev.
+ * Fix the kopano-spamd install file

Changed in kopanocore (Debian):
status: Unknown → Fix Committed
Changed in kopanocore (Debian):
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.