apt-get update to latest libidn2.so.0 causes multiple application failures including apt-update

Can confirm here:

````
# cat /etc/lsb-release
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=18.04
DISTRIB_CODENAME=bionic
DISTRIB_DESCRIPTION="Ubuntu 18.04.3 LTS"
````

Errors from a lot of apps, even apt-get itself:

````
/usr/lib/apt/methods/http: relocation error: /usr/lib/x86_64-linux-gnu/libgnutls.so.30: symbol _idn2_punycode_decode version IDN2_0.0.0 not defined in file libidn2.so.0 with link time reference
E: Method http has died unexpectedly!
````

root@tachyon ~ ツ
# apt update && apt upgrade
Des:1 http://ubuntu.mirrors.ovh.net/ubuntu bionic InRelease [242 kB]
Des:2 http://ubuntu.mirrors.ovh.net/ubuntu bionic-updates InRelease [88,7 kB]
Des:3 http://ubuntu.mirrors.ovh.net/ubuntu bionic-backports InRelease [74,6 kB]
Obj:4 http://ppa.launchpad.net/libreoffice/ppa/ubuntu bionic InRelease
Obj:5 http://ppa.launchpad.net/malteworld/ppa/ubuntu bionic InRelease
Des:6 http://ppa.launchpad.net/ondrej/php/ubuntu bionic InRelease [20,8 kB]
Des:7 http://security.ubuntu.com/ubuntu bionic-security InRelease [88,7 kB]
Obj:8 http://ppa.launchpad.net/transmissionbt/ppa/ubuntu bionic InRelease
Obj:9 http://ppa.launchpad.net/webupd8team/java/ubuntu bionic InRelease
Ign:10 http://packages.elastic.co/elasticsearch/2.x/debian stable InRelease
Obj:11 http://packages.elastic.co/elasticsearch/2.x/debian stable Release
Des:12 http://repo.percona.com/percona/apt bionic InRelease [15,8 kB]
Des:13 http://ppa.launchpad.net/ondrej/php/ubuntu bionic/main amd64 Packages [51,7 kB]
Obj:14 http://nginx.org/packages/mainline/ubuntu bionic InRelease
Des:15 http://ppa.launchpad.net/ondrej/php/ubuntu bionic/main Translation-en [24,3 kB]
Des:16 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [503 kB]
Des:18 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [170 kB]
Des:19 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [6.712 B]
Des:20 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [2.872 B]
Des:21 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [604 kB]
Descargados 1.893 kB en 2s (957 kB/s)
Leyendo lista de paquetes... Hecho
Leyendo lista de paquetes... Hecho
Creando árbol de dependencias
Leyendo la información de estado... Hecho
Calculando la actualización... Hecho
Los siguientes paquetes se han retenido:
  linux-image-generic
Se actualizarán los siguientes paquetes:
  libidn2-0 libidn2-0-dev libidn2-dev libnss-systemd libpam-systemd libsystemd0 libtomcat8-java libudev1 systemd systemd-sysv tomcat8 tomcat8-common udev
13 actualizados, 0 nuevos se instalarán, 0 para eliminar y 1 no actualizados.
Se necesita descargar 5.545 kB/9.722 kB de archivos.
Se utilizarán 135 kB de espacio de disco adicional después de esta operación.
¿Desea continuar? [S/n]
Des:1 http://ppa.launchpad.net/ondrej/php/ubuntu bionic/main amd64 libidn2-dev amd64 2.2.0-1+ubuntu18.04.1+deb.sury.org+1 [68,0 kB]
Des:2 http://ppa.launchpad.net/ondrej/php/...

I experienced the same issue.

cat /etc/lsb-release
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=18.04
DISTRIB_CODENAME=bionic
DISTRIB_DESCRIPTION="Ubuntu 18.04.3 LTS"

uname -sri
Linux 5.0.0-27-generic x86_64

Machine would no longer boot successfully, primarily due to NetworkManager failing.
These are the steps I took to revert until resolved:
Boot in recovery mode, get to command prompt
dhclient <eth>
wget http://mirrors.kernel.org/ubuntu/pool/main/libi/libidn2/libidn2-0_2.0.4-1.1build2_amd64.deb
dpkg -i libidn2-0_2.0.4-1.1build2_amd64.deb
reboot
---
Note: If you have i386 libs you have to revert them as well:
wget http://mirrors.kernel.org/ubuntu/pool/main/libi/libidn2/libidn2-0_2.0.4-1.1build2_i386.deb
dpkg -i libidn2-0_2.0.4-1.1build2_i386.deb

Confirming. If one tries rebooting the computer/VM, it may result in total failure, due to NetworkManager failing to start.

Temporary workaround as advised on the Net (works for Ubuntu 18.04.3, x86 64bit):

$ wget http://mirrors.kernel.org/ubuntu/pool/main/libi/libidn2/libidn2-0_2.0.4-1.1build2_amd64.deb
$ sudo dpkg -i libidn2-0_2.0.4-1.1build2_amd64.deb
$ sudo apt-mark hold libidn2-0

Disconcerting!

But I note that https://bugs.launchpad.net/ubuntu/+source/libidn2/+bug/1843507/comments/4 solves the issue for me. At least temporarily.

This is critical. Now, I can't boot my system due to NetworkManager failing to start.

However, this only affects those with "deb http://ppa.launchpad.net/ondrej/php/ubuntu bionic main"

I did a fresh install without ondrej's PHP-FPM 7.3 repository and I no longer have this problem anymore. Please forward this issue over to https://bugs.launchpad.net/~ondrej

libidn2-0:
  Installed: 2.2.0-1+ubuntu18.04.1+deb.sury.org+1
  Candidate: 2.2.0-1+ubuntu18.04.1+deb.sury.org+1
  Version table:
 *** 2.2.0-1+ubuntu18.04.1+deb.sury.org+1 500
        500 http://ppa.launchpad.net/ondrej/php/ubuntu bionic/main amd64

Thank you for your bug report, the issue seems to be with a ppa and not an Ubuntu version though,
http://ppa.launchpad.net/ondrej/php/ubuntu
I've subscribed Ondřej to the bug now, hopefully he can fix this version or remove it

Tracked here: https://github.com/oerdnj/deb.sury.org/issues/1247, but it also needs to be fixed in Debian and Ubuntu as it was wrong for upstream to drop public symbols and not bump the SOVERSION. I removed the packages from the PPA and I am working on having a fixed package (with restored symbols) in Debian first and then I'll reupload the fixed package to the PPA.

This is a shout-out to every upstream library authors; Never ever remove public symbols from the ABI even if they are "private" and should not be use...

We experienced the same issue.

We are also using http://ppa.launchpad.net/ondrej/php/ubuntu

The solution from https://bugs.launchpad.net/ubuntu/+source/libidn2/+bug/1843507/comments/4 solved the issue for now.

I have the same issue here, but on kubuntu, and i am pretty sure i have sury in for php.

I also have someone i know with kubuntu with the same basic symptoms (network down after uodates) a few days ago, but yet still researching details. Keeping you guys updated

@seb128 make sure the next LTS has a libidn2 version with the symbols restored (I just uploaded 2.2.0-2) or SOVERSION bumped (that's for upstream to decide) or the partial upgrades will suffer from the same fate. The repository has been update

in addition to #4 I had to purge all versions of libidn2-0 including i386 executing SEVERAL TIMES:

    dpkg --purge --force-all libidn2-0

so my full process was like:

wget http://mirrors.kernel.org/ubuntu/pool/main/libi/libidn2/libidn2-0_2.0.4-1.1build2_amd64.deb

dpkg --purge --force-all libidn2-0 && dpkg --purge --force-all libidn2-0 && dpkg --purge --force-all libidn2-0 && dpkg --purge --force-all libidn2-0

dpkg -i libidn2-0_2.0.4-1.1build2_amd64.deb

apt-mark hold libidn2-0

apt --fix-broken install
apt-get update
apt-get upgrade

After comment #11, I just ran apt update && apt upgrade then it working fine with 2.2.0-2 version. Now everything is working fine.

Just like you I am on Ubuntu 18.04 LTS using repository ppa:ondrej/php

After Ondřej has released a fix, when I apt-get update or apt update && apt upgrade I am still getting the usual /usr/lib/apt/methods/http: relocation error.

Can someone please tell me step by step in simple terms what to do?
Should I follow the procedure in #4 & #12? or is there something else that must be done now that 2.2.0-2 is uploaded?

Help please.

@rororo
First:
https://bugs.launchpad.net/ubuntu/+source/libidn2/+bug/1843507/comments/12
then:
apt-get upgrade libidn2-0

@Ondřej, thanks for the status update/details/fix! Also probably a note for the futur to be careful before removing a symbol from the .symbols even if those are _prefixed

@seb123, yep, I was burnt by this so many times that it wouldn't pass over me. I guess I should also send email to Simon...

Thank you VERY MUCH for the fast response @Ondřej, I can confirm it's fixed by just apt update && apt upgrade

so it is already fixed?

which version is new package?

The 2.2.0-2 looks working now, thanks for the quick fix.

Confirming 2.2.0-2 looks good. Thanks Ondřej Surý.

This temporary workaround worked for me:

$ wget http://mirrors.kernel.org/ubuntu/pool/main/libi/libidn2/libidn2-0_2.0.4-1.1build2_amd64.deb
$ sudo dpkg -i libidn2-0_2.0.4-1.1build2_amd64.deb
$ sudo apt-mark hold libidn2-0

With that said, I want to avoid problems in the future so at what point should I remove the hold on libidn2-0? I host a few websites so anything that messes up PHP brings down all my websites. Should I downgrade back PHP 7.2 (Ubuntu 18 default) and remove the Ondrej ppa?

At what point should I remove the hold on libidn2-0?
!!!Please reply!!!

Bump!

@rororo74: See at the ticket status.
Since 2019-09-11 -> libidn2-0 Version 2.2.0-2

https://bugs.launchpad.net/ubuntu/+source/libidn2/+bug/1843507/comments/11

I noticed, but the instructions I got on that day were to:
wget http://mirrors.kernel.org/ubuntu/pool/main/libi/libidn2/libidn2-0_2.0.4-1.1build2_amd64.deb
dpkg --purge --force-all libidn2-0 && dpkg --purge --force-all libidn2-0 && dpkg --purge --force-all libidn2-0 && dpkg --purge --force-all libidn2-0
dpkg -i libidn2-0_2.0.4-1.1build2_amd64.deb
apt-mark hold libidn2-0
apt --fix-broken install
apt-get update
apt-get upgrade

So to unhold this and resume normal operations would you agree to just unhold and run updates like so?
apt-mark unhold libidn2-0
apt-get update
apt-get upgrade

you can check what exact version do you have in repos executing:

apt-cache show libidn2-0