Pulseaudio FTBS on PandaBoard with -j2

Binary package hint: pulseaudio

Using 10.10, pulseaudio fails to build from source when trying to build with parallel threads. what i did is:

apt-get source pulseaudio
sudo apt-get build-dep pulseaudio
dpkg-buildpackage -j4

It fails toward the end, like this:

libtool: relink: gcc -std=gnu99 -shared .libs/libpulse_la-channelmap.o .libs/libpulse_la-context.o .libs/libpulse_la-error.o .libs/libpulse_la-ext-device-manager.o .libs/libpulse_la-ext-stream-restore.o .libs/libpulse_la-introspect.o .libs/libpulse_la-mainloop-api.o .libs/libpulse_la-mainloop-signal.o .libs/libpulse_la-mainloop.o .libs/libpulse_la-operation.o .libs/libpulse_la-proplist.o .libs/libpulse_la-rtclock.o .libs/libpulse_la-sample.o .libs/libpulse_la-scache.o .libs/libpulse_la-stream.o .libs/libpulse_la-subscribe.o .libs/libpulse_la-thread-mainloop.o .libs/libpulse_la-timeval.o .libs/libpulse_la-utf8.o .libs/libpulse_la-util.o .libs/libpulse_la-volume.o .libs/libpulse_la-xmalloc.o .libs/libpulse_la-client-conf-x11.o -lX11-xcb -lX11 -lICE -lSM -lXtst -lxcb-atom -lxcb -L/home/ubuntu/rebuild/pulseaudio-0.9.22~0.9.21+stable-queue-32-g8478/debian/tmp//usr/lib -L/usr/lib -lpulsecommon-0.9.21 -lrt -ldl -lm -pthread -mtune=cortex-a9 -mfpu=neon -Wl,-z -Wl,nodelete -Wl,-version-script=./map-file -Wl,-Bsymbolic-functions -pthread -Wl,-soname -Wl,libpulse.so.0 -o .libs/libpulse.so.0.12.2
libtool: relink: gcc -std=gnu99 -shared .libs/cli.o -L/home/ubuntu/rebuild/pulseaudio-0.9.22~0.9.21+stable-queue-32-g8478/debian/tmp//usr/lib -L/usr/lib -lpulsecore-0.9.21 -lpulsecommon-0.9.21 -lpulse -lrt -ldl -lm -pthread -mtune=cortex-a9 -mfpu=neon -Wl,-Bsymbolic-functions -pthread -Wl,-soname -Wl,libcli.so -o .libs/libcli.so
/usr/bin/ld: cannot find -lpulse
collect2: ld returned 1 exit status
libtool: install: error: relink `libcli.la' with the above command before installing it
make[5]: *** [install-modlibexecLTLIBRARIES] Error 1
make[5]: *** Waiting for unfinished jobs....

when building with -j1, it works fine.