DPDK with Xen

Hi Thiago,
thanks for splitting up the discussion.

We are not entirely sure yet on how to manage (combined) library versions (so is the DPDK project overall).
And in that regard we will see if we can just "take the patch" or need to find a different solution.

I'm working on 2.2 now and once that is done I'll take a look on enabling XEN with/without that patch.
I'll let you know then if that is easy / undoable or anywhere in between.
Depending on that we can go on with the discussion.

Hi,
I was able to identify the underlying issue of the build problem with LIBRTE_PMD_XENVIRT & COMBINE_LIBS.
There is a much simpler fix than what was suggested to you for this specific issue.
I submitted it to dpdk-dev => http://dpdk.org/ml/archives/dev/2015-December/029246.html

Since it is a trivial fix I'll carry it as internal delta until I see it upstream accepted.

OTOH LIBRTE_XEN_DOM0 is building a kernel module - I have to refuse this part of the request. As usual out-of-tree modules would be huge extra effort to get that properly delivered. If you really need this you would have to start a community based packet on your own - maintaining the kernel module for LIBRTE_XEN_DOM0 with https://help.ubuntu.com/community/DKMS.

All the other things around versioning and upgrading to 2.1/2.2 will stall me a while from uploading.
Let me know if you are in urgent need of a preliminary built .deb file or so.

Building on i386 instead of amd64 reveal issues in the XEN_PMD code that might force me to drop the enablement.
I'll have a look if it is simple.

I reported the build issue at dpdk-dev => http://dpdk.org/ml/archives/dev/2015-December/029261.html

I'm not really willing to carry any super-special "only build it in amd64" delta just for that.

Waiting on your (Thiago) and upstream responses to decide how to proceed.

Hi Christian,

 Nice talk on DPDK Dev mail list about combined libs! I hope to see everything Ubuntu need, on upstream DPDK 2.2...

 Listen, is the Xen on 32-bit the only remaining DPDK problem to close this BUG?

 About DOM0, I understand that it needs DKMS and, from what I'm seeing, only XENVIRT will be enough to start playing with it.

 Thank you so much for your effort! I really appreciate it! =)

Best,
Thiago

Hi Thiago,
Yes as of now it seems that the 32bit build issue is the only issue
blocking me currently to enable XEN_PMD in the build.
If you could get a fix to that to upstream to DPDK I think I can pick it up
and use it to enable XEN_PMD in the next version of the package.
In the worst case it might be fine if you get it upstream after 2.3 release
- but the sooner you would find the time for it, the better - as it should
apply more or less cleanly to the 2.3 release code.

I'm happy to hear that XEN_PMD might be enough for you to start as the DOM0
thing would be a totally different level of complexity.

Christian Ehrhardt
Software Engineer, Ubuntu Server
Canonical Ltd

On Mon, Dec 7, 2015 at 11:47 AM, Thiago Martins <email address hidden>
wrote:

> Hi Christian,
>
> Nice talk on DPDK Dev mail list about combined libs! I hope to see
> everything Ubuntu need, on upstream DPDK 2.2...
>
> Listen, is the Xen on 32-bit the only remaining DPDK problem to close
> this BUG?
>
> About DOM0, I understand that it needs DKMS and, from what I'm seeing,
> only XENVIRT will be enough to start playing with it.
>
> Thank you so much for your effort! I really appreciate it! =)
>
> Best,
> Thiago
>
> --
> You received this bug notification because you are subscribed to dpdk in
> Ubuntu.
> Matching subscriptions: DPDK general subscription
> https://bugs.launchpad.net/bugs/1521289
>
> Title:
> DPDK with Xen
>
> Status in dpdk package in Ubuntu:
> Triaged
>
> Bug description:
> Hey guys,
>
> Can next Ubuntu version enable Xen on DPDK (both DOM0 and XENVIRT) ?
>
> I'm trying to rebuild and package DPDK Ubuntu package with Xen but, I
> found a bug on DPDK, and I'm stucked now, here is the mail thread on
> DPDK-dev mail list:
>
> http://permalink.gmane.org/gmane.comp.networking.dpdk.devel/28658
>
> Here is a patch that works with DPDK 2.2.*
>
> http://dpdk.org/dev/patchwork/patch/9088/
>
> With this patch, it is possible to enable COMBINE_LIBS and XENVIRT at
> the same time but, it breaks Ubuntu's Lib ABI versioning scheme (patch
> "ubuntu-combined-shared-lib-abiversion.patch doesn't work anymore, if
> above patch applied).
>
> Also, DPDK 2.3 will be available in March 2016, before Xenial final
> freeze (I believe), maybe, Ubuntu Xenaial can ship with it, instead of
> DPDK 2.2...
>
> I would love to see Ubuntu DPDK package compiled with Xen! ;-)
>
> Cheers!
> Thiago
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/ubuntu/+source/dpdk/+bug/1521289/+subscriptions
>

Sounds awesome Christian!

Listen, is this [DPDK with Xen on 32-bit] still a BUG with DPDK 2.2.0-rc3?

The combo "CONFIG_RTE_BUILD_COMBINE_LIBS + LIBRTE_PMD_XENVIRT" is now fixed! At least, it compiles... =)

Cheers!
Thiago

The fix for "CONFIG_RTE_BUILD_COMBINE_LIBS + LIBRTE_PMD_XENVIRT" that went
upstream was mine :-)

I didn't retry the 32bit buld since then, but I did not see a fix for that
on the list yet.

Christian Ehrhardt
Software Engineer, Ubuntu Server
Canonical Ltd

On Tue, Dec 8, 2015 at 12:49 PM, Thiago Martins <email address hidden>
wrote:

> Sounds awesome Christian!
>
> Listen, is this [DPDK with Xen on 32-bit] still a BUG with DPDK
> 2.2.0-rc3?
>
> The combo "CONFIG_RTE_BUILD_COMBINE_LIBS + LIBRTE_PMD_XENVIRT" is now
> fixed! At least, it compiles... =)
>
> Cheers!
> Thiago
>
> --
> You received this bug notification because you are subscribed to dpdk in
> Ubuntu.
> Matching subscriptions: DPDK general subscription
> https://bugs.launchpad.net/bugs/1521289
>
> Title:
> DPDK with Xen
>
> Status in dpdk package in Ubuntu:
> Triaged
>
> Bug description:
> Hey guys,
>
> Can next Ubuntu version enable Xen on DPDK (both DOM0 and XENVIRT) ?
>
> I'm trying to rebuild and package DPDK Ubuntu package with Xen but, I
> found a bug on DPDK, and I'm stucked now, here is the mail thread on
> DPDK-dev mail list:
>
> http://permalink.gmane.org/gmane.comp.networking.dpdk.devel/28658
>
> Here is a patch that works with DPDK 2.2.*
>
> http://dpdk.org/dev/patchwork/patch/9088/
>
> With this patch, it is possible to enable COMBINE_LIBS and XENVIRT at
> the same time but, it breaks Ubuntu's Lib ABI versioning scheme (patch
> "ubuntu-combined-shared-lib-abiversion.patch doesn't work anymore, if
> above patch applied).
>
> Also, DPDK 2.3 will be available in March 2016, before Xenial final
> freeze (I believe), maybe, Ubuntu Xenaial can ship with it, instead of
> DPDK 2.2...
>
> I would love to see Ubuntu DPDK package compiled with Xen! ;-)
>
> Cheers!
> Thiago
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/ubuntu/+source/dpdk/+bug/1521289/+subscriptions
>

Hi Thiago,
good news.

I wanted to let you know that the following fixes that went into the release of DPDK 2.2:
- 539ed5f8 mk: fix combined library build with Xen driver (my patch)
- f17230e1 xenvirt: fix build for 32-bit platform (thanks to Huawei Xie for that one)
together seem to be sufficient to build with LIBRTE_PMD_XENVIRT enabled.

Thereby, if no other showstopper reveals itself, the coming upgrade to 2.2 that I plan for xenial will be built with LIBRTE_PMD_XENVIRT=y.

WOW! This is awesome! Thank you so much for your effort Christian! I really
appreciate it...

Ubuntu is so cool!

You guys, Ubuntu developers, are very close with users via Launchpad...
 :-D

On 17 December 2015 at 13:24, ChristianEhrhardt <email address hidden>
wrote:

> Hi Thiago,
> good news.
>
> I wanted to let you know that the following fixes that went into the
> release of DPDK 2.2:
> - 539ed5f8 mk: fix combined library build with Xen driver (my patch)
> - f17230e1 xenvirt: fix build for 32-bit platform (thanks to Huawei Xie
> for that one)
> together seem to be sufficient to build with LIBRTE_PMD_XENVIRT enabled.
>
> Thereby, if no other showstopper reveals itself, the coming upgrade to
> 2.2 that I plan for xenial will be built with LIBRTE_PMD_XENVIRT=y.
>
> ** Changed in: dpdk (Ubuntu)
> Status: Triaged => Fix Committed
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1521289
>
> Title:
> DPDK with Xen
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/ubuntu/+source/dpdk/+bug/1521289/+subscriptions
>

Hi Thiago,
if you want to experiment with it, there is a - yet unstable - preview of DPDK 2.2 with xen pmd enabled at https://launchpad.net/~paelzer/+archive/ubuntu/dpdk-merge-2.2/

WoW! That's amazing! Thank you for this amazing Christmas gift! :-D

Happy holidays for you and your family Christian!

Cheers!

This bug was fixed in the package dpdk - 2.2.0-0ubuntu1

---------------
dpdk (2.2.0-0ubuntu1) xenial; urgency=low

  * Merge from Upstream to DPDK 2.2
    Remaining changes:
    - Set soabi for the combined shared library
  * Drop changes:
    - configuring RTE_LIBNAME to dpdk as it is the upstream default now
    - enabled formerly non building components as they build properly in 2.2
    - d/p/ubunut-avoid-texlive-fonts-extra, d/control:
      Replace use of DejaVuSansMono is no more needed as upstream changed the
      font. Thereby we can drop our delta.
    - d/p/ubuntu-fix-gcc5-ftbs.patch no more needed with DPDK 2.2
  * Added changes
    - Disable CONFIG_RTE_NEXT_ABI as required for packaging (git 506f51cc)
    - Enable LIBRTE_PMD_PCAP which is useful for some DPDK testcase examples
      this adds a build dependency to libpcap-dev
    - Fully support DH_VERBOSE for build debugging convenience
    - adapt to new make infrastructure of dpdk 2.2
    - d/README.debian: convert into d/dpdk-doc.README.debian
    - d/dpdk-doc.README.debian: update recommendations about sdk env variables
    - d/dpdk-sdk-env.sh: now deployed in /usr/share/dpdk to be opt in
    - enable XEN support for dpdk (LP: #1521289).

 -- Christian Ehrhardt <email address hidden> Wed, 17 Feb 2016 09:29:28 +0100