Azure Linux Agent (WALA) 2.1.5 Released

Hi Daniel,

I've built a test package for trusty in https://launchpad.net/~daniel-thewatkins/+archive/ubuntu/wala. Please test this version and let us know if you are happy for us to start the process of getting this in to the official archive.

One notable change in this version of the package is that waagent will run using Python 3 rather than Python 2; this makes trusty consistent with more recent releases, but is a difference that you may want to pay attention to in your testing.

Thanks,

Dan

Hi Dan,
Thank you for getting back to us here.

We have started testing, can you let me know the whole list of versions of the OS you would like us to test this on?

Thank,

Dan

-----Original Message-----
From: <email address hidden> [mailto:<email address hidden>] On Behalf Of Dan Watkins
Sent: Wednesday, July 20, 2016 1:45 AM
To: Daniel Sol <email address hidden>
Subject: [Bug 1603581] Re: Azure Linux Agent (WALA) 2.1.5 Released

Hi Daniel,

I've built a test package for trusty in https://na01.safelinks.protection.outlook.com/?url=https:%2f%2flaunchpad.net%2f~daniel-&data=01%7C01%7Cdanis%40microsoft.com%7C54f08526a7004389ad3308d3b07af002%7C72f988bf86f141af91ab2d7cd011db47%7C1&sdata=bljOv%2f3QDzCoVIev%2bERYs7KrLxdlMRFriDT%2f8Ui9uIs%3d
thewatkins/+archive/ubuntu/wala. Please test this version and let us know if you are happy for us to start the process of getting this in to the official archive.

One notable change in this version of the package is that waagent will run using Python 3 rather than Python 2; this makes trusty consistent with more recent releases, but is a difference that you may want to pay attention to in your testing.

Thanks,

Dan

--
You received this bug notification because you are subscribed to the bug report.
https://na01.safelinks.protection.outlook.com/?url=https%3a%2f%2fbugs.launchpad.net%2fbugs%2f1603581&data=01%7c01%7cdanis%40microsoft.com%7c54f08526a7004389ad3308d3b07af002%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=9lMbOFlRnc99Cx7jTUA6igsrMqVMYJVQI5joZSEKyfk%3d

Title:
  Azure Linux Agent (WALA) 2.1.5 Released

Status in walinuxagent package in Ubuntu:
  New

Bug description:
  As discussed in an email, the Linux Agent (WALA) version 2.1.5 has now been signed off and is in Master now.

  Please find the details below of some of items built into this release :
  https://github.com/Azure/WALinuxAgent/releases

  We would like you to take this version and test it within your images, please can you file any bugs in Github, as this is monitored by our dev team.

  If you have any questions please reach out to me directly or raise it through Github.

To manage notifications about this bug go to:
https://na01.safelinks.protection.outlook.com/?url=https%3a%2f%2fbugs.launchpad.net%2fubuntu%2f%2bsource%2fwalinuxagent%2f%2bbug%2f1603581%2f%2bsubscriptions&data=01%7c01%7cdanis%40microsoft.com%7c54f08526a7004389ad3308d3b07af002%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=ms1HkVBKhKvqmA3K%2bPlo%2bmpUWkU4yuZEz06maghxjx0%3d

Hi Dan,
Just to confirm we have tested basic validation on 1404 and 1604 with the private 2.1.5 packages:

- deploy stock vm
- check wala/python versions and log
- add package source and upgrade
- check wala/python versions and log
- install+enable vm access and check log
- verify status in portal
- log in with new user

We have seen no issues.

Thanks,

Dan

Attached is a debdiff for the new version.

Hi Matthew,
Thank you for the notice.

I see in the bug notification this was tested for 1404, 1604, can I confirm it is now in the repos for these two releases, also, will it go into 1610 too?

Thanks,

Dan

-----Original Message-----
From: <email address hidden> [mailto:<email address hidden>] On Behalf Of Mathew Hodson
Sent: Wednesday, August 31, 2016 1:52 PM
To: Daniel Sol <email address hidden>
Subject: [Bug 1603581] Re: Azure Linux Agent (WALA) 2.1.5 Released

** Tags added: patch

--
You received this bug notification because you are subscribed to the bug report.
https://na01.safelinks.protection.outlook.com/?url=https%3a%2f%2fbugs.launchpad.net%2fbugs%2f1603581&data=01%7c01%7cdanis%40microsoft.com%7c8d698a812caa484311b008d3d1e1f032%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=X3m1Q08otZ0t1dpoWd2TIGCyMCPXKZeydISvR7p77o0%3d

Title:
  Azure Linux Agent (WALA) 2.1.5 Released

Status in walinuxagent package in Ubuntu:
  Triaged

Bug description:
  As discussed in an email, the Linux Agent (WALA) version 2.1.5 has now been signed off and is in Master now.

  Please find the details below of some of items built into this release :
  https://github.com/Azure/WALinuxAgent/releases

  We would like you to take this version and test it within your images, please can you file any bugs in Github, as this is monitored by our dev team.

  If you have any questions please reach out to me directly or raise it through Github.

To manage notifications about this bug go to:
https://na01.safelinks.protection.outlook.com/?url=https%3a%2f%2fbugs.launchpad.net%2fubuntu%2f%2bsource%2fwalinuxagent%2f%2bbug%2f1603581%2f%2bsubscriptions&data=01%7c01%7cdanis%40microsoft.com%7c8d698a812caa484311b008d3d1e1f032%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=YpxaVNmXsLthRgQwlopxC46eG8Pl6oawuxwKqHGQ4Dg%3d

This bug was fixed in the package walinuxagent - 2.1.5-0ubuntu1

---------------
walinuxagent (2.1.5-0ubuntu1) yakkety; urgency=medium

  * New upstream release (LP: #1603581)
    - d/patches/disable-auto-update.patch:
      - The new version introduces auto-updating of the agent to its latest
        version via an internal mechanism; disable this
    - d/patches/fix_shebangs.patch:
      - Dropped in favour of the dh_python3 --shebang option.
    - Refreshed d/patches/disable_udev_overrides.patch

 -- Daniel Watkins <email address hidden> Tue, 13 Sep 2016 16:11:47 +0100

Hi, we are about to release 2.1.7, we have a few bug fixes in this release, please can you stop work on this bug and take 2.1.7 when it releases next week. I will raise a new bug for that.

Thanks,

Dan

Do you have a list of bugs that you feel warrant us stopping movement on 2.1.5?

Dan Sol - given where we are in the yakkety release cycle (https://wiki.ubuntu.com/YakketyYak/ReleaseSchedule) unless there is a serious regression or critical bug fix that can't be backported to 2.1.5, we need to stay the course and look to bringing in 2.1.7 in at the start of the Z release in ~4 weeks. So, the question is if you would like for us to stop the backport of 2.1.5 to Xenial and Trusty, and wait for 2.1.7 to appear in Z and then start the backport.

Hi Patricia,
Sorry for the delay in getting back to you.

We have identified a bug, I will go into more details on the call with you later today, as I would like your thoughts on options we have to keep you on course, I will then update this bug.

Thanks,

Dan

-----Original Message-----
From: <email address hidden> [mailto:<email address hidden>] On Behalf Of Patricia Gaughen
Sent: Wednesday, September 21, 2016 11:07 AM
To: Daniel Sol <email address hidden>
Subject: [Bug 1603581] Re: Azure Linux Agent (WALA) 2.1.5 Released

Dan Sol - given where we are in the yakkety release cycle
(https://na01.safelinks.protection.outlook.com/?url=https%3a%2f%2fwiki.ubuntu.com%2fYakketyYak%2fReleaseSchedule&data=02%7c01%7cdanis%40microsoft.com%7c7e8f549ffdd946a6da2208d3e24b62cf%7c72f988bf86f141af91ab2d7cd011db47%7c1%7c0%7c636100785813909774&sdata=H4WJaBO%2fTzAYVh3Cw3udVtpzDNGYOXCDB%2fishzv3I0g%3d) unless there is a serious regression or critical bug fix that can't be backported to 2.1.5, we need to stay the course and look to bringing in 2.1.7 in at the start of the Z release in ~4 weeks. So, the question is if you would like for us to stop the backport of 2.1.5 to Xenial and Trusty, and wait for 2.1.7 to appear in Z and then start the backport.

--
You received this bug notification because you are subscribed to the bug report.
https://na01.safelinks.protection.outlook.com/?url=https%3a%2f%2fbugs.launchpad.net%2fbugs%2f1603581&data=02%7c01%7cdanis%40microsoft.com%7c7e8f549ffdd946a6da2208d3e24b62cf%7c72f988bf86f141af91ab2d7cd011db47%7c1%7c0%7c636100785813909774&sdata=jjhYvMGi9sqb1ok48hJMMTl5VW3ExyXSArC%2boWXn0Fw%3d

Title:
  Azure Linux Agent (WALA) 2.1.5 Released

Status in walinuxagent package in Ubuntu:
  Fix Released
Status in walinuxagent source package in Trusty:
  New
Status in walinuxagent source package in Xenial:
  New

Bug description:
  As discussed in an email, the Linux Agent (WALA) version 2.1.5 has now been signed off and is in Master now.

  Please find the details below of some of items built into this release :
  https://na01.safelinks.protection.outlook.com/?url=https%3a%2f%2fgithub.com%2fAzure%2fWALinuxAgent%2freleases&data=02%7c01%7cdanis%40microsoft.com%7c7e8f549ffdd946a6da2208d3e24b62cf%7c72f988bf86f141af91ab2d7cd011db47%7c1%7c0%7c636100785813909774&sdata=l85ffWuP8exvuAahYrpHj7ow1bFKFL27po5Hp8BiQxk%3d

  We would like you to take this version and test it within your images, please can you file any bugs in Github, as this is monitored by our dev team.

  If you have any questions please reach out to me directly or raise it through Github.

To manage notifications about this bug go to:
https://na01.safelinks.protection.outlook.com/?url=https%3a%2f%2fbugs.launchpad.net%2fubuntu%2f%2bsource%2fwalinuxagent%2f%2bbug%2f1603581%2f%2bsubscriptions&data=02%7c01%7cdanis%40microsoft.com%7c7e8f549ffdd946a6da2208d3e24b62cf%7c72f988bf86f141af91ab2d7cd011db47%7c1%7c0%7c636100785813909774&sdata=AAw%2fyiPl2VBOWk9KwXmDHa3%2bVicGgFBzCZ3dyNgbD1o%3d

Walinuxagent 2.1.5 is ready for testing on this Xenial public image:
https://josvaz.blob.core.windows.net/shared/Ubuntu-xenial-16_04-LTS-amd64-server-20161020-wala2.1.5-os-2016-11-03-644FF1D6.vhd

We have done some tests on our own and we have started the SRU process to incldue the package in xenial. But we would like you to take that image and test it as well.

Is that VHD image link enough?
or do you prefer a different way of sharing the test image with you?

We did not want to mix that on our production pipeline and get it confused with "official" dailies.

This is the debdiff from xenial, it has been tested from a PPA using both given regression cases.

Above debdiff code can be found in PPA:
https://launchpad.net/~josvaz/+archive/ubuntu/wala-2.1.5-xenial-backport

Debdiff updated to point to this public SRU bug
Again, tested from a PPA using both given regression cases.

Trusty backport PPA updated to:
https://launchpad.net/~josvaz/+archive/ubuntu/trusty-wala-backport

FTR, I asked for increased test case coverage to cover known past regressions. Details at: https://irclogs.ubuntu.com/2016/11/09/%23ubuntu-release.html#t08:39

Unsubscribed ~ubuntu-sponsors as uploads are in the queue.

Hello Daniel, or anyone else affected,

Accepted walinuxagent into xenial-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/walinuxagent/2.1.5-0ubuntu4~16.04.0 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

Walinux agent 2.1.5 is abilable for testing in this public test images:

Xenial:
https://josvaz.blob.core.windows.net/shared/Ubuntu-xenial-16_04-LTS-amd64-server-20161020-wala2.1.5-os-2016-11-03-644FF1D6.vhd

And also now for Trusty here:
https://josvaz.blob.core.windows.net/shared/Ubuntu_DAILY_BUILD-trusty-14_04_5-LTS-amd64-server-20161111-wala-1479131709-en-us-30GB

We have done some tests on our own and we have started the SRU process to include the packages in xenial & trusty. But we would like you to take that image and test it as well.

Is that VHD image link enough?
or do you prefer a different way of sharing the test image with you?

(We did not want to mix that on our production pipeline and get it confused with "official" dailies.)

Trusty debdiff from current trusty walinuxagent 2.1.3

The proposed package comes from the yakkety walinuxagent 2.1.5 package with no other chnages that the last changelog entry.

Xenial backput of walinuxagent 2.1.5 has passed the SRU tests according to:
https://wiki.ubuntu.com/walinuxagentUpdates

SRU Test Cases
These are automated tests:

1.) Build new cloud image with -purposed package
2.) Boot instance
3.) Confirm that instance provisioned
4.) Run standard tests and regression tests
5.) Repeat from step 2 for all other Azure VM Sizes.

Hi, we can test this, I have passed this bug to our dev team. thanks

Hi, we have tested the xenial package, this seems fine. thanks.

This bug was fixed in the package walinuxagent - 2.1.5-0ubuntu4~16.04.0

---------------
walinuxagent (2.1.5-0ubuntu4~16.04.0) xenial; urgency=medium

  * Backport yakkety version to xenial (LP: #1603581)

 -- Jose Luis Vazquez Gonzalez (Jose Vazquez) <email address hidden> Tue, 25 Oct 2016 13:45:46 +0200

The verification of the Stable Release Update for walinuxagent has completed successfully and the package has now been released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

Trusty debdiff from current trusty walinuxagent 2.0.16

The proposed package comes from the yakkety walinuxagent 2.1.5 package with oine change:

  [ Steve Langasek ]
  * Drop systemctl reference from ephemeral-disk-warning.conf, this command
    doesn't exist in trusty.

walinuxagent trusty backport test image has been refreshed:
https://josvaz.blob.core.windows.net/shared/Ubuntu_DAILY_BUILD-trusty-14_04_5-LTS-amd64-server-20161130-wala-1480614674-en-us-30GB

We aim for this image to enter proposed today as it has passed our manual tests.

Can Azure test this image as well?

Hi guys - we can test this.
Please note on a thread with Dan Watkins we need to have the Agent auto update enabled in waagent.conf, this is set to 'n' in 16.10, can this be changed for all, and before final public release into trusty and yakkety?

# Enable or disable self-update, default is enabled
AutoUpdate.Enabled=y
AutoUpdate.GAFamily=Prod

Ive sent info to Dan, happy to chat about this.

Thanks,

Hello Daniel, or anyone else affected,

Accepted walinuxagent into trusty-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/walinuxagent/2.1.5-0ubuntu4~14.04.0 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed.Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

Hi - I have just tried to test this, but I cannot see the package for trusty proposed, can you confirm it is there? I'm looking for the walinuxagent package.

Can you also let me know what we need to do to get the auto update enabled too? thanks

Hi Daniel,

I also had this problem earlier today, the source page was there but not the binary.

Dimitri & Steve fixed a dependency issue for me and I got the newly built amd64 package from proposed as expected. I am trying it on a test image as we speak.

Check out again, if you can't still get it from proposed images we might need to dig into why is that.

Our SRU tests passed but I will not mark as verified. We are to enable wala 2.1.5 autoupdates BEFORE we release 2.1.5 for trusty, so I need to update the package and re-upload to proposed.

For xenial we already released a 2.1.5, so will need to do a full SRU again with autoupdates on (same as for yakkety)

Marked verification-failed-trusty as this package version should not be released for trusty, instead we need to upload a new one with auto-update on.

Actually marked it verification-done-trusty. Talking to Dan it was clear that it will be less work at this point to get a trusty wala 2.1.5 out now and then diff the autoupdate on against it on the next SRU cycle.

Hi Guys,
Thank you for checking this out.

We really need this in, what is the difference in time in adding auto update compared to waiting for the next SRU cycle?

Thanks I

This bug was fixed in the package walinuxagent - 2.1.5-0ubuntu4~14.04.0

---------------
walinuxagent (2.1.5-0ubuntu4~14.04.0) trusty; urgency=medium

  * Backport to trusty (LP: #1603581)

  [ Steve Langasek ]
  * Drop systemctl reference from ephemeral-disk-warning.conf, this command
    doesn't exist in trusty.

 -- Jose Luis Vazquez Gonzalez (Jose Vazquez) <email address hidden> Thu, 01 Dec 2016 11:41:07 +0100

Hi Daniel,

It is difficult to quantify, but we decided to go on and release wala 2.1.5-0ubuntu4~14.04.0 cause:
- It had actually passed verification already.
- It introduced a delta we already verified and tested. If we threw away the package at this point next SRU will have to verify both the part already tested and the autoupdate on change.
- The previous package did NOT have autoupdate support at all, and xenial already is at 2.1.5 with autoupdates off.

This is now fix released, autoupdate neablement will happen on a separate tracking bug:
https://bugs.launchpad.net/ubuntu/+source/walinuxagent/+bug/1650522