MAAS

workaround critical apt acquire translations bug

Bug #1342292 reported by Dustin Kirkland 
10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
MAAS
Fix Released
Critical
Unassigned
Orange Box
Fix Released
Critical
Dustin Kirkland 

Bug Description

This happens in the field with MAAS frequently. When starting a node (or juju bootstrapping), the node will seemingly "hang" for hours. If you inspect the squid-deb-proxy logs, you'll learn, in fact, that apt in the node is hung acquiring translations.

mvo is working with us to help identify the solution from an apt or a squid-deb-proxy perspective.

However, a better hammer, from a MAAS perspective, is to disable translations by default. Please accept the patch/branch.

Thanks.
Dustin

Related branches

lp:~kirkland/maas/1342292
MAAS Maintainers: Pending requested
Diff: 11 lines (+1/-0)
1 file modified
contrib/preseeds_v2/curtin_userdata (+1/-0)
Revision history for this message
Dustin Kirkland  (kirkland) wrote :
Changed in maas:
importance: Undecided → Critical
status: New → In Progress
assignee: nobody → Dustin Kirkland  (kirkland)
Revision history for this message
Julian Edwards (julian-edwards) wrote :

The root cause is bug 1313576 so duping there

Revision history for this message
Jorge Castro (jorge) wrote :

Bug 1313576 is marked as fix released and we just ran into this issue on an orange box today, so I'm going to undupe this bug. Is there something else that could be causing this behavior?

Revision history for this message
Dustin Kirkland  (kirkland) wrote :

We hit this again last week on the Orange Box.

I have now added a patch to orange-box.deb which hacks the fix into /etc/mass/preseeds/curtin_userdata. It would be ideal if either:
  a) MAAS would carry this patch
  b) apt would somehow fix this problem

Until such time as (a) or (b) happen, the orange-box.deb will be carrying this:

--- /etc/mass/preseeds/curtin_userdata 2014-09-23 21:18:30 +0000
+++ /etc/mass/preseeds/curtin_userdata 2014-10-01 11:41:06 +0000
@@ -14,6 +14,7 @@
   driver_04_load: ["sh", "-c", "depmod && modprobe {{driver['module']}}"]
 {{endif}}
 late_commands:
+ lang: curtin in-target -- sh -c "/bin/echo 'Acquire::Languages \"none\";' > /etc/apt/apt.conf.d/99translations"
   maas: [wget, '--no-proxy', '{{node_disable_pxe_url|escape.shell}}', '--post-data', '{{node_disable_pxe_data|escape.shell}}', '-O', '/dev/null']
 {{if third_party_drivers and driver}}
   driver_00_key_get: curtin in-target -- sh -c "/bin/echo -en '{{key_string}}' > /tmp/maas-{{driver['package']}}.gpg"

Changed in orange-box:
status: New → Fix Released
importance: Undecided → Critical
assignee: nobody → Dustin Kirkland  (kirkland)
Changed in maas:
assignee: Dustin Kirkland  (kirkland) → nobody
Revision history for this message
Julian Edwards (julian-edwards) wrote :

Dustin, can you add some logs in here when you see it happen again. Ideally, the squid log and everything off the node that might be relevant.

Changed in maas:
status: In Progress → Triaged
Revision history for this message
Andres Rodriguez (andreserl) wrote :

This has been fixed as part of LP: #1474417

Changed in maas:
status: Triaged → Fix Released
status: Fix Released → Fix Committed
Andres Rodriguez (andreserl)
Changed in maas:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.