15:00 #startmeeting Weekly Ubuntu Foundations team 15:00 Meeting started at 15:00:11 UTC. The chair is bdmurray. Information about MeetBot at https://wiki.ubuntu.com/meetingology 15:00 Available commands: action, commands, idea, info, link, nick 15:00 #topic Lightning Round 15:00 echo $(shuf -e vorlon bdmurray doko sil2100 mwhudson juliank waveform slyon jawn-smith dbungert xypron ginggs schopin) 15:00 vorlon bdmurray slyon juliank doko mwhudson jawn-smith schopin xypron waveform dbungert sil2100 ginggs 15:01 vorlon: 15:01 hmm :) 15:01 might want to skip me for now 15:01 uploaded apport fixing a glibc 2.34 test failure 15:01 submitted MP regarding ubuntu-cdimage and Intel IoT images for focal only 15:01 sponsored wmanager for schopin 15:01 uploaded bionic SRU of update-notifier for LP: #1836475 15:01 Launchpad bug 1836475 in update-notifier (Ubuntu Bionic) "[SRU] update-notifier-common weekly cron job runs at the same time for all computers across the globe" [High, Fix Committed] https://launchpad.net/bugs/1836475 15:02 uploaded u-r-u for waveform fixing LP: #1936401 15:02 updated focal upgrade instructions at help.u.c 15:02 Intel IoT conversations / work 15:02 finishing the 20.04.3 release 15:02 Launchpad bug 1936401 in ubuntu-release-upgrader (Ubuntu Impish) "Migrate Pi users away from u-boot in impish" [Undecided, Fix Released] https://launchpad.net/bugs/1936401 15:02 sorting out my email configuration 15:02 retrospecting on Foundations work for 2021 15:02 ✔ done 15:02 slyon is out 15:02 I have been working on RISC-V secure boot 15:02 juliank: 15:02 I'm working on EFI boot management magic 15:02 There were some problems to solve in U-Boot resulting in a bunch of patches 15:02 (done) 15:03 https://lists.denx.de/pipermail/u-boot/2021-August/459054.html 15:03 Now I can build U-Boot with all security relevant variables inside 15:03 And it will check the signatures 15:03 Next is to setup shim 15:03 15:04 doko: 15:04 xypron: o/ remember that we're going in the order that bdmurray mentions at the beginning, after shuffle ^ 15:04 ok I'm ready whenever 15:04 - LP: #1939379, -march settings change, was: armv7-a, now armv7-a+fp 15:04 - fixed the libdeflate ftbfs on armhf properly, using armv8-a+simd+crc32 15:04 - LP: #1939413, packages not stripped on arm64, no idea yet why ... 15:04 - OpenJDK security updates prepared and built, handed over to the security 15:04 team 15:04 Launchpad bug 1939379 in gcc-11 (Ubuntu) "ARM kernel builds fail with GCC 11" [Undecided, Confirmed] https://launchpad.net/bugs/1939379 15:04 - dh-ada-library: https://bugs.debian.org/992241, no progress yet 15:04 Launchpad bug 1939413 in protobuf (Ubuntu) "/usr/lib/aarch64-linux-gnu/libprotobuf.a’ generated with LTO version 9.2 instead of the expected 11.0" [Undecided, New] https://launchpad.net/bugs/1939413 15:04 - LP: #1941710, the c-t-b builds produce a wrong libc.so for non-default 15:04 Debian bug 992241 in src:dh-ada-library "dh-ada-library ftbfs with mismatching gcc/gnat versions" [Important, Open] 15:04 Launchpad bug 1941710 in cross-toolchain-base (Ubuntu) "buggy libc.so created for non-default 32bit multlibs" [Undecided, New] https://launchpad.net/bugs/1941710 15:04 32bit multilibs, causing the gcc-N-cross-* packages failing to build 15:04 - OpenJDK 18 snapshot 15:04 - Attending some presentations at DebConf, Python BoF on Friday night 15:04 (done) 15:04 * aspectc++ regression with glibc 2.34. Actually needs an upstream patch in llvm-toolchain. Investigating other issues with this package now 15:04 * Re-write ubuntu-image in go * Thanks sil2100 for merging bootfs_steps PR. Also got snapd PR merged 15:04 * New PR opened for populate_prepare_partitions step 15:04 * More code re-organization 15:04 * Supporting field engineers with desktop image customization process 15:04 * 20.04.3 iso testing on Pi and RISC-V hardware 15:04 [done] 15:05 * glibc transition: 15:05 + fixed wmanager tests. LP: #1940816 15:05 Launchpad bug 1940816 in wmanager (Ubuntu) "Autopkgtest fail with glibc 2.34" [Undecided, In Progress] https://launchpad.net/bugs/1940816 15:05 + worked a lot on the systemd armhf failure, so far no luck. LP: #1940635 15:05 Launchpad bug 1940635 in systemd (Ubuntu) "systemd-networkd failing to acquire a DHCP6 lease from dnsmasq on armhf" [Undecided, New] https://launchpad.net/bugs/1940635 15:05 (done) 15:05 WaVeR: 15:05 sorry waveform 15:05 * Finished u-r-u quirk for migrating users from u-boot in impish (LP: #1936401) 15:05 * Investigated openzwave for glibc migration 15:05 * Focal .3 release ISO testing + JSON updates 15:05 * Working on tweaking some of the ISO test cases for next time (remove arm64 from pi2, add CM4, 400, etc.) 15:05 * Investigated possible serial console issues (probable hardware failure) 15:05 * Worked on sense-hat & sense-emu packaging for debian (just copyright checks) 15:05 Launchpad bug 1936401 in ubuntu-release-upgrader (Ubuntu Impish) "Migrate Pi users away from u-boot in impish" [Undecided, Fix Released] https://launchpad.net/bugs/1936401 15:05 * Pi meetings 15:05 * Take home test 15:05 (done) 15:05 * curtin: python3-apt conversion MP review in progress, will split out some 15:05 smaller chunks to simplify a bit 15:05 * ftbfs grep: - have a proposed upload (LP: #1940999), working with sponsor on 15:05 Launchpad bug 1940999 in grep (Ubuntu) "FTBFS against glibc 2.34" [High, Confirmed] https://launchpad.net/bugs/1940999 15:05 the details. There is a question on if we should continue to build without 15:05 using the grep included regex code - today that code is pulled in from glibc 15:05 instead, but the glibc version fails one of the grep unittests (where the 15:05 built-in regex code in grep does not fail - LP: #1940996) 15:05 Launchpad bug 1940996 in grep "test failure - test-regex" [Medium, In Progress] https://launchpad.net/bugs/1940996 15:05 * curl proposed-migration: start looking at the regressions, first is 15:06 alertmanager-irc-relay - but in my attempts to repro that issue I found a new 15:06 FTBFS 15:06 * autoinstall-generator: fix LP: #1926292, split out into a secondary issue a 15:06 different problem that is exposed when the first issue is not a factor 15:06 Launchpad bug 1926292 in autoinstall-generator "App does not work at all" [High, Fix Committed] https://launchpad.net/bugs/1926292 15:06 (LP: #1940856) 15:06 Launchpad bug 1940856 in autoinstall-generator "Handle multiline directives" [Undecided, New] https://launchpad.net/bugs/1940856 15:06 * focal: run thru 2 subiquity amd64 mandatory iso tests 15:06 (done) 15:06 sil2100: 15:06 * SRU reviews and releases 15:06 * NEW reviews 15:06 * DMB meeting (partially there) 15:06 * Ubuntu Core discussion 15:06 * 20.04.3: 15:06 - Lots of coordination 15:06 - Did a test install on my Nvidia-hardware, looked all goo 15:06 - Tweaks to the isotracker download links 15:06 - Generated changes list for .3, sorted the changes per categories (such wow, much manual) 15:06 - Coordinated a respin of just subiquity images, made sure no other changes got pulled in 15:06 - Verified arm64/armhf base tarballs 15:06 - Prepublished images 15:07 - ...and then published the images \o/ 15:07 - Archived all the previous point-releases 15:07 - Tweaked the archive-image script, adjusted publish-image-set for the new image sets 15:07 - Worked on some additional messaging (legacy server installer) 15:07 - Sent out announcements after proper e-mail setup, yay! 15:07 * Updated documentation regarding our CI/CD core snap setup (wiki) 15:07 * Added missing ESM PPAs to britney ESM, but didn't finish the production deployment *yet* 15:07 * ubuntu-image: 15:07 - Reviewed bootfs creation PR for William 15:07 - Started tweaking documentation on how to build custom classic preinstalled images 15:07 - Discussions about image customization 15:07 * Foundations retrospective preparation 15:07 * UC22 pipeline opening: 15:07 - Tweaked the UC22 pi gadget to build with the new base, finally! 15:07 - Fixed core22 to build on LP after latest changes got deployed by Colin 15:07 - UC22 pi images finally building, new core22 in edge 15:07 * Working with the snapstore team trying to figure out why core20 reviews cause reviewing tooling crashes 15:07 - Finally new core20 snaps are successfully getting uploaded! 15:07 * A few lines of code to the simplestreams support for cdimage 15:07 * Staffing discussions 15:07 * Started my +1 maintenance 15:07 * Looking into livecd-rootfs umount failures on UI CI again 15:07 (done) 15:08 ginggs: 15:08 * fixed fpc FTBFS with glibc 2.34 15:08 * +1 Maintenance, Monday through Wednesday 15:08 - sync'd delve/1.7.0-3 15:08 - found pcre2 needed a transition, uploaded fixed package and no-change rebuilds of reverse dependencies 15:08 - uploaded no-change rebuilds of rebuilds of ppp's reverse dependencies to complete transition 15:08 - looked at cod-tools autopkgtest failure on ppc64el blocking diffutils and curl, submitted MP for a hint, but we decided to add it to big_packages instead 15:08 - merged openmpi, uploaded to bileto, checked autopkgtest results and published 15:08 * finished up preparing strace upload to fix FTBFS, filed LP: #1941750 15:08 Launchpad bug 1941750 in strace (Ubuntu) "FFe: strace FTBFS with gcc 11 / glibc 2.34" [Undecided, New] https://launchpad.net/bugs/1941750 15:08 (done) 15:09 any questions on status? 15:10 I didn't go yet :) 15:10 * archive work: NBS, processing Debian removals (including old and unused gccs), NEW processing, kernel cleanup in focal-proposed 15:10 * license reviews for the ESM team 15:10 * interviewing 15:10 * trying to sort out breakage of ping (missing fscap) in armhf autopkgtest runners; ran instead into apparmor problems trying to build a new image 15:10 (done) 15:11 vorlon: do you have a link to the ping breakage thing for armhf ? 15:12 schopin: I think we have a jira card open for it now, with no details 15:12 FR-1639 15:13 okay, moving on 15:13 #topic Release Incoming Bugs 15:13 thanks, I'll glance at it, on the off chance it's related to my DHCPv6 problem. 15:13 and https://paste.ubuntu.com/p/2K2xqnBVm2/ 15:13 #link http://reqorts.qa.ubuntu.com/reports/rls-mgr/rls-ii-incoming-bug-tasks.html 15:13 schopin: if your dhcpv6 problem involves a binary on the system that should have an fscap and now does not, then yes :) 15:13 bug 1876034 15:13 Bug 1876034 in command-not-found (Ubuntu) "apt update crashes with 'KeyError: 'suite'' in cnf-update-db if index compression is enabled" [Medium, Confirmed] https://launchpad.net/bugs/1876034 15:14 I found this the other day and having command-not-found not work doesn't seem ideal 15:14 "if index compression is enabled" - is that something that happens by default? 15:15 juliank: ? 15:15 on Docker images I think it is default? 15:16 Oh right, I found this via the sponsor report because there is an MP 15:16 So it seems like a low hanging fruit 15:16 ok 15:16 We want a different fix where it uses apt-helper cat-file fwiw (I really should expose apt_pkg.FileFd) 15:17 "cat-file"? cows and cats? what's next? 15:17 pythons 15:17 gophers 15:17 juliank: Seriously though if there is a different fix can you comment on that somewhere? 15:18 lemurs 15:18 mutts. 15:18 indri surely? :) 15:18 bdmurray: It's not written, but it's trivial 15:19 bug 1865900 15:19 Bug 1865900 in apache2 (Ubuntu) "apache 2.4.29-1ubuntu4.12 authentication with client certificate broken" [Undecided, In Progress] https://launchpad.net/bugs/1865900 15:21 It looks like there is a python3-requests patch here which might solve the issue 15:22 mdeslaur: do you have anything to add about this bug? 15:23 let's leave that open and I'll check with marc 15:23 #link http://reqorts.qa.ubuntu.com/reports/rls-mgr/rls-hh-incoming-bug-tasks.html 15:23 that's empty 15:23 #link http://reqorts.qa.ubuntu.com/reports/rls-mgr/rls-ff-incoming-bug-tasks.html 15:24 bug 1917062 showed up during iso testing 15:24 Bug 1917062 in plymouth (Ubuntu) "Decryption passphrase prompt not displayed until escape is pressed (Xubuntu hirsute test case)" [High, Confirmed] https://launchpad.net/bugs/1917062 15:24 bdmurray: I don't see any progress in the upstream bug, so I don't think there's anything we can do... 15:25 oh, I didn't see the last comment 15:25 that's what I was looking at 15:26 During iso testing for 20.04.3 would the encryption passphrase have been tested with Ubuntu or something not Xubuntu? 15:28 If not could somebody test with Ubuntu and see if you have to press escape? 15:28 I think there is a test case for FDE 15:28 jawn-smith: could you investigate and maybe check it then? 15:29 comment #28 seems to have good repro steps 15:29 sure 15:29 jawn-smith, http://iso.qa.ubuntu.com/qatracker/milestones/425/builds/235539/testcases/1451/results seems to be the LVM+FDE test case 15:30 (for .3) 15:31 #topic Team proposed-migration report 15:31 #link http://people.canonical.com/~ubuntu-archive/proposed-migration/update_excuses_by_team.html#foundations-bugs 15:32 boost vs cmake: ginggs it looks like you've been triggering some retries of this recently, any insight? 15:33 no, I was trying to test each package against the version of boost in -proposed 15:34 ok 15:34 doko: from your side do you know anything about this? 15:34 no. can we remove boost1.71? 15:35 oh, is this not the current version? 15:35 there are some reverse-deps to sort out 15:35 libui-gxmlcpp5v5 python3-libcegui-mk2-0.8.7 vitis-ai-runtime:arm64 ? 15:35 snapcast, vitis-ai 15:35 but I can follow up I suppose 15:36 cmake also triggered llvm-toolchain-12 tests to fail, and a retry didn't fix it 15:36 can someone investigate this? 15:37 does this also show with llvm-13? if not, then maybe just ignore it 15:38 it apparently doesn't. but llvm-toolchain-12 is the one currently in main? 15:38 there is a new llvm-toolchain-12 in -proposed 15:38 (but not built everywhere yet) 15:38 is there a reason to think that fixes things? 15:39 I'd like someone to commit to follow up 15:39 doko: will you? 15:39 not me at this point 15:39 ok 15:39 ginggs: ? 15:40 i'll take a look 15:40 thanks 15:40 glibc has a few failing autopkgtests still 15:41 per discussion with mwhudson, the netplan.io is the only one that should be considered critical path, the others are believed to be bugs outside of glibc 15:41 aspectc++: not a glibc bug and can be addressed by removing the package; jawn-smith any other comments? 15:41 yes, mwhudson suggested to remove it 15:42 no, it appears to be llvm related rather than glibc so I'm fine with the removal 15:42 netplan.io: LP: #1940635 is filed by slyon. Who is following up on this one? 15:42 Launchpad bug 1940635 in systemd (Ubuntu) "systemd-networkd failing to acquire a DHCP6 lease from dnsmasq on armhf" [Undecided, New] https://launchpad.net/bugs/1940635 15:42 I am 15:42 ok, updating the bug assignee to match 15:42 jawn-smith, I saw you backporting a gcc patch. is this related? 15:43 in my ppa you mean? I thought it might be related but it turned out not to be 15:43 schopin: and the netplan and systemd test failures are the same root cause? 15:43 openzwave: waveform, any updates? otherwise we've confirmed this is removable 15:43 vorlon: very probably. 15:44 and r-cran-sys is confirmed to be an infrastructure problem (ping), not a bug in glibc or r-cran-sys 15:45 (apparently the testsuite still passed once on retry, so maybe one of the armhf runners has a non-buggy fs?!) 15:45 vorlon, I'd go ahead with removal -- found it fails to build under gcc-11 (which was already reported upstream, but sans fix), which was due to a call against a NULL object 15:45 waveform: ok 15:45 ok, removing 15:46 ok; there's also boost1.71 blocking zlib, which if I work out a boost 1.71 removal, goes away 15:47 zlib also blocked by the same llvm-toolchain-12 failure 15:47 and by vg 15:47 anyone want to dig into these zlib-triggered regressions? 15:47 slyon: can you take these? 15:47 didn't we ignore some vg failures before? 15:48 no idea 15:48 slyon is out for the week 15:48 slyon isn't here 15:48 ah 15:48 xypron: could you take a look at these zlib-related failures? 15:49 vorlon, why, these are same as for cmake 15:49 fwiw the zlib upload has only touched s390x-specific code paths 15:49 doko: the vg isn't 15:50 schopin: could be that something is misbuilt with the new toolchain though, so still needs investigated 15:50 that's "failure", not "failures" ;p 15:50 doko: fine :) 15:50 xypron: are you ok to look into the vg failure triggered by zlib? 15:50 agreed, just giving some pointers for whoever looks into it. 15:50 then we have a bunch of things blocked by glibc... 15:50 schopin: you uploaded the openssl that's blocked; are you following through on that or do you need someone else to? 15:51 some help would be nice 15:51 dbungert: can you help here? 15:51 I'm happy to start on that, but had assumed that I would be looking at curl regressions - what's your preference? 15:52 dbungert: ok, you can keep curl 15:52 OK 15:52 bdmurray: can you help with openssl? 15:52 I can certainly try 15:53 doko: binutils vs glibc, is that something you can follow up on? 15:53 boost1.74 is stuck in -proposed, I'm assuming that's mwhudson's 15:54 that's wrong trigger, didn't mwhudson propose to ignore that one for now? 15:54 doko: I didn't hear that from him; if it's the wrong trigger, can you follow up all the same to get it unstuck? 15:55 xypron: e2fsprogs has failing autopkgtests in -proposed, can you follow up on this and let us know if you need help? 15:56 e2fsprogs is in my backlog 15:56 is slyon back next week? we probably should leave systemd to him 15:56 vorlon ^ 15:56 xypron: thanks 15:56 ok sounds like slyon is still out next week 15:56 i wonder if systemd armhf is fcap too 15:57 waveform: could you take a look at systemd, then? 15:57 vorlon, ack 15:57 dbungert has curl 15:57 ack 15:57 juliank: could you look at icu vs boost? 15:57 xnox: yeah I had the same idea. 15:57 vorlon: I think I'm out of time 15:59 can anyone else look at icu vs boost? 15:59 the rest is kind of a mess, probably falls out from cleanup of systemd and a few other things so I'm not going to try to assign these out 15:59 ginggs: could you look at the systemd-triggered autopgktest regressions? 16:00 sure 16:01 ok 16:01 then let's stop there 16:01 bdmurray: 16:01 #topic AOB 16:01 I'm out tomorrow 16:01 and we are over time 16:02 so thanks everybody! 16:02 #endmeeting