Katello/Pulp3 Integration meeting

ggainey · September 15, 2021, 5:11pm

July 28, 2021

Pulp

Pulpcore

Bmbouter out August 2-29, ttereshc taking over as lead
3.15 pushed back to August 10 (tentatively)
- 3.15.0 - Pulp
- Dkliban release lead
3.7.7 has been released
- pulpcore · PyPI
- Contains just the tasking system assignment to dead worker backport
3.14.3 is released
- 3.14.3 - Pulp
How to support python 3.6 for z-stream releases
- Dev boxes can use the older version of the installer, e.g. 3.14
- Installer needs a branch created to support this
- The CI can be configured to using Python 3.6 for older branches
Alternate Content Source implementation still ongoing
- Current plan to deliver in 3.16
Variety of small-but-important fixes for Django 3.2 compatibility
- Handling deprecations
- Some queryset evaluation differences
- Postgresql connection reuse within coroutines is different
- Will be in core/3.15
- django/3.2 means no deb-10 support, just deb-11
SELinux fix/investigation coordinating by @mikedep333
Pulp2-selinux vs pulp3-selinux collision issue
- https://github.com/pulp/pulpcore-selinux/pull/36

RPM

3.14.0 is out
- Changelog — Pulp RPM Support 3.14.2 documentation
“Relative path problem” has PRs open, should be resolved in the next releases of pulp_rpm + pulpcore
- https://github.com/pulp/pulp_rpm/pull/2050
- https://github.com/pulp/pulpcore/pull/1513
3.13.z incorrect metadata problems are fixed in 3.14.0, repair script is ready and tested by Katello, instructions provided to users
- Issue #9107: filelists and changelog metadata is not parsed properly - Pulp saves incorrect filelists and changelog metadata and generates incorrect metadata - RPM Support - Pulp
More bugs being fixed, will start moving on to bugzillas
- Kickstart metadata
- dep-resolution
Working on 6.10 bugs affecting Pulp3 to Pulp2 sync

Migration

0.11.z release planned (mostly deb-related backports)
Testing bugfixes for RPM for pulp3 to pulp2

Ansible

No updates

Pulp Container

Working on the pulpcore 3.15 compatibility in preparation for 2.8 release
import/export got merged and it enables import/export of synced repos

OSTree

Lubos is implementing the upload use case. Story #8918: As a user, I can create a new repository by uploading an archive with OSTree commits - OSTree Support - Pulp
Will start working on CI next week
Slated for katello-4.3; katello might be able to start looking at it in a month(ish)

Pulp CLI

[david] Will look into ACS support after 3.16

Katello

Semi urgent issue found as part of pulpcore 3.14.3: Issue #9146: sync of file:// repos tries to move files from /var/lib/pulp/sync_imports/ - Pulp (files removed from ‘import/file:// sync dir’)
Further python (& generic) support being added (upload, unit removal, cv publish)
Ian tested the filelist/changelog repair script, thanks ian and dalley!
Odd edge case when migrating-while-publishing-CV
- Talk to ttereshc

QE

Lots of test-automation-writing for new features
QE has a selinux-enforcing test
- https://github.com/SatelliteQE/robottelo/blob/fe01c9051f625c7e72504ced2b2c8fbfb63c04b8/tests/foreman/sys/test_pulp3_filesystem.py#L32

Build Team

3.14.3 rpms signed, re-running pipelines
- Will work w/ jsherrill on pipeline failure
- https://github.com/theforeman/pulpcore-packaging/pull/198

ggainey · September 15, 2021, 5:11pm

August 4, 2021

Pulp

Pulpcore

3.15 on track for August 10
- 3.15.0 - Pulp
- Requires Python 3.8+ and django 3.2
- Foreman installer will need to generate db encryption key
  - Feature: Story #8192: Add code to pulpcore that uses the db key to encrypt fields - Pulp
    - Davis to open foreman issue
      - Feature #33210: Generate a db encryption key when installing pulp - Installer - Foreman
- Reclaim disk space feature
  - Story #8459: As a user I want to reclaim disk space for a list of repositories - Pulp
  - Plugins need to opt-in, per-content-type
- Non-blocking orphan clean up as well
  - Task #8824: Convert orphan cleanup into a non-blocking task - Pulp
SELinux BZ for 6.10 is in progress
Issue #9146: sync of file:// repos tries to move files from /var/lib/pulp/sync_imports/ - Pulp import from /var/lib/pulp/ moving files
- Fixed and will be backported to 3.14.4
Relative path problem, should be backported to 3.14 and 3.7

RPM

New release this week (maybe today), fixes for:
- Downloading from Amazon Linux repositories
- RHEL Pulp 3 to Pulp 2 sync
- Capable of sync poorly-formed repos
- Distribution tree metadata fixes
  - Some issues remain: Issue #9208: Published .treeinfo metadata not matching expectations (remaining issues) - RPM Support - Pulp
  - Priority? (justin - normal since we aren’t aware of any implications for users)

Migration

0.11.3 released
- Modular-errata fix included - should get into next-z
Investigating issues

Ansible

Galaxy v3 Deprecation migration
- Only handle latest repo versions?
- Justin says “This is fine.”

Pulp Container

2.8.0 is out (core/3.14, 3.15 compatible)
- Reclaim-disk-space is enabled (under 3.15)

OSTree

Finishing up the upload story
- Tests are written
- Finishing up CI setup
Will work on sync story next

Pulp CLI

No updates

Katello

Pulp 2 metadata repo cleanup script release upstream, going into N/N-1 downstream, old-version-keeping will be turned off in N
Still focused on downstream bug fixing

QE

Next-Y testing
Feature testing
Automation failure fixes
Highlight upgrade blockers:
- CU DB: Blocked (cust DB is only GREEN)
  - 1962462 – pulp3: Sat6.9 with pulpcore tasking system assigns task to a removed worker - POST
    - backport old-tasking-fix
  - 1989282 – In satellite upgrade, content switchover failed with status 1 Triaged - NEW - Reported yesterday
    - poss test-db-corruption
Normal upgrade: Completely Blocked
- Satellite upgrade blocked in Next-Y Snap11 due to new reported issues:
  - 1989378 – Pulp migration failed with " Katello::Errors::Pulp3Error: out of memory" Triaged - NEW - Reported yesterday
    - OOM
Capsule Upgrade RED

Build Team

Python3/EL8 upstream prep

ggainey · August 11, 2021, 6:12pm

August 11, 2021

Pulp

Pulpcore
- 3.14.4 released yesterday
  - Relative path problem fix (needs pulp_rpm 3.14.1 release)
    - Issue #8133: Same package from different repos yields error on sync - Pulp
    - https://bugzilla.redhat.com/show_bug.cgi?id=1985958
  - No longer tries to move files from sync_imports/
    - Issue #9146: sync of file:// repos tries to move files from /var/lib/pulp/sync_imports/ - Pulp
    - 1986996 – sync of file:// repos tries to move files from /var/lib/pulp/sync_imports/
- 3.7.z is planned to address relative path problem at migration time
  - Will require matching pulp_rpm backport
- 3.15 is postponed due to Django 3.2 compatibility concern (too many db connections being open)
  - Fix/optimization is on the way, but changes won’t be backported upstream
  - 3.14 will still work with Django 3.2 but it’s no longer advised to do so
  - Downstream will be able to backport the fixes if they choose to upgrade to Django 3.2 (likely would require backports for content plugins)
- Shared task resources will be in 3.16 (Satellite-Next or a downstream backport)
  - Poss into core/3.15 but be disabled
    - Needs hardening before turning it on for everyone
  - Plugins need code changes to support the feature
  - Affected workflow - concurrent copy from the same source repos
  - Story #9148: As a plugin writer i want to be able to share task resources for reading - Pulp
  - 1986356 – pulp3: independent CV publishes with same source repos content copy not concurrent
    - Currently aligned w/ Next-Y - is it really a must-have?
    - Ttereshc will take ques to triage-group
- PulpCon planning
  - Happening in early November
  - Think about topics you’d like to see (or give!)
RPM
- 3.14.1 coming today (hopefully)
  - Fix for syncing from Amazon Linux repos
  - Fixes for .treeinfo metadata
  - Relative path problem fix
  - Pulp 3 → Pulp 2 sync issue fixed
- No feature work, only bugfixes
- Depsolving BZs
  - 1934545 – pulp3: Content View publish with filters and depsolve=true generates assert failures
  - https://bugzilla.redhat.com/show_bug.cgi?id=1965942
- Issue #9230: Syncing kickstart trees with mirror=true does not properly include images in publication - RPM Support - Pulp
- Issue #9224: Pulp 3.14 - can't sync a repository because of a checksum - RPM Support - Pulp
Migration
- No updates apart from helping QE to investigate issues (upgrade testing)
Ansible
- No updates
Pulp Container
- 1981225 – Unable to sync docker images
- Needs eyes from Katello - may not be Pulp?
- Jsherrill to triage/re-assign as needed
OSTree
- Merged upload use case
- Starting work on sync workflow
- First-release “soon” (beta)
- dkliban/mcorr to work on fedoramagazine article on this work
Pulp CLI
- 0.11.0 release (see changelog)
Pulp discourse
- Announcement: Moving to Pulp Community Discourse · Discussion #86 · pulp/community · GitHub
- https://discourse.pulpproject.org/

Katello

Katello 4.2.rc1 in progress (with pulpcore 3.14)
Continued downstream bugfixing
Katello-upstream users looking fwd to delayed core/3.14 EL8 RPMs

QE

Pulp 3.14 Testing:
- Test results: Mostly Green!
- Pending issues:
  - Kickstarter sync to external capsule: https://bugzilla.redhat.com/show_bug.cgi?id=1992329, 1985122 – pulp3: sync of a file repo to an external capsule fails
  - Not all files are uploaded to a repo: 1985303 – Not all files are uploaded to a repository, no error is shown
Next-Z bz verification
- Ensure migration plugin runs in FIPS mode
  - Failed: 1929347 – pulp3: Ensure migration plugin runs in FIPS mode and respects the ALLOWED_CONTENT_CHECKSUMS configuraiton
- Filed: publishing cv threw an error and marked successful with no error in /var/log/messages: 1992699 – Publishing a cv threw an error and marked successfull with no error in /var/log/messages on a FIPS enabled system
Next-Y verification
Automation failures

Build Team

No updates

ggainey · August 24, 2021, 6:15pm

[6 days post-mtg, noticed that I hadn’t posted the minutes - apologies all]

August 18, 2021

Overview

Katello Schedule
- 3.18
  - pulpcore 3.7
  - pulp_rpm 3.10
- 4.1 - May 2021
  - pulpcore 3.14
  - pulp_rpm 3.14
- 4.2 branching ~August 2021
- 4.3 branching ~Nov 2021

Pulp

Pulpcore
- 3.15 release is postponed till next week
  - More work on db connections issue
- Issues with gunicorn
  - Premature cnx closing
  - Upload with concurrency 25+
  - Under investigation
- ACS progress
- FIPS fun : https://bugzilla.redhat.com/show_bug.cgi?id=1995175
RPM
- Focusing on
  - Issues with attached BZs (depsolving specifically at the moment)
  - Distribution tree issues
- Upstream discussions with DNF team
Migration
- ‘NoneType’ object has no attribute ‘url’ when migrating distribution tree content
  - Issue #8862: ‘NoneType’ object has no attribute ‘url’ when migrating distribution tree content - Migration Plugin - Pulp
- An issue with the incomplete publication from James
  - 1982542 – RefreshDistribution step fails with "publication":["Invalid hyperlink - Object does not exist."]
Ansible
- No updates
Pulp Container
- RBAC work in progress
- No other updates
OSTree
- Sync workflow continues - done #soon
- Needs testing w/ cloud.redhat.com
  - Will reach out to PM to arrange
Pulp CLI
- Working on ACS support

Katello

Continued bugfixing
- Remote update issue, now creating ‘test’ remotes
Alternate content source & Ostree planning continues
Ostree compatible with 3.15? - yes

QE

Pulp 3.14 Testing:
- Testing next-Y continues apace
- Pending issues:
  - Kickstarter sync to external capsule: 1992329 – Sync of a kickstart repo to the external capsule fails, 1985122 – pulp3: sync of a file repo to an external capsule fails
  - Not all files are uploaded to a repo: 1985303 – Not all files are uploaded to a repository, no error is shown
Dev investigating diff between snap 12 and snap 13 regarding export
next-Y bz verification
Automation failure fixes

Build Team

Prepping core/3.15 packaging work
Backports to core/3.7 rpm/3.11 may happen “soon” - Zach and Tanya to chat post-mtg

ggainey · August 25, 2021, 4:24pm

Overview

Katello Schedule
- 3.18
  - pulpcore 3.7
  - pulp_rpm 3.10
- 4.1 - May 2021
  - pulpcore 3.14
  - pulp_rpm 3.14
- 4.2 branching ~August 2021
- 4.3 branching ~Nov 2021

Pulp

Pulpcore
- 3.7.8 is released
  - Relative path fix for the pulp-2to3-migration use case
- 3.14.5 is released
  - Content app fixes
  - Sync performance regression fix
  - On_demand to immediate switch and import/export
  - Changelog — Pulp Project 3.14.5 documentation
- 3.15.0 is planned for tomorrow
  - Django 3 db connections issue is resolved
- ACS is closed to being merged (pulp_file now, pulp_rpm #soon)
  - Katello prob won’t think about integrating for a few months
  - Maybe get some “light” katello-dev workflow testing, as kind of UAT?
  - Recheckin in 2 weeks
RPM
- Focusing on
  - Issues with attached BZs (depsolving specifically at the moment)
    - 1965942 – pulp3: Sat6.9 with pulp-3 raises invalid depsolving warnings when publishing a CV with filters - warnings RE missing dependencies (PR waiting merge)
    - 1965936 – Huge memory usage when using CV filters in Sat6.9 with pulp-3 - memory use bz (help/patch under test)
    - 1934545 – pulp3: Content View publish with filters and depsolve=true generates assert failures - assert during depsolving/logging
    - https://bugzilla.redhat.com/show_bug.cgi?id=1995232 - postgres-cpu/explain bz
- 3.11.2 is released
  - Fixes for the pulp-2to3-migration case
- 3.14.2 is released
  - Requires pulpcore 3.14.5
  - Fixes
    - for kickstart repo sync in mirror mode
    - Syncing identical content in parallel
- Katello-repos def need rpm/3.11-current
  - Zach will invoke build-team@
Migration
- On and off with the incomplete publication issue, can’t reproduce
Ansible
- 0.9.1 is released
  - Issue #9250: improper validation when passing json as requirements yaml - Ansible Plugin - Pulp
  - Issue #9220: content_ansible_collection_versions_create endpoint requires a lot of fields from inside uploaded artifact - Ansible Plugin - Pulp
- Bindings version - Update pulp-ansible by fao89 · Pull Request #9577 · Katello/katello · GitHub
  - VCR tests will tell us if there’s an issue w/ bindings
  - Needs work - katello/fao89 will collab on getting it addressed
Pulp Container
- No update
OSTree
- No update
Pulp CLI
- ACS support in progress
  - Will be ready the same time as pulpcore/file/rpm (in 1-2 weeks)
Pulp Python
- 3.4.1 Released
  - Bugfixes and sha256 content filter
  - Changelog — Pulp python Support 3.4.1 documentation

Katello

Filed Issue #9292: race condition syncing repositories with the same tags results in bad data within the database - Container Support - Pulp (container sync race condition, bz linked)

QE

Final push to review bugs for beta, still working on test automation for new features.
From katello: 2 test-databases have been broken/corrupted in similar ways
- Is there backup/restore issue?

Build Team

Thanks for beta requirements, going into snap today
Prepping for 3.15 as soon as available to package

ggainey · September 1, 2021, 7:09pm

September 01, 2021

Overview

Katello Schedule
- 3.18
  - pulpcore 3.7
  - pulp_rpm 3.11
- 4.1 - May 2021
  - pulpcore 3.14
  - pulp_rpm 3.14
- 4.2 branching ~August 2021
  - pulpcore 3.14
  - pulp_rpm 3.14
- 4.3 branching ~Nov 2021

Pulp

Pulpcore
- Connection already closed issue in content app, aligned to 3.16
  - Issue #9276: Content app can have unusable/closed db connections - Pulp
  - If you run into is, please share a box with a reproducer
- Handling Content-Encoding better, in progress
  - Issue #9213: DNF gets wrong rpm download size, until package downloaded with curl, then works - Pulp
  - Maybe katello hack to download kickstart tree images with on_demand sync will no longer be needed
- Https proxy support, in progress
  - Story #9304: As a user, I can configure https proxy using https:// - Pulp
- 3.16 tentative release date - Sep-28
  - ACS
- https://github.com/pulp/community/ is archived, discussions are down
  - Actively trying out https://discourse.pulpproject.org/
RPM
- 1965936 – Huge memory usage when using CV filters in Sat6.9 with pulp-3 - memory use bz (help/patch under test)
- 1934545 – pulp3: Content View publish with filters and depsolve=true generates assert failures - assert during depsolving/logging
- https://bugzilla.redhat.com/show_bug.cgi?id=1995232 - postgres-cpu/explain bz
- Katello 4.1.2.1 - 404 error through content proxy due to incorrect location_href - Support - TheForeman
- 3.14.3 is released 31-AUG
Migration
- Incomplete publication fixed
- 0.11.4 released
- ‘NoneType’ object has no attribute ‘url’ when migrating distribution tree content
  - Issue #8862: ‘NoneType’ object has no attribute ‘url’ when migrating distribution tree content - Migration Plugin - Pulp
  - In progress
Ansible
- 0.10.0 is released (compatible with pulpcore 3.15)
  - Collection Deprecation is a content now
Pulp Container
- Issue #9292: race condition syncing repositories with the same tags results in bad data within the database - Container Support - Pulp - fixed and will be backported to 2.7.z
OSTree
- Upload and Sync are done. Will release a beta this week.
- Working on the repository version delete next.
- Trying to find out what Satellite users will need to do to sync from c.rh.c
Pulp CLI
- Options (e.g. --remote) will accept pulp href or name
  - Instead of having --remote and --remote-href
- 0.12 in release-planning

Katello

Still heavy bugfixing
Starting ostree soon - yes please
- Target sync/upload early
- Wait on delete - “coming soon”

QE

beta blocker testing
Automation failure fixes
Only one blocker for 3.14 testing left

Build Team

Ggainey to ask build-team to package newer libsolv for el7

goosemania · September 8, 2021, 7:26pm

September 8, 2021

Overview

Katello Schedule
- 3.18
  - pulpcore 3.7
  - pulp_rpm 3.11
- 4.1 - May 2021
  - pulpcore 3.14
  - pulp_rpm 3.14
- 4.2 branching ~August 2021
  - pulpcore 3.14
  - pulp_rpm 3.14
- 4.3 branching ~Nov 2021

Pulp

Pulpcore
- https proxy support
  - Story #9304: As a user, I can configure https proxy using https:// - Pulp
  - 1993917 – Syncing repositories with https proxy set ends with warning Katello::Errors::Pulp3 Error Only http proxies are supported
- ACS progress
- 3.14.6 is out
  - Content-Encoding headers issue Issue #9213: DNF gets wrong rpm download size, until package downloaded with curl, then works - Pulp
  - FIPS issue which prevented workers to even start Issue #9249: ValueError: _blake2 is not available in FIPS mode - Pulp
- To upgrade to 3.15 you’ll need this resolved
  - Task #9355: Create django 3.2 patch for Katello that allows md5 to be used even on FIPS systems - Pulp
    - Planned to deliver patch by Sept 17th to @Zhenech
RPM
- Solution for the depsolving issues (both time, memory, and errors) likely in hand, needs some more evaluation and testing first, but there is cause for optimism
- Syncing from mirrorlists seems broken (or perhaps just Amazon Linux repos), investigating: Issue #9328: repository metadata not getting published for some repos synced from a mirror list - RPM Support - Pulp
- Additional memory consumption improvements will be coming soon, waiting on createrepo_c
Migration
- SELinux issues
- ‘NoneType’ object has no attribute ‘url’ when migrating distribution tree content
  - Issue #8862: ‘NoneType’ object has no attribute ‘url’ when migrating distribution tree content - Migration Plugin - Pulp
  - Patch tested by katello user
Ansible
- Pulp_ansible planning to sync repo from git repos
  - Story #9344: [EPIC] As a user, I can sync content from git - Ansible Plugin - Pulp
- Pulp_ansible planning to add signing (tickets not yet written)
- Pulp_ansible planning to have CLI start auto-wrapping Role content as Collections (tickets not yet written)
Pulp Container
- 2.8.1 is out with the tags sync race condition fix
OSTree
- Working on the beta release today
- Compatible with 3.15+
Pulp CLI
- No updates

Katello

Pulp 3.15 needed for ostree development, rpms not available for another 1.5 weeks
- Investigated deploying a pulp-installer installation of pulp3 alongside a katello vm, documented instructions here: Pulp 3 Integration - Katello - Foreman
Switch away from multi-copy api for content view publishing unless dep solving

QE

Still have a blocker for the upcoming release:
- 1998291 – Change Puma defaults to match recommendations from Puma documentation - not Pulp
next Z-release bz verification
next Y-release bz verification
Automation failures

Build Team

No updates

ggainey · September 15, 2021, 4:55pm

September 15, 2021

Overview

Katello Schedule
- 3.18
  - pulpcore 3.7
  - pulp_rpm 3.11
- 4.1 - May 2021
  - pulpcore 3.14
  - pulp_rpm 3.14
- 4.2 branching ~August 2021
  - pulpcore 3.14
  - pulp_rpm 3.14
- 4.3 branching ~Nov 2021

Pulp

Pulpcore
- Working on a resolution to https://bugzilla.redhat.com/buglist.cgi?quicksearch=2003264, PR opened
- 3.16 planned for 28-SEP
  - On schedule
  - Will include ACS support
- Secure proxy work is ongoing
  - Coordination w/ aiohttp group ongoing, pretty successful so far
- Deadlock investigation getting much attention
RPM
- 3.14.4 releasing soon, maybe tomorrow. Fixes for:
  - Poor depsolving-enabled copy performance and memory use
    - 2003764 – CV-promotion with-filters causes pulp code to do repoclosure once per-rpm-copied, which is Very Nonperformant.
  - Fix a regression in mirrorlist support
  - Throw a sync error for rare repos that use an out-of-repo location_href if mirroring is enabled
- Temporarily shifting some attention back to Pulpcore as the issue count and severity has decreased
- Jsherrill to schedule a mtg to discuss mirrored-metadata-wrkflow “discoveries”
Migration
- 0.11.4 released
  - Backport #9372: Backport "‘NoneType’ object has no attribute ‘url’ when migrating distribution tree content" to 0.11.z - Migration Plugin - Pulp distribution tree migration fix
Ansible
- Proxy issue (TCP_DENIED/407) backported
  - 0.5.10 released
  - 0.7.4 to be released
  - Fully fixed on 0.10, partially fixed on 0.8 and 0.9
Pulp Container
- Investigation of concurrent-push issue continues
  - May affect any concurrent-content-upload?
OSTree
- Released alpha last week
  - 3.15-compatible
  - Katello will start looking into this #soon (jjeffers)
Pulp CLI
- ACS work ongoing
PulpCon!
- Incoming Nov-8 - would love to have presentations from katello/qe/build
- What would people like to see presentations on?
- PulpCon 2021 Call for Proposals

Katello

Probably need to discuss other aspects of 2003264 – clients connected to on_demand capsules will start getting 404s if the Satellite regenerates repository metadata in more detail with dralley, also related to signed metadata (mentioned above, will schedule a mtg)
James is going to start looking into ostree integration, discussions with pm are ongoing
- Workflow needs “a little bit of work”[™]

QE

Memory leak in puma that may impact beta:
- 1998259 – potential memory leak in puma
3.14 - new bz: 2004397 – Sync of a Kickstart repo to the N-1 capsule fails
- Pulp2 capsule syncing from pulp3 satellite
Finishing up Next-Z bz verification
- Verification takes A While due to nature of the bug
- https://bugzilla.redhat.com/show_bug.cgi?id=1962462
Test rcm-compose

Build Team

3.15 RPM progress
- Patch in-progress to support FIPS on Django-3.2
  - Task #9355: Create django 3.2 patch for Katello that allows md5 to be used even on FIPS systems - Pulp
- Need new version of openssl to relax pulpcore-3.15-req on python-crypto
- Build-team has some of its own issues to resolve
  - ‘Fun’ With SCL

ggainey · September 22, 2021, 4:17pm

September 22, 2021

Overview

Katello Schedule
- 3.18
  - pulpcore 3.7
  - pulp_rpm 3.11
- 4.1 - May 2021
  - pulpcore 3.14
  - pulp_rpm 3.14
- 4.2 branching ~August 2021
  - pulpcore 3.14
  - pulp_rpm 3.14
- 4.3 branching ~Nov 2021

Pulp

Pulpcore
- Task group responses Story #9380: As a plugin writer, I have machinery that can return a task_group from viewsets - Pulp (3.16)
  - The ACS refresh endpoints will return task groups instead of the parent task (3.16)
  - Also updated the import create endpoint in 3.16
    - Task #9382: Update import code to return a task group - Pulp
- PR submitted for deadlock BZ/issue
  - 1997623 – Capsule sync fails with duplicate key and deadlock
  - Issue #8750: Deadlock on rpm repository pulp2pulp sync - Pulp
  - Arranging for stress-testing of 3.14-backport on a RHUI-4 setup
- Pulpcore 3.16 released moved back to Oct 5, at the latest we will release on Oct 12
- Discussing backporting to all releases in-between, e.g. everything on 3.14.z should go into 3.15.z. Is this important?
  - “Could reduce future problems” - katello
- FIPS patches provided to build team. Still waiting for openssl resolution upstream.
- Secure Proxy is going well
  - Finalizing aiohttp/pulp work #soon (by end of month?) into aiohttp-3.7.last
    - If needed earlier - ping bmbouter for patch
  - Aiohttp-3.8 dropped py-3.6 support
RPM
- One particular microsoft RPM repo for RHEL 8 is known to cause very severe issues with Pulp
  - Basically unsyncable for two different reasons, one known, one unknown, both related to memory
  - May involve patching Pulpcore
  - Issue #9399: sync error: invalid memory alloc request size - RPM Support - Pulp
  - Issue #9406: Trivial OOM on sync for a particular Microsoft repo - RPM Support - Pulp
- 3.14.4 Release should (finally) go out today or tomorrow, got delayed last week due to emergent issues
Migration
- 1993951 – RPM1008: Checksum type "sha256" is not available for all units in the repository
- Under investigation, might be RPM not Migration
Ansible
- No updates
- How far back does Pulp need to support ansible clients?
  - There needs to be some discussion around support-expectations downstream, soon-ish
Pulp Container
- Working to 3.16 compat release
- Gunicorn-issue-miniteam looking to get reproducer
OSTree
- No updates
Pulp CLI
- 0.12.0 releasing in the next week or two
  - With ACS support

Katello

Ostree integration ongoing
- Hit issue with sync (Issue #9431: Sync tasks fail with the latest pulpcore version - OSTree Support - Pulp)
Better support for mirrored metadata (preventing shooting of feet)

QE

No updates

Build Team

3.15 continues apace

ggainey · September 29, 2021, 4:18pm

September 29, 2021

Overview

Katello Schedule
- 3.18
  - pulpcore 3.7
  - pulp_rpm 3.11
- 4.1 - May 2021
  - pulpcore 3.14
  - pulp_rpm 3.14
- 4.2 branching ~August 2021
  - pulpcore 3.14
  - pulp_rpm 3.14
- 4.3 branching ~Nov 2021

Pulp

Pulpcore
- 3.16 delayed to 12-OCT? – NO
  - Downstream dev-freeze coming in 1st week of November
  - Need to coordinate closely with build-team to go w/ this
  - Re-evaluation in progress - might go back to 5-OCT, stay tuned
- 3.14.7 incoming (deadlocks, remote-url-update, and other fixes)
- 3.15 behind on backports
  - Pulp/katello using 3.15, so might like updates?
  - AH wants 3.15 - so, make it happen
  - AI: someone in pulp needs to own backporting Things to 3.15 [dkliban]
- Secure proxy/aiohttp work
  - Bmbouter opening patch against downstream today
  - Prob evgeni to review
- Auth in URL bz 2007655 – Authorization repository causing invalid upstream url
  - We plan on not allowing credentials in the Remote URL.
  - Migration plugin will migrate URLs with auth as regular URLs and separate username and password fields on the remote
- Total counter increases during task execution 1994391 – Total steps for tasks increases
  - Closing wontfix
RPM
- 3.14.5 incoming
- One outstanding blocker issue (Auth in URL): Issue #9464: Regression: Syncing username+password authenticated remotes fails - RPM Support - Pulp
- Investigating reports that Kickstart doesn’t work - but it seems like these users are using pulp_rpm 3.10, and that it might work fine on 3.14. Would appreciate confirmation of this
  - Unable to kickstart Rocky Linux 8 due to .treeinfo - #4 by llandin - Support - TheForeman
  - Foreman failed to download metadata for repo 'AppStream': cannot download repomd.xml - Support - TheForeman
  - AI: Who can help dralley with testing? Alternately - ask users to upgrade-and-retest [jsherrill]
Migration
- 1993951 – RPM1008: Checksum type "sha256" is not available for all units in the repository capsule sync failure (pulp_rpm 3.14.5)
- https://bugzilla.redhat.com/show_bug.cgi?id=2006307 investigation of migration failure due to oom
- https://bugzilla.redhat.com/show_bug.cgi?id=2003888 documenttoolarge during migration (looking for reproducer for potential fix)
Ansible
- Git-sync in development (future work)
- Mdellweg joining the miniteam
Pulp Container
- Container-signing ongoing (future work)
OSTree
- Fixed a katello bug, patch tested
- Needs a release
Pulp CLI
- Wrapping up pulp_rpm ACS commands for 0.12.0
- 0.12 coming Real Soon Now
Thanks David Davis!

Katello

Ostree work continues
Bringing this up for discussion: Backport #9446: Backport #8133 "Same package from different repos yields error on sync" to 3.9.z - Pulp
- Was blocking 4.0/1/2
- Katello fwd-ported Things from 3.7 to 3.9
- Comes back to “should pulp backports go to All Releases”

QE

Next-Y bzs
Waiting on Next-Z build
Automation failures & fixes
3.14 bug verification happening/ed
- 2004397 – Sync of a Kickstart repo to the N-1 capsule fails

Build Team

Next-Y Stuff is Crazy-Making
Next-Z - not till next week
3.15 and SCL - Evgeni working on it, some dep-work still in flight

ggainey · October 6, 2021, 9:02pm

October 6, 2021

Overview

Katello Schedule
- 3.18
  - pulpcore 3.7
  - pulp_rpm 3.11
- 4.1 - May 2021
  - pulpcore 3.14
  - pulp_rpm 3.14
- 4.2 branching ~August 2021
  - pulpcore 3.14
  - pulp_rpm 3.14
- 4.3 branching ~Nov 2021

Pulp

Pulpcore
- 3.14.8 is released
  - https://bugzilla.redhat.com/show_bug.cgi?id=1993773
  - More investigation needed
- 3.16.0 released - installer will be released later today
  - Some plugins need compat releases, also today
RPM
- 3.14.6 is released
  - 2010207 – RHEL6.10 kickstart repo sync error "incompatible with 'mirror' sync"
- 3.16.0 will be released #soon
- Progress is being made on (re)adding a non-metadata mirror option, API design discussion ongoing: Story #9316: As a user, I can mirror the packages in a repo (kick out ones that are no longer in the upstream) without mirroring the metadata. - RPM Support - Pulp
- No solution yet for 2008602 – Katello::Errors::Pulp3Error: invalid memory alloc request size while syncing third-party repos
  - But as far as we know it’s just this one repo (the Microsoft one)
Migration
- Selinux changes merged that will help w/ 2to3
- Build team is aware
Ansible
- 0.10.1 was released
- Matthias (x9c4) and bmbouter will assume lead role
- Working on Automation Hub future features such as content signing
  - [ipanova]There is more than this feature that will be planned and it will involve both ansible and container plugins:
    - Content signing
    - Token auth
    - import/export
Pulp Container
- 2.9.0 is released with pulpcore 3.16 compat.
- Roles PRC POC continues
OSTree
- modify-API work in progress
Pulp CLI
- 0.12.0 going out today or tomorrow
  - Includes ACS commands for file and rpm (relies on core/3.16)
  - Katello to add card to test when time available

Katello

Ostree work ongoing, sync/indexing support merged, upload next up
Working on 3.15 support over the next ~week
- Packaging in progress, el7 works, el8 still has a couple of issues

QE

3.14 testing is completed
Ongoing next-Y bz verification
Received next-Z snap 1 yesterday
- Ongoing next-Z bz verification
Team resolving automation run problems for next-Z
Automation failure fixes (next-Y runs)
Note for build-team: https-proxy bugs will NOT work. Sad now.
- [original] not ready for verification 1993917 – Syncing repositories with https proxy set ends with warning Katello::Errors::Pulp3 Error Only http proxies are supported
- [a followup bug] not resolved yet 2011303 – Unable to sync content from CDN when using an HTTP proxy

ggainey · October 13, 2021, 7:52pm

October 13, 2021

Overview

Katello Schedule
- 3.18
  - pulpcore 3.7
  - pulp_rpm 3.11
- 4.1 - May 2021
  - pulpcore 3.14
  - pulp_rpm 3.14
- 4.2 branching ~August 2021
  - pulpcore 3.14
  - pulp_rpm 3.14
- 4.3 branching ~Nov 2021

Pulp

Pulpcore
- 3.16 release happened last week
RPM
- Lots of progress made on introducing a mirror mode without metadata mirroring
- Sync-optimization-problem being addressed
- 3.16.0 hopefully by Friday - will be compatible with pulpcore 3.15
  - Pulp_rpm 3.16 will be the active backport branch with pulpcore 3.15 compatibility rather than pulp_rpm 3.15
- Advisory conflict issue, in progress
  - 2013320 – CV publish fails with "get() returned more than one UpdateRecord" if multiple advisories with the same errata_id are requested to be published
  - Blocks verification of couple katello BZs
  - Patch available #soon
  - Discussion to continue post-meeting
Migration
- Nothing to report
Ansible
- Working on git-remote, collection-signing-planning
- Prob not katello-impacting
Pulp Container
- Adding support for azure storage backend
- Container image signing planning
- Prob not katello-impacting
OSTree
- Implementation on the ‘repository modify’ api is ongoing, done #soon
Pulp CLI
- 0.12 released

Katello

Ostree upload work ongoing
Katello 3.15 integration started (only 2 small changes noticed, deb class rename, and orphan cleanup timeout).
- Tests green, waiting on packaging (rhsm-pypi needed)
Next-Y Hackfest - good responses RE “how smooth 2to3 migration went”

QE

6.10 bz verification
- FIPS bit was not included in snap 22 so QE waiting on snap 23 to reverify FIPS bz
- New bz: 2013320 – CV publish fails with "get() returned more than one UpdateRecord" if multiple advisories with the same errata_id are requested to be published
next-Z bz verification
Automation failure fixes - in prep for next-Y-GA runs
~500 BZs verified for next-Y!

Build Team

FIPS will def be fixed w/ today’s snap
Star Wars trench run almost at the exhaust port!

ggainey · October 20, 2021, 3:54pm

October 20, 2021

Overview

Katello Schedule
- 3.18
  - pulpcore 3.7
  - pulp_rpm 3.11
- 4.1 - May 2021
  - pulpcore 3.14
  - pulp_rpm 3.14
- 4.2 branching ~August 2021
  - pulpcore 3.14
  - pulp_rpm 3.14
- 4.3 branching 5-Nov 2021
  - Pulpcore 3.16
  - Pulp-rpm 3.17

Pulp

Pulpcore
- Nothing to report
RPM
- PRs merged for sync optimization fix, content mirror without metadata mirror
- Investigating a set of related issues, may try to resolve them prior to 3.16 release
  - If not - rpm/3.16 today/tomorrow
- Will soon be investigating if any depsolving changes are needed to support RHEL 9 (static_context implications to copy() api)
- ACS moved to rpm/3.17
  - Need to insure rpm/3.17 is released prior to katello-4.3 dev-freeze
- Advisory-conflict fix backported to rpm/3.14.7 and released
  - 2013320 – CV publish fails with "get() returned more than one UpdateRecord" if multiple advisories with the same errata_id are requested to be published
Migration
- Nothing to report
Ansible
- No updates
Pulp Container
- Merged azure storage support
OSTree
- adding cli support
- Katello would love a new beta release - dkliban to drive
Pulp CLI
- Prob do a 0.13 when ostree has landed

Katello

Pulp 3.15 appearing in nightly
- release-pipeline fixes happening
Ostree upload work
Installer changes needed for core/3.16?
- Pulpcore-selinux new version
- If there are any 3.15-to-3.16 changes - LET JUSTIN KNOW!

QE

Waiting on snap 24 (should be final snap)
Automation failure fixes in preparation for GA
next-Z bz verification

Build Team

Snap24 Real Soon Now (™)

ggainey · October 27, 2021, 3:46pm

October 27, 2021

Overview

Katello Schedule
- 3.18
  - pulpcore 3.7
  - pulp_rpm 3.11
- 4.1 - May 2021
  - pulpcore 3.14
  - pulp_rpm 3.14
- 4.2 branching ~August 2021
  - pulpcore 3.14
  - pulp_rpm 3.14
- 4.3 branching ~Nov 2021

Pulp

Pulpcore
- 3.17.0 release scheduled for Nov 16
- Content app db connection issue should be fixed soon as part of 3.14.9 Issue #9515: content app doesn't survive PostgreSQL disconnect in pulpcore 3.14.7 - Pulp
RPM
- Comps.xml upload API in-progress
  - Requested by RHUI, does katello want to expose it?
- RHEL 9 copy / depsolving support next on the list
- 3.14.8, 3.16.1 going out today
  - Fix a sync issue with Amazon-hosted repos, and (for 3.16) a set of issues with sync optimization in combination with metadata mirroring
- ACS Kbase in draft
Migration
- QE found a FIPS-migration blocker
  - Patch for createrepo_c needed (thanks dalley!)
  - https://bugzilla.redhat.com/show_bug.cgi?id=2017489
Ansible
Pulp Container
OSTree
- Another alpha went out earlier this week
  - Repository Modify API, commit-sha returned with refname
Pulp CLI
- Nothing to report

Katello

Still working on getting 3.15 working in nightly
- Install is green, upgrade issues being resolved
Buildteam 3.16 work starting
Ostree plugin packaged
Ostree upload work (lots of questions)
- jjeffers to set up a mtg to discuss
‘Ping’ will now report content app status

QE

next-Z FIPS issue:
- https://bugzilla.redhat.com/show_bug.cgi?id=2017489
- Coordinate w/ zhunting on new createrepo_c build to retest
next-Y bz verification
Automation failure fixes

Build Team

ggainey · November 3, 2021, 3:50pm

November 3, 2021

Overview

Katello Schedule
- 3.18
  - pulpcore 3.7
  - pulp_rpm 3.11
- 4.1 - May 2021
  - pulpcore 3.14
  - pulp_rpm 3.14
- 4.2 branching ~August 2021
  - pulpcore 3.14
  - pulp_rpm 3.14
- 4.3 branching ~Nov 2021

Pulp

Pulpcore
- dkliban is now the Satellite Liaison!
- Pulpcon next week
  - Would be cool to have updates form katello
- 3.17 release slated for the week of the 15th
- Chunked-uploads bug - will be backported to 3.14
  - Issue #9550: Ensure correct tmp location is used when reconstructing chunked uploads - Pulp
RPM
- 3.16.1 released
- Will be focusing on:
  - Ensuring compatibility with RHEL 9
  - Reducing memory consumption during sync
Migration
- Nothing to report
Ansible
- No updates
Pulp Container
- No updates
OSTree
- Fixing some bugs (ref/commit required)
  - https://github.com/pulp/pulp_ostree/issues/140
- Will release once fix is avail
Pulp CLI
Pulp-selinux-1.2.7 released
- Squid, http-proxy support

Katello

Ostree upload work continues, sample small tarball to test with for automation?
- Work w/ dklliban, lmjachky
Ran integration tests with 3.16, all green, no changes needed in katello.
- Waiting on builds
Wanted to raise 2018888 – Actions::Pulp3::CapsuleContent::RefreshDistribution fails with NoMethodError: undefined method `pulp_href' for nil:NilClass likely a dupe, may not need any action

QE

next-Z testing
- Verified: 2017489 – Migration fails when migrating content with FIPS mode enabled (createrepo_c)
- New BZ: 2019563 – Missing fields on MD5 repos in repomd.xml on a FIPS enabled satellite
  - Looks like FIPS-mode is broken in Pulp2-2.21.5
- Failed: 1970246 – Publishing a repository in Capsule can take more than an hour to finish if many cloned repositories have been synced to the Capsule
  - Vlad, pmoravec working together on this
  - Hchen has submitted a pair of PRs for this
- Troubleshooting with ggainey on FIPS on pulp2
  - What if we downgrade to pulp-2.21.4 and retest?
  - Jsherrill to work with ltran
Automation failure fixes

Build Team

No updates today

ggainey · November 17, 2021, 7:54pm

November 17, 2021 (November 10 skipped for PulpCon)

Overview

Katello Schedule
- 3.18
  - pulpcore 3.7
  - pulp_rpm 3.11
- 4.1 - May 2021
  - pulpcore 3.14
  - pulp_rpm 3.14
- 4.2 branching ~August 2021
  - pulpcore 3.14
  - pulp_rpm 3.14
- 4.3 branching ~Nov 2021

Pulp

Pulpcore
- Bulk-task-delete in progress : Story #8554: Provide easy task cleanup api - Pulp
  - https://github.com/pulp/pulpcore/pull/1721
  - https://github.com/pulp/pulp-cli/pull/431
- Discussion about plugin API deprecation policy changing to have 3.20 be the next breaking release
- 3.17 scheduled for Nov 23rd
RPM
- RHEL9, static_context modules, advanced use
  - We may be in “no changes needed” territory
- RHEL8, static_context will not happen (whew)
- Oracle Linux sync and memory issues (dralley investigating)
Migration
- 0.11.6 in progress
  - SLES related Issue #9254: Pulp 2to3 Migration of SLES repositories does not work correctly - Migration Plugin - Pulp
  - Errata batch size issue Issue #9451: Set bach_size to mitigate query result exceeding 16mb - Migration Plugin - Pulp
Ansible
- Z-stream fixes for GalaxyNG Gang
- git-sync work continues
- Collection-signing implementation in progress
Pulp Container
- Content-signing planning is finishing up
OSTree
Pulp CLI

Katello

3.16 close to being done packaging wise, pulling it in should be quick
Ostree upload nearing completion
Rhel 9 testing
- Issue #9570: RHEL 9 beta contains one module stream, but it isn't imported into pulp - RPM Support - Pulp (maybe related to Story #8741: Full support for "static_context" in modulemd documents - RPM Support - Pulp ?)
- No luck reproducing against master or core/3.14, see issue for notes

QE

Automation Failure fixes for next-Z
Automation for closed loop bugs
next-Y snap delayed

Build Team

No report

December 01, 2021 (24-Nov cancelled for PTOs)

Overview

Katello Schedule
- 3.18
  - pulpcore 3.7
  - pulp_rpm 3.11
- 4.1, 4.2
  - pulpcore 3.14
  - pulp_rpm 3.14
- 4.3 ~Nov 2021
  - pulpcore 3.16(?)
  - pulp_rpm 3.16
- 4.4?

Pulp

Pulpcore
- 3.7.9, 3.15.3 released yesterday
  - 3.15 download-everything-always regression fixed
- 3.17 delayed - go/nogo today, currently next week? (but prob not)
- Plugins coming out soon will declare compat with up to 3.19 which should allow upgrades of a single component, e.g. just pulpcore without compatibility issues
  - Increasing Pulpcore Compatibility with Plugin Versions | software repository management
- Bulk delete of task records is on-track to be included in 3.17
RPM
- Two investigations in-progress:
  - Memory-consumption
    - Following up on foreman issue
  - Distribution-tree fun
    - Issue #9566: Create better primary keys for subtrees - RPM Support - Pulp
      - See the scenario when the issue pops up, not sure if it affects katello
      - Is backport needed? (has an impact on implementation)
    - Issue #9583: Distribution tree uniqueness constraint is not enough for a suboptimal .treeinfo - RPM Support - Pulp
      - ATIX sees the issue often with pulp-2to3-migration
      - CentOS 8 and Alma 8 are affected (RHEL is fine)
      - Conversations with centos folks about the way they generate treeinfos
      - No reports except from 2to3 - why sync isn’t complaining?
Migration
- 0.11.6 is out
  - Customers started hitting the errata issue, consider for next-Y
    - 2003888 – The Pulp 2 to Pulp 3 migration stucks and raises 'pymongo.errors.DocumentTooLarge' error in /var/log/messages
Ansible
- Import Collections from Git continues
- Long-term effort to consolidate the APIs between GalaxyNG and pulp_ansible starting in Jan
- Collection signing is in-progress
  - Will sign all unsigned content in a repo or specific collections. Signatures are content. Will sync signatures also. CLI is getting verification capabilities
  - https://github.com/pulp/pulp_ansible/pull/754
Pulp Container
- 2.8.2 and 2.9.1 are out
- Main focus is container signing feature
  - NET 2.11+
  - Jsherrill to add backlog item for full katello support, ticket for PM radar
- Roles for pulp-container
- Adding redis caching for image pull requests
OSTree
- No updates
Pulp CLI
- Adding full pulp_container support
Infrastructure
- Most pulp- components are now using ‘main’ as default, not master

Katello

Upgraded to 3.16 in nightly, katello 4.3 rc 2 (first downstream snap)
- Double-download-issue needs a backport request
  - Issue #9542: Repositories with packages in common (same hash) redownload the file even if it is already in the artifact folder - Pulp
Integration with repo cleaning in review

QE

No report

Build Team

No report

ggainey · December 8, 2021, 5:18pm

December 08, 2021

Overview

Katello Schedule
- 3.18
  - pulpcore 3.7
  - pulp_rpm 3.11
- 4.1, 4.2
  - pulpcore 3.14
  - pulp_rpm 3.14
- 4.3 ~Nov 2021
  - pulpcore 3.16(?)
  - pulp_rpm 3.16
- 4.4?

Pulp

Pulpcore
- 3.17 to release Dec 14th
- Bulk-task delete is merged to be included in 3.17.0
- Hoping to migrate pulpcore issues to github.com/pulp/pulpcore/issues/ next week after 3.17.0 release
- Removing some APIs for managing ContentGuard permissions
- Telemetry working group starting in Jan
  - Proposal: Telemetry
RPM
- Working to improve sync memory-consumption
  - Mostly happening in createrepo_c land
- Distribution-tree fun
  - Issue #9566: Create better primary keys for subtrees - RPM Support - Pulp (continued from last week)
    - Does this scenario impact Katello? Is a backport needed? (has an impact on implementation)
    - Likely yes?
  - Issue #9583: Distribution tree uniqueness constraint is not enough for a suboptimal .treeinfo - RPM Support - Pulp (continued from last week)
    - No change
Migration
- 0.11.7 is out
  - Includes a fix for importer migration on re-runs Backport #9612: Backport #8968 "'NoneType' object has no attribute 'delete'" during migration to 0.11.z - Migration Plugin - Pulp
- Pulp_deb working on deb-2to3
  - ttereshc to share diffs w/ katello
Ansible
Pulp Container
- 2026277 – null value in column "manifest_id" violates not-null constraint error while syncing RHOSP container images
  - 1. source containers can be a problem, including rate limiting
    - 1845471 – [RFE] Add ability to opt out of mirroring source containers.
    - To exclude source container use exclude_tags = [‘latest’, ‘*-source’]
  - 1. Refactor #9424: Remove the interrelate stage from the sync pipeline - Container Support - Pulp
  - Discussion around how katello/pulp3 could cooperate on how to exclude src-containers
OSTree
Pulp CLI

Katello

Switching to sync policy in progress
- May backport downstream-only? Maybe?
- “Let’s backport correctly” seems to be the consensus
Adding ostree testing to nightly/release pipeline
Tried out new openapi version bindings, failed to build properly
- Issue #9619: OpenAPI schema for ModulemdDefault is incorrect - RPM Support - Pulp
Question: https://bugzilla.redhat.com/showhttps://bugzilla.redhat.com/show_bug.cgi?id=2024963_bug.cgi?id=2024963

QE

Next-X snap 1.1 preview/test
Next-Y automation failure fixes
Watching pulpcon pulp testing and adding feedback

Build Team

No report

ggainey · December 16, 2021, 2:20pm

December 15, 2021

Overview

Katello Schedule
- 3.18
  - pulpcore 3.7
  - pulp_rpm 3.11
- 4.1, 4.2
  - pulpcore 3.14
  - pulp_rpm 3.14
- 4.3 ~Nov 2021
  - pulpcore 3.16(?)
  - pulp_rpm 3.16
- 4.4?

Pulp

Pulpcore
- 3.17 is out
  - It has the bulk deletion for tasks endpoint in it here
  - PulpImport /tmp usage also fixed
- Moving from pulp.plan.io to github issues soon, maybe this week, maybe Jan
RPM
- No significant updates from last week
- Backport releases will go out soon for 3.14 and 3.16 streams
- ttereshc is working on 2027127 – Pulp 2 to 3 migration fails on certain repos during the upgrade with FileNotFoundError: [Errno 2] No such file or directory: '' in prepare_metadata_files
Migration
- Shared pulp_deb contributions with katello, anything need from pulp side?
Ansible
- No updates
Pulp Container
- 2.10.0 is out, compat with pulpcore 3.17
  - Has Azure support and rate_limit option on remote
- Sync will download container signatures by default if sigstore is provided or registry natively supports signatures extensions api - starting with 2.11 version
OSTree
Pulp CLI

Katello

Switching to sync policy in review
Fix for content-migration (request-url-too-long)
Enhancing uploads thru katello-api (ostree)
Ostree working really well so far!

QE

Sat-next work in progress
Looking at cust-case-bugs for automatable cases

Build Team

No report

January 05, 2022

Overview

Katello Schedule
- 3.18
  - pulpcore 3.7
  - pulp_rpm 3.11
- 4.1, 4.2
  - pulpcore 3.14
  - pulp_rpm 3.14
- 4.3 ~Nov 2021
  - pulpcore 3.16(?)
  - pulp_rpm 3.16
- 4.4?

Pulp

Pulpcore
- Moving to github #soon - all other pulp-projects already migrated!
  - BZ sync will be affected
- Working on backport-request/release process
RPM
- Depsolving / Copy work re: ASML customer case expected
- Memory consumption investigation, multiple different avenues being worked on
- DistributionTree support
  - 3.11 and 3.14 getting backports
- 3.17 will be released without ACS support
  - It is being pushed into 3.18 so that 3.17 can remain compatible with pulpcore 3.15
Migration
- DistTree fixes affect 2to3 as well
  - Needs a code-change, expect another 0.11.z to fix
  - “Conflicting” trees - resolve via tweaking timestamps
  - next-prev-z going out end-of-month(ish) - to QE by 12-JAN
Ansible
- No report today
Pulp Container
- Finished planning for sync pipeline refactor to address this BZ 2026277 – null value in column "manifest_id" violates not-null constraint error while syncing RHOSP container images
  - next-Z if possible? (27-Jan-ish)
- Container image Signing effort ongoing - current top prio
OSTree
- No updates
Pulp CLI
- No updates, still awesome
Move to github issues
- Pulpcore only active project not yet migrated
- Auto-link between bugzillas and ‘upstream’ not in place yet
- Patience please while we iron out the process kinks!

Katello

‘Sync policy’ now implemented (as “mirroring policy”), will likely be backported to current-downstream
https-proxy/aiohttp changes
- Might be a problem still? Under investigation
- 1993917 – Syncing repositories with https proxy set ends with warning Katello::Errors::Pulp3 Error Only http proxies are supported

QE

Busy with new Satellite: Planning for new test automation and fixing some UI tests due to changes in the new version.
- Patternfly4 changes, etc
next-X feature testing
next-X BZ verification
current-Y BZ verification
prev-Y BZ verification

Build Team

No report