Katello/Pulp3 Integration meeting

October 20, 2021

Overview

  • Katello Schedule
    • 3.18
      • pulpcore 3.7
      • pulp_rpm 3.11
    • 4.1 - May 2021
      • pulpcore 3.14
      • pulp_rpm 3.14
    • 4.2 branching ~August 2021
      • pulpcore 3.14
      • pulp_rpm 3.14
    • 4.3 branching 5-Nov 2021
      • Pulpcore 3.16
      • Pulp-rpm 3.17

Pulp

  • Pulpcore
    • Nothing to report
  • RPM
  • Migration
    • Nothing to report
  • Ansible
    • No updates
  • Pulp Container
    • Merged azure storage support
  • OSTree
    • adding cli support
    • Katello would love a new beta release - dkliban to drive
  • Pulp CLI
    • Prob do a 0.13 when ostree has landed

Katello

  • Pulp 3.15 appearing in nightly
    • release-pipeline fixes happening
  • Ostree upload work
  • Installer changes needed for core/3.16?
    • Pulpcore-selinux new version
    • If there are any 3.15-to-3.16 changes - LET JUSTIN KNOW!

QE

  • Waiting on snap 24 (should be final snap)
  • Automation failure fixes in preparation for GA
  • next-Z bz verification

Build Team

  • Snap24 Real Soon Now (™)

October 27, 2021

Overview

  • Katello Schedule
    • 3.18
      • pulpcore 3.7
      • pulp_rpm 3.11
    • 4.1 - May 2021
      • pulpcore 3.14
      • pulp_rpm 3.14
    • 4.2 branching ~August 2021
      • pulpcore 3.14
      • pulp_rpm 3.14
    • 4.3 branching ~Nov 2021

Pulp

  • Pulpcore
  • RPM
    • Comps.xml upload API in-progress
      • Requested by RHUI, does katello want to expose it?
    • RHEL 9 copy / depsolving support next on the list
    • 3.14.8, 3.16.1 going out today
      • Fix a sync issue with Amazon-hosted repos, and (for 3.16) a set of issues with sync optimization in combination with metadata mirroring
    • ACS Kbase in draft
  • Migration
  • Ansible
  • Pulp Container
  • OSTree
    • Another alpha went out earlier this week
      • Repository Modify API, commit-sha returned with refname
  • Pulp CLI
    • Nothing to report

Katello

  • Still working on getting 3.15 working in nightly
    • Install is green, upgrade issues being resolved
  • Buildteam 3.16 work starting
  • Ostree plugin packaged
  • Ostree upload work (lots of questions)
    • jjeffers to set up a mtg to discuss
  • ‘Ping’ will now report content app status

QE

Build Team

November 3, 2021

Overview

  • Katello Schedule
    • 3.18
      • pulpcore 3.7
      • pulp_rpm 3.11
    • 4.1 - May 2021
      • pulpcore 3.14
      • pulp_rpm 3.14
    • 4.2 branching ~August 2021
      • pulpcore 3.14
      • pulp_rpm 3.14
    • 4.3 branching ~Nov 2021

Pulp

Katello

QE

Build Team

  • No updates today

November 17, 2021 (November 10 skipped for PulpCon)

Overview

  • Katello Schedule
    • 3.18
      • pulpcore 3.7
      • pulp_rpm 3.11
    • 4.1 - May 2021
      • pulpcore 3.14
      • pulp_rpm 3.14
    • 4.2 branching ~August 2021
      • pulpcore 3.14
      • pulp_rpm 3.14
    • 4.3 branching ~Nov 2021

Pulp

Katello

QE

  • Automation Failure fixes for next-Z
  • Automation for closed loop bugs
  • next-Y snap delayed

Build Team

  • No report

Other Topics

  • 24 November mtg - CANCELLED, manymany ppl out on PTO next week

December 01, 2021 (24-Nov cancelled for PTOs)

Overview

  • Katello Schedule
    • 3.18
      • pulpcore 3.7
      • pulp_rpm 3.11
    • 4.1, 4.2
      • pulpcore 3.14
      • pulp_rpm 3.14
    • 4.3 ~Nov 2021
      • pulpcore 3.16(?)
      • pulp_rpm 3.16
    • 4.4?

Pulp

Katello

QE

  • No report

Build Team

  • No report

December 08, 2021

Overview

  • Katello Schedule
    • 3.18
      • pulpcore 3.7
      • pulp_rpm 3.11
    • 4.1, 4.2
      • pulpcore 3.14
      • pulp_rpm 3.14
    • 4.3 ~Nov 2021
      • pulpcore 3.16(?)
      • pulp_rpm 3.16
    • 4.4?

Pulp

Katello

QE

  • Next-X snap 1.1 preview/test
  • Next-Y automation failure fixes
  • Watching pulpcon pulp testing and adding feedback

Build Team

  • No report

December 15, 2021

Overview

  • Katello Schedule
    • 3.18
      • pulpcore 3.7
      • pulp_rpm 3.11
    • 4.1, 4.2
      • pulpcore 3.14
      • pulp_rpm 3.14
    • 4.3 ~Nov 2021
      • pulpcore 3.16(?)
      • pulp_rpm 3.16
    • 4.4?

Pulp

Katello

  • Switching to sync policy in review
  • Fix for content-migration (request-url-too-long)
  • Enhancing uploads thru katello-api (ostree)
  • Ostree working really well so far!

QE

  • Sat-next work in progress
  • Looking at cust-case-bugs for automatable cases

Build Team

  • No report

Other Topics

  • No more meetings in 2021
  • Happy New Year!
1 Like

January 05, 2022

Overview

  • Katello Schedule
    • 3.18
      • pulpcore 3.7
      • pulp_rpm 3.11
    • 4.1, 4.2
      • pulpcore 3.14
      • pulp_rpm 3.14
    • 4.3 ~Nov 2021
      • pulpcore 3.16(?)
      • pulp_rpm 3.16
    • 4.4?

Pulp

  • Pulpcore
    • Moving to github #soon - all other pulp-projects already migrated!
      • BZ sync will be affected
    • Working on backport-request/release process
  • RPM
    • Depsolving / Copy work re: ASML customer case expected
    • Memory consumption investigation, multiple different avenues being worked on
    • DistributionTree support
      • 3.11 and 3.14 getting backports
    • 3.17 will be released without ACS support
      • It is being pushed into 3.18 so that 3.17 can remain compatible with pulpcore 3.15
  • Migration
    • DistTree fixes affect 2to3 as well
      • Needs a code-change, expect another 0.11.z to fix
      • “Conflicting” trees - resolve via tweaking timestamps
      • next-prev-z going out end-of-month(ish) - to QE by 12-JAN
  • Ansible
    • No report today
  • Pulp Container
  • OSTree
    • No updates
  • Pulp CLI
    • No updates, still awesome
  • Move to github issues
    • Pulpcore only active project not yet migrated
    • Auto-link between bugzillas and ‘upstream’ not in place yet
    • Patience please while we iron out the process kinks!

Katello

QE

  • Busy with new Satellite: Planning for new test automation and fixing some UI tests due to changes in the new version.
    • Patternfly4 changes, etc
  • next-X feature testing
  • next-X BZ verification
  • current-Y BZ verification
  • prev-Y BZ verification

Build Team

  • No report

January 12, 2022

Overview

  • Katello Schedule
    • 3.18
      • pulpcore 3.7
      • pulp_rpm 3.11
    • 4.1, 4.2
      • pulpcore 3.14
      • pulp_rpm 3.14
    • 4.3 ~Nov 2021
      • pulpcore 3.16(?)
      • pulp_rpm 3.16
    • 4.4?

Pulp

Katello

  • ACS support being started, expect questions from iballou!
  • Support for on_demand for container

QE

  • next-X feature testing
  • next-X bz verification
  • Checking automation and signing off for curr-Y
  • prev-Y bz verification
  • More automation work w/ new UI infrastructure

Build Team

January 19, 2022

Overview

  • Katello Schedule
    • 3.18
      • pulpcore 3.7
      • pulp_rpm 3.11
    • 4.1, 4.2
      • pulpcore 3.14
      • pulp_rpm 3.14
    • 4.3 ~Nov 2021
      • pulpcore 3.16(?)
      • pulp_rpm 3.16
    • 4.4?

Pulp

Katello

  • Pulp 3.17 being built into rpms (may not make katello 4.4)
  • ACS work still ongoing, initial testing looks good

QE

  • prev-Y bz verification
  • next-X bz verification
  • next-X feature testing
  • Fixing automation failures

January 26, 2022

Overview

  • Katello Schedule
    • 3.18
      • pulpcore 3.7
      • pulp_rpm 3.11
    • 4.1, 4.2
      • pulpcore 3.14
      • pulp_rpm 3.14
    • 4.3 ~Nov 2021
      • pulpcore 3.16(?)
      • pulp_rpm 3.16
    • 4.4?

Pulp

Katello

  • ACS support underway (Ian)
  • Docker/podman push support, seeing issues, may need help (Justin)
    • Auth bug (to be filed)
    • client/server comm complaining - will bug ipanova or matrix #pulp-container
  • 3.17 RPMs still being built by packaging

QE

  • prev-Y automation signoff
  • next-X bz verification
  • next-X feature testing
  • Fixing automation failures

Build Team

  • 3.17 rpm-builds in progress
    • done #soon?

February 02, 2022

Overview

  • Katello Schedule
    • 3.18
      • pulpcore 3.7
      • pulp_rpm 3.11
    • 4.1, 4.2
      • pulpcore 3.14
      • pulp_rpm 3.14
    • 4.3 ~Nov 2021
      • pulpcore 3.16(?)
      • pulp_rpm 3.16
    • 4.4?

Pulp

  • Pulpcore
    • Query of PRs merged in the last week
    • Some backports, see query ^
    • More CI fixes as we improve our backporting process
    • One bugfix about cancelled tasks not being picked up
    • In progress, but not yet merged
      • Improved proxy testing
      • Ability to reroot /pulp/api/v3/
      • Issue-creation-template being created to improve issue-process
    • ggainey working on distribution tree import/export
  • RPM
    • RBAC effort will start this month
    • Katello to open an RFE to be able to export metadata (publications)
  • Migration
  • Ansible
    • 0.12.0 releasing today
      • Contains new signing features
    • Improved proxy testing underway
  • Pulp Container
    • Moving our tests away from dockerhub to github registry ( avoid docker pull limits CI is reaching)
    • 2.8.4 released ( manifest sync bugfix)
    • Container signing mvp more or less done, tests to follow
    • Wrapping up adding redis caching on requests
    • Working on adding cross-repository blob mount (docker push)
    • Working on removing InterrelateStage from the sync pipeline
    • Wrapping up transition to Roles (RBAC)
    • In the queue to look at adding support for PulpRemoteUserAuthentication (docker push)
      • Not (currently) urgent for katello
  • OSTree
  • Pulp CLI
    • Ability to work with a Pulp system that is rerooted

Katello

  • Initial ACS work under review (with file)
  • Success with docker push (one bug filed https://github.com/pulp/pulp_container/issues/558)
    • Need to think through workflow
    • Allow pre-creation?
    • On hold for now due to bugfixing
    • AI: ipanova/jsherrill to brainstorm workflows
  • Ryan giving presentation to CEE around ostree tomorrow
  • AI: dklliban/jsherrill to brainstorm upstream use-cases
  • Pulp_rpm ruby-bindings issue: openapi-gen-dep got bumped
    • Need to release a bindings-version w/ a lower faraday-version req
      • Allow 1.x and 0.7.13
    • Will definitely need testing support
    • VCR testsuite will catch problems
    • AI: Pulp to work w/ build-team ASAP

QE

  • next-Z bz verification
  • next-X bz verification
  • next-X feature testing
  • Fixing automation failures

Build Team

February 09, 2022

Overview

  • Katello Schedule
    • 3.18
      • pulpcore 3.7
      • pulp_rpm 3.11
    • 4.1, 4.2
      • pulpcore 3.14
      • pulp_rpm 3.14
    • 4.3, 4.4 ~Nov 2021
      • pulpcore 3.16(?)
      • pulp_rpm 3.16
    • 4.5 ~May 2022

Pulp

Katello

  • Adjusting remote sync timeouts to specify more specific timeouts
    • Curr dflt is too low
  • Meeting on Monday to talk through container push workflow, let me know if interested
  • Adding container exclude tags, defaulting to exclude source containers

QE

  • next-Z bz verification
  • next-X bz verification
  • next-X feature testing
  • Fixing automation failures

Build Team

February 16, 2022

Overview

  • Katello Schedule
    • 4.5 ~May 2022
      • Pulpcore 3.18(?)

Pulp

  • Pulpcore
    • Query of all changes from last week
    • 3.18 to release on Feb 22
      • New mgmt command to view publication contents
      • SQL deadlock fix merged and backported
      • Import/Export bugfix merged (not backported)
      • Variety of RBAC change (not significant to katello)
      • Scheduled tasks likely to be added to 3.18
        • Not user editable, only for plugin writers currently
      • Re-rooting feature available for pulp-content
        • Currently hard-coded to /pulp/api/v3/
        • Will be /api/v3/
        • Q: Can you change it on an existing system?
        • Comment: katello prob won’t care about this
  • RPM
    • Possible 3.17 migration bug, investigating (dalley)
      • 3.17.4 likely to come out this week if so
    • Update on memory consumption, call for feedback
      • Specifically - once changelog-limiting is available - need specifics on current-memory-use looks when under load/real-data scenarios
    • RBAC work in progress for 3.18
  • Migration
  • Ansible
    • We need @mdellweg invited here to report
      • done
    • Signature Uploads in-progress
    • API refactor in-progress
      • Primarily drop-in replacement
      • Will ease multi-repo context
      • Will be a few weeks before available
  • Pulp Container
    • Bunch of backports and releases 2.5, 2.8, 2.9 and 2.10
    • Looking at adding support for PulpRemoteUserAuthentication (docker push)
  • OSTree
  • Pulp CLI

Katello

QE

Build Team

February 23, 2022

Overview

  • Katello Schedule
    • 4.5 ~May 2022
      • Pulpcore 3.18(?)
        • Pulpcore 3.17 first
      • pulp_rpm 3.17

Pulp

  • Pulpcore
  • RPM
    • No changes needed for the migration issue discussed last week, Postgresql versions >= 12 unaffected, upgrading solves the problem
    • Work on BZs continues
  • Migration
  • Ansible
  • Pulp Container
  • OSTree
  • Pulp CLI

Katello

  • rpm/3.17 still “on the board”
    • [iballou] raise question about priority of this for next-X testing (pretty please)
  • prev-Y-related bugs
  • Migration-related Stuff (mostly UX)

QE

  • next-Z bz verification, snap-2 dropped
    • Unexpected failures being investigated
  • next-X bz verification
  • next-X feature testing
  • Fixing automation failures

Build Team

March 02, 2022

Overview

  • Katello Schedule

Pulp

  • Pulpcore
    • Query of all changes from last week
    • Releases for 3.18.1, 3.16.4, 3.17.4 (latter have MANY bugfixes)
    • Decreasing memory-use during sync in progress (see bmbouters for details)
    • Support of metalink URLs for remotes starting discussion - get your opinions in now!
  • RPM
    • 3.17.4 released
      • Fixes ruby bindings, one bugfix
    • BZ work continues
    • “Very close” to having “a” sync-memory mitigation ready
      • A few hundred megabytes per sync + improves the time by 60-120 seconds
      • Also pulpcore work in train for same
  • Migration
  • Ansible
  • Pulp Container
  • OSTree
  • Pulp CLI

Katello

QE

  • next-z bz verification, snap-2, most ppl done
  • nexy-Y bz verification snap 11
  • next-Y feature testing
  • Fixing automation failures

Build Team

March 09, 2022

Overview

  • Katello Schedule

Pulp

  • Pulpcore
  • RPM
    • 3.14.13 released yesterday
    • Working on a few issues reported on foreman forums
    • RBAC work continues, see ppicka for details
  • Migration
  • Ansible
    • ggainey to touch base w/ x9c4 RE adding lines here
  • Pulp Container
    • Support for cross repo blob mount is in
    • Support for upload of foreign layers is in
    • Support for manifest list push is in
    • Preparing for 2.11 release that will have content signing support plus mentioned features ^
    • Remote user auth fix is in, what branch do you want it backported to?
      • No need to backport, will take with core/3.18
    • Fixed a customer bug “ Can’t sync private repos from Azure registry”, what branch do you want it backported to? (2.8?)
  • OSTree
  • Pulp CLI

Katello

  • core/3.18 builds requested
  • “Move to core/3.17” has made it “on the board”
  • rpm/3.17 - in upstream, will be in next product snap
  • Working on client bindings update

QE

  • next-Z snap 1 tomorrow
  • prev-Y bz verification in progress for snap 2
  • next-X bz verification in progress for snap 12
  • next-X feature testing
  • Fixing automation failures

March 16, 2022

Overview

  • Katello Schedule

Pulp

Katello

  • How critical is https://github.com/pulp/pulpcore/issues/2327 ?
    • GA’ing Katello 4.4 would mean forcing people up to Pulpcore 3.16 through the EOL’ing of Katello 4.2
    • It’s Important
  • Permission requirements for /var/lib/pulp/media/* and /var/lib/pulp/tmp/* ?
    • Is 0750 okay?
    • 755 would work as well - owner needs to be “user who’s running pulp services”
      • Or 770, if apache/pulp

QE

  • next-Z snap 2 bz verification in progress
  • next-Y bz verification in progress for snap 13
  • next-Y feature testing
  • Fixing automation failures

March 23, 2022

Overview

  • Katello Schedule

Pulp

  • Pulpcore
    • Query of all changes from last week
    • Significant memory reduction bugfix merged, and being backported
      • 27% reduction in memory with EL7 on_demand sync and 5% less runtime
      • Backporting will be happening #soon
    • RemoteArtifact duplicate key error bugfix merged, and being backported
    • Pulpcore now publishes its bindings docs
      • Pulpcore Client
      • Should we publish ruby-bindings-docs as well?
        • “Handy”, more for new folk coming on
  • RPM
  • Migration
    • 0.11.10 released w/ one bugfix (511)
  • Ansible
  • Pulp Container
    • Released 2.11
    • post-release work happening
    • Sync-pipeline refactoring in progress
  • OSTree
  • Pulp CLI
  • Pulp-openapi-generator
    • patch to expose timeouts merged
  • Release cadence - we might pick a “release day” once per week
  • Query: how does katello setup auth-backends?
    • Taken up post-mtg

Katello

QE (In QE all hands, won’t make it in this meeting)

  • prev-Z snap 1 bz verification. Waiting on snap templatization before verification
  • curr-Z snap 3 bz verification in progress
  • nexy-Y bz verification in progress for snap 14
  • next-Y feature testing
  • Fixing automation failures

March 30, 2022

Overview

  • Katello Schedule

Pulp

  • Pulpcore
  • RPM
    • Memory improvements to be merged released imminently (finally)
      • Combined with some pulpcore improvements that Brian worked on, the biggest syncs stay under 0.9 gb of memory consumption, down from ~3.5 at the release of Sat 6.10
    • Working on other small fixes
    • RBAC work progressing/finishing ip
  • Migration
    • Should consider EOL for 2to3 (core/3.20?)
  • Ansible
  • Pulp Container
  • OSTree
  • Pulp CLI
    • No updates
  • Can we update the pulpcore version being used in Sat-Next-Y?
    • Where/with whom should we discuss this?
    • core/3.17 heading for katello/4.5
    • dkliban/dalley to work w/ iballou on what this implies

Katello

QE