Pulpcore Meeting Minutes

April 18

  • Weekly release check-in
    • pulpcore
      • [ ] 3.24
      • [X] 3.23
      • [ ] 3.22
      • [ ] 3.21
      • [ ] 3.18
      • [ ] 3.16
    • pulp_file
      • [X] 1.14
  • Django 4.2 updates
  • move from Twitter to mastodon? (fosstodon.org maybe?)
    • AI: [ggainey] bring up at Team mtg next week
  • https://github.com/pulp/pulpcore/issues/3710 needs discussion
    • Labels? - not available at repo-version level
      • maybe start w/ Labels, and see how far we can get?
    • AH/repo-mgt - already talked about repo-group concept?
      • Pulp2 had something like
    • What about repo-version being a piece of content that could be held by a repository? (RepoCeption!)
      • need a content-object that is-a repo-version?
    • plugin implications?
  • Docs issue in plugin CI’s
    • plugin docs-build (pulp_file for sure)
    • we install pulp “outside” the container
    • conflicts w/ cli/glue, pip-installing, plugin-vs-core docs-requirements conflicts
    • have a bandaid in-place(ish) for core
    • need some thought on how to fix the problem “appropriately”
    • root-cause(ish): plugin-doc-build requires pulpcore-doc-requirements-install, and then plugin-doc-requirements-install, and core can therefore break the plugins w/out knowing
    • AI: [mdellweg] to investigate better workaround in template
    • AI: [ggainey] report back on any breakage in today’s pulp_file release (attempt)
1 Like

April 25

2 Likes

[missed posting some minutes, catching up here]

May 2nd

  • Weekly release check-in
    • pulpcore
      • [X] 3.24
      • [X] 3.23
      • [ ] 3.22
      • [ ] 3.21
      • [ ] 3.18
      • [ ] 3.16
    • pulp_file
      • [ ] 1.14
  • core/3.24
  • Let’s nail down what cadence we will use as “number of Y-releases without breaking changes”
    • see previous notes Pulpcore team meeting - HackMD
    • suggestion: core/3.40 (15 versions post-3.25)
      • “probably” six-months-ish
      • see how well this works/revisit at that point
  • With the new release policy, is it still useful to have tests for new pulpcore features living in pulp_file only?
    • In the long run, it does not matter if the tests are in pulpcore or pulp_file.
    • “Test should come with the feature” suggests adding them to pulpcore if it’s a pulpcore only change.
    • What was the original reason to move tests using pulp_file to the plugin?
      • mdellweg’s memory: We had compatibility issues with all the branches moving around. But we fixed that and can now depend on stable pulp_file releases.
    • if there is any code-change in pulp_file for a Thing, then its test needs to live in pulp_file
    • if there is no pulp_file code-change (e.g., core is adding a Thing that pulp_file gets “for free” due to inheritance), then the test for it “can” live in pulpcore
    • this own’t solve the problem - pulp_file changes that require core-changes still collide oddly/badly
    • what about fixtures? can you use pulp_file fixtures from inside pulpcore?
      • yes if pulp_file is a pytest plugin
    • discussion: should core and file be the same project?

May 9

  • pulpcore
    • [X] 3.25 (NEW)
    • [ ] 3.24
    • [X] 3.23
    • [ ] 3.22
    • [ ] 3.21
    • [ ] 3.18
    • [ ] 3.16
  • pulp_file
    • [ ] 1.15 (NEW)
    • [ ] 1.14
    • [ ] 1.13
    • [ ] 1.12
    • [ ] 1.11
    • [ ] 1.10
  • Issue discussion
    • https://github.com/pulp/pulp_rpm/issues/3134
    • add a repo-versions__in
    • how can we make this performant?
    • filters could use perf-analysis/fixes
    • needs a POC to understand implications
      • materialized views? (django? or postgres?)
  • A proposal from telemetry workgroup
    • current state
      • Dependencies declared in the pulp-ci-centos build
      • Code missing in the pulpcore’s main branch. We can’t merge the code if we don’t add the opentelemetry basic stack as a direct dependency on pulpcore's requirements.
      • A new PR for OpenTelemetry aiohttp-server instrumentation project.
        • needed for pulp-content instrumentation
      • pulp-api is in a great spot
      • aiohttp is pretty good, but we really want it released upstream to consume
      • nothing for tasking yet - phase-2 perhaps?
      • Got a oci-env profile for development purposes.
        • Still not merged given some instabilities with CI’s docker tests.
          • need some help/eyes
    • The new proposal
      • Given the new pulpcore release process
        • “We can undo it later if needed”
      • Phase 1
        • We want to add a trimmed opentelemetry stack list of dependencies directly into pulpcore.
          • opentelemetry-distro[otlp]>=0.38b0,<=0.38b0
          • opentelemetry-exporter-otlp-proto-http>=1.17.0,<=1.17.0
          • opentelemetry-instrumentation-django>=0.38b0,<=0.38b0
          • opentelemetry-instrumentation-wsgi>=0.38b0,<=0.38b0
        • We have a PR open for instrumenting pulp-api
        • We are about to open a PR for opentelemetry-instrumentation-aiohttp-server
        • Will have a PR for instrumenting pulp-content after getting the otel PR merged
          • We can release a package with the instrumentator if the PR got stalled for some reason(ex: got no reviewers)
          • Or we can add it directly into pulpcore code base(vendor it?)
      • Phase 2
        • instrument the workers?
        • Any specific pulp related code?
    • discussion
    • decision:
      • merge reqs/PR to pulpcore
      • merge otel-work in oci_env
      • release as soon as it’s merged (3.25? .26?)
  • difficulty in getting core-PRs reviewed
    • think about this for next week’s mtg
  • 3.25 Today?
  • Can we make a bot or something to tell us when there are un-released commits on our branches
    • this would be great!
    • maybe a cmd to be run on a local copy of the repo?
    • a tues-workflow to check branches and auto-release?
    • let’s gather some info and anyone who’s Very Excited about this can start pulling something together
  • discussion around drop-trailing-slash PR
    • gerrod’s refactoring would make this easier to implement
    • do we hold up 3.25 for this, or not
    • if we’re going to change this to opt-in, it can happen “whenever”
    • decision: remove from blocker-list, release core/3.25
1 Like

May 16

  • pulpcore

    • [ ] 3.26 (NEW)
    • [ ] 3.25 (current release)
    • [ ] 3.23 (galaxyNG/4.7)
    • [ ] 3.22 (katello/4.9)
    • [ ] 3.21 (katello/4.7, galaxyNG/4.6)
    • [ ] 3.18 (katello/4.5)
    • [ ] 3.16 (katello/4.3)
  • pulp_file

    • [ ] 1.15 (NEW)
    • [ ] 1.14 (current)
    • [ ] 1.12 (katello/4.9)
    • [ ] 1.11 (katello/4.7)
    • [ ] 1.10 (katello/4.3. 4.5)
  • difficulty in getting core-PRs reviewed
    • think about this for next week’s mtg
    • “should we continue requiring 2 reviewers”?
      • still ok, except when everyone is on PTO?
      • problem w/ finding 2 SMEs at all times, moreso than github-access-issue
      • even just “extra eyes” (ie, not SME eyes) is useful
  • “keeping branch warm” discussion
    • remove 1.13 from pulp_file update_ci_branches? - YES
    • remove 3.24 from pulpcore update_ci_branches? - Yes(ish)
    • “whatever is used in downstream” and “currently-released branch”
    • what will be the implications for our upstream?
      • will they just stay on “downstream” branches (making them even more like an LTS?)
    • should core/3.24 be an exception?
      • if so - we can add it when we decide we need to
    • We should delete the backport labels for cold branches.
    • AI: [ggainey] make sure release-process is updated to be explicit about this
  • Create a working-group to improve CI automation to support weekly releases
    • Still too many manual steps in release process, quite a burden
    • only dkliban and x9c4 on the “CI Team” currently
    • still many manual-steps at Y-release time
    • lots of improvements discussed, not enough ppl to pick them up
    • let’s get a doc together and add ideas to it
    • who would like to champion for this?
      • gerrod to helm this
      • volunteers: ggainey, decko, x9c4
  • How to handle this migration:
  • This PR lacks a changelog and issue
  • OpenTelemetry is beta - discussion
    • there was a LONG matrix discussion on this
    • lots of other projects use this already
    • in both doc and in code explain why we’re relying on a “beta” dependency [decko]
    • [decko] will add missing changelog in his current PR
    • let’s make sure we continue to be good about having discussions exactly like this one
    • we should be asking the Otel Group directly, “when are you going to be not-beta”
1 Like