Problem:
I started with the official redhat 7 repo ( https://cdn.redhat.com/content/dist/rhel/server/7/7Server/x86_64/os) and created a distribution. The distribution shows packages that cannot be downloaded.
Expected outcome:
Be able to download any package in the distribution
Pulpcore version:
3.13.0
Pulp plugins installed and their versions:
rpm - 3.12.0
Operating system - distribution and version:
Red Hat Enterprise Linux Server release 7.9 (Maipo)
Other relevant data:
Broken download
curl -v -O https://<repo_server>/pulp/content/ci-rhel7-q2-w16-2023/Packages/h/hunspell-devel-1.3.2-16.el7.x86_64.rpm
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* About to connect() to <repo_server> port 443 (#0)
* Trying 10.1.2.46...
* Connected to <repo_server> (10.1.2.46) port 443 (#0)
* Initializing NSS with certpath: sql:/etc/pki/nssdb
* CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
* SSL connection using TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384
* Server certificate:
* subject: CN=<repo_server>
* start date: Jun 16 13:23:50 2021 GMT
* expire date: Sep 18 13:23:50 2023 GMT
* common name: <repo_server>
* issuer: CN=<repo_server>,O=Pulp,C=US
> GET /pulp/content/ci-rhel7-q2-w16-2023/Packages/h/hunspell-devel-1.3.2-16.el7.x86_64.rpm HTTP/1.1
> User-Agent: curl/7.29.0
> Host: <repo_server>
> Accept: */*
>
< HTTP/1.1 200 OK
< Server: nginx/1.16.1
< Date: Tue, 18 Apr 2023 23:58:04 GMT
< Content-Type: audio/x-pn-realaudio-plugin
< Content-Length: 75952
< Connection: keep-alive
< Accept-Ranges: bytes
< Etag: "2f6f596cb806e3c10b8bd0f334d7b850:1659684846.907411"
< Last-Modified: Tue, 14 Apr 2020 13:51:20 GMT
< X-Cache: TCP_MEM_HIT from a23-205-102-15.deploy.akamaitechnologies.com (AkamaiGHost/11.0.3-47547230) (-)
< x-rh-edge-request-id: 42632061
< x-rh-edge-reference-id: 0.f66cd17.1681861943.42632061
< x-rh-edge-cache-status: Hit from child
< x-origin: rcmnew
< EJ-HOST: authorizer-prod-iad2-33-4fhjd
< X-Akamai-Request-ID: 42632061
< Strict-Transport-Security: max-age=15768000
<
{ [data not shown]
* transfer closed with 60190 bytes remaining to read
20 75952 20 15762 0 0 37411 0 0:00:02 --:--:-- 0:00:02 37439
* Closing connection 0
curl: (18) transfer closed with 60190 bytes remaining to read
Working Download
curl -v -O https://<repo_server>/pulp/content/ci-rhel7-q2-w16-2023/Packages/h/hunspell-devel-1.3.2-13.el7.x86_64.rpm
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* About to connect() to <repo_server> port 443 (#0)
* Trying 10.1.2.46...
* Connected to <repo_server> (10.1.2.46) port 443 (#0)
* Initializing NSS with certpath: sql:/etc/pki/nssdb
* CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
* SSL connection using TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384
* Server certificate:
* subject: CN=<repo_server>
* start date: Jun 16 13:23:50 2021 GMT
* expire date: Sep 18 13:23:50 2023 GMT
* common name: <repo_server>
* issuer: CN=<repo_server>,O=Pulp,C=US
> GET /pulp/content/ci-rhel7-q2-w16-2023/Packages/h/hunspell-devel-1.3.2-13.el7.x86_64.rpm HTTP/1.1
> User-Agent: curl/7.29.0
> Host: <repo_server>
> Accept: */*
>
< HTTP/1.1 200 OK
< Server: nginx/1.16.1
< Date: Tue, 18 Apr 2023 23:58:34 GMT
< Content-Type: application/octet-stream
< Content-Length: 75544
< Connection: keep-alive
< Last-Modified: Thu, 18 Nov 2021 18:09:31 GMT
< Accept-Ranges: bytes
< Strict-Transport-Security: max-age=15768000
<
{ [data not shown]
100 75544 100 75544 0 0 333k 0 --:--:-- --:--:-- --:--:-- 333k
* Connection #0 to host <repo_server> left intact
Here are the exerts from a repo sync for the same packages
reposync --gpgcheck -l --downloadcomps --download-metadata --repoid=ci-rhel7-q2-w16-2023 --download_path=/data/redhat7
(8828/33666): hunspell-devel-1.3.2-13.el7.x86_64.rpm
hunspell-devel-1.3.2-16.el7.x8 FAILED
This is the sync job
HTTP 200 OK
Allow: GET, PATCH, DELETE, HEAD, OPTIONS
Content-Type: application/json
Vary: Accept
{
“pulp_href”: “/pulp/api/v3/tasks/fc23cd4a-0749-494a-be8f-8f34d9484575/”,
“pulp_created”: “2023-04-18T21:20:06.502423Z”,
“state”: “completed”,
“name”: “pulp_rpm.app.tasks.synchronizing.synchronize”,
“logging_cid”: “9e7302e0ca7d4b40a1c683b0030211eb”,
“started_at”: “2023-04-18T21:20:09.472214Z”,
“finished_at”: “2023-04-18T21:30:25.746569Z”,
“error”: null,
“worker”: “/pulp/api/v3/workers/290c893b-a3da-4572-a57c-e76646adec4d/”,
“parent_task”: null,
“child_tasks”: [],
“task_group”: null,
“progress_reports”: [
{
“message”: “Parsed Packages”,
“code”: “sync.parsing.packages”,
“state”: “completed”,
“total”: 33666,
“done”: 33666,
“suffix”: null
},
{
“message”: “Parsed Comps”,
“code”: “sync.parsing.comps”,
“state”: “completed”,
“total”: 91,
“done”: 91,
“suffix”: null
},
{
“message”: “Parsed Advisories”,
“code”: “sync.parsing.advisories”,
“state”: “completed”,
“total”: 5123,
“done”: 5123,
“suffix”: null
},
{
“message”: “Downloading Metadata Files”,
“code”: “sync.downloading.metadata”,
“state”: “completed”,
“total”: null,
“done”: 6,
“suffix”: null
},
{
“message”: “Downloading Artifacts”,
“code”: “sync.downloading.artifacts”,
“state”: “completed”,
“total”: null,
“done”: 21,
“suffix”: null
},
{
“message”: “Associating Content”,
“code”: “associating.content”,
“state”: “completed”,
“total”: null,
“done”: 2788,
“suffix”: null
},
{
“message”: “Un-Associating Content”,
“code”: “unassociating.content”,
“state”: “completed”,
“total”: null,
“done”: 2964,
“suffix”: null
}
],
“created_resources”: [
“/pulp/api/v3/repositories/rpm/rpm/a4c96de2-3f01-49f7-b737-a7b972589184/versions/12/”
],
“reserved_resources_record”: [
“/pulp/api/v3/repositories/rpm/rpm/a4c96de2-3f01-49f7-b737-a7b972589184/”,
“/pulp/api/v3/remotes/rpm/rpm/1d94bc40-0d4e-41c3-961e-56980f4585ff/”
]
}