2086964 – oc-mirror fails on differential run when mirroring a package with multiple channels specified

Bug 2086964 - oc-mirror fails on differential run when mirroring a package with multiple channels specified

Summary: oc-mirror fails on differential run when mirroring a package with multiple ch...

Keywords:
Status:	CLOSED ERRATA
Alias:	None
Product:	OpenShift Container Platform
Classification:	Red Hat
Component:	oc
Sub Component:
Version:	4.11
Hardware:	Unspecified
OS:	Unspecified
Priority:	unspecified
Severity:	medium
Target Milestone:	---
Target Release:	4.11.0
Assignee:	Alex
QA Contact:	zhou ying
Docs Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+	depends on / blocked

Reported:	2022-05-16 22:46 UTC by Jennifer Power
Modified:	2022-08-10 11:12 UTC (History)
CC List:	2 users (show)
Fixed In Version:
Doc Type:	If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed:	2022-08-10 11:12:25 UTC
Target Upstream Version:
Embargoed:

Attachments	(Terms of Use)

Links
System	ID	Private	Priority	Status	Summary	Last Updated
Github	openshift oc-mirror pull 467	0	None	open	Bug 2086964: fix(operators): adds better support for packages with multiple channel configurations	2022-05-17 14:52:14 UTC
Red Hat Product Errata	RHSA-2022:5069	0	None	None	None	2022-08-10 11:12:37 UTC

Description Jennifer Power 2022-05-16 22:46:35 UTC

Description of problem:

oc-mirror does not handle specifying packages with multiple channels with heads-only mode.


Version-Release number of selected component (if applicable):

Client Version: version.Info{Major:"", Minor:"", GitVersion:"v0.2.0-alpha.1-36-g7bde4c7", GitCommit:"7bde4c7b", GitTreeState:"clean", BuildDate:"2022-05-16T13:31:03Z", GoVersion:"go1.17.1", Compiler:"gc", Platform:"linux/amd64"}


How reproducible:
100%


Steps to Reproduce:
1. Generate first configuration
apiVersion: mirror.openshift.io/v1alpha2
kind: ImageSetConfiguration
storageConfig:
  local:
    path: test
mirror:
  operators:
    - catalog: registry.redhat.io/redhat/redhat-operator-index:v4.10
      packages:
        - name: quay-operator
          channels:
          - name: stable-3.6
          - name: quay-v3.5
            minVersion: 3.5.7
2. Run oc-mirror: oc-mirror --config imageset-config-1.yaml file://out
3. Generate second configuration
apiVersion: mirror.openshift.io/v1alpha2
kind: ImageSetConfiguration
storageConfig:
  local:
    path: test
mirror:
  operators:
    - catalog: registry.redhat.io/redhat/redhat-operator-index:v4.10
      packages:
        - name: quay-operator
          channels:
          - name: stable-3.6
4. run oc-mirror without or with dry-run:
oc-mirror --config imageset-config-2.yaml file://out --dry-run

Actual results:

The catalog processing fails on the quay operator with the following error:
"Version string empty"


Expected results:

The process to complete successfully


Additional info:

https://github.com/openshift/oc-mirror/issues/465

Comment 3 zhou ying 2022-05-25 05:24:28 UTC

tested with latest version , can't reproduce the issue now:

[root@localhost newverify]# oc-mirror --config setting2.yaml file:// --dry-run 
Creating directory: oc-mirror-workspace/src/publish
Creating directory: oc-mirror-workspace/src/v2
Creating directory: oc-mirror-workspace/src/charts
No metadata detected, creating new workspace
WARN[0031] DEPRECATION NOTICE:
Sqlite-based catalogs and their related subcommands are deprecated. Support for
them will be removed in a future release. Please migrate your catalog workflows
to the new file-based catalog format. 
wrote mirroring manifests to oc-mirror-workspace/operators.1653455889/manifests-redhat-operator-index

To upload local images to a registry, run:

	oc adm catalog mirror file://redhat/redhat-operator-index:v4.10 REGISTRY/REPOSITORY
<dir>
  quay/clair-rhel8
    blobs:
      registry.redhat.io/quay/clair-rhel8 sha256:0344366a246a0f7590c2bae4536c01f15f20c6d802b4654ce96ac81047bc23f3 1.699KiB
      registry.redhat.io/quay/clair-rhel8 sha256:c59a2b44b19e48e1017a6aee1482b54bb0cd401f4b99fe2697a0aafcb0c3ecac 3.934KiB
      registry.redhat.io/quay/clair-rhel8 sha256:a9a92ed30e46fd662d97d0d79fd3be08f32ff799b09a2251a3d01e027c59186e 24.74MiB
      registry.redhat.io/quay/clair-rhel8 sha256:4752687a61a97d6f352ae62c381c87564bcb2f5b6523a05510ca1fb60d640216 34.75MiB
    manifests:
      sha256:0716e3557407693ee11639d2759e95c81af6510276157eae4898585e9a4dc4db
      sha256:86d45aaf6f783f119d9ed9acf9fc962b037564b32ba2b68e9075282f7e1d6e5b
      sha256:86d45aaf6f783f119d9ed9acf9fc962b037564b32ba2b68e9075282f7e1d6e5b -> 6f4a8dbc
  quay/quay-builder-qemu-rhcos-rhel8
    blobs:
      registry.redhat.io/quay/quay-builder-qemu-rhcos-rhel8 sha256:545277d800059b32cf03377a9301094e9ac8aa4bb42d809766d7355ca9aa8652 1.753KiB
      registry.redhat.io/quay/quay-builder-qemu-rhcos-rhel8 sha256:2ca24580cec96821ee6848b8e71b8bc81b45dc11dedf4ec73f252a69e3cb17cb 3.925KiB
      registry.redhat.io/quay/quay-builder-qemu-rhcos-rhel8 sha256:f70d60810c69edad990aaf0977a87c6d2bcc9cd52904fa6825f08507a9b6e7bc 74.8MiB
      registry.redhat.io/quay/quay-builder-qemu-rhcos-rhel8 sha256:af53c826747d479de9ad83e1dc872ea733d0caf7a98c559abdb75ac34b1f82ef 1.039GiB
    manifests:
      sha256:3c5ca9604ced0f227b5f1c36843e78e0a143d85020d8c523f4e9c7c473f11ff7
      sha256:3e9aa91a8620b6702eac0ad26065c96f7211a44dc4f7c45a1bc57b8ca65c1e25
      sha256:3c5ca9604ced0f227b5f1c36843e78e0a143d85020d8c523f4e9c7c473f11ff7 -> c34c747a
  quay/quay-builder-rhel8
    blobs:
      registry.redhat.io/quay/quay-builder-rhel8 sha256:545277d800059b32cf03377a9301094e9ac8aa4bb42d809766d7355ca9aa8652 1.753KiB
      registry.redhat.io/quay/quay-builder-rhel8 sha256:42f4d85d29fdb29466a1ab77e77e3c4b9877bf272c14222ce9c1b9aacecc9fca 4.607KiB
      registry.redhat.io/quay/quay-builder-rhel8 sha256:94e1567d96ba8e4acfd1410e0c2fb2d9d7662d42497bc4aba5f6147e96846e77 35.01MiB
      registry.redhat.io/quay/quay-builder-rhel8 sha256:3787740a304bb109fdeb4801f672581cf5019fdba7ba7b649493519881e9f285 49.5MiB
      registry.redhat.io/quay/quay-builder-rhel8 sha256:f70d60810c69edad990aaf0977a87c6d2bcc9cd52904fa6825f08507a9b6e7bc 74.8MiB
    manifests:
      sha256:4c17a2825378a21b7ac0ecc695960383eee111152446e5dec398d87e9df22beb
      sha256:f4fff1c0df5203e94a8dabf3bc9f03a52ef8539e09ef02a06dd2d40c36a4e397
      sha256:4c17a2825378a21b7ac0ecc695960383eee111152446e5dec398d87e9df22beb -> bdde8909
  quay/quay-operator-bundle
    blobs:
      registry.redhat.io/quay/quay-operator-bundle sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1 32B
      registry.redhat.io/quay/quay-operator-bundle sha256:78d0e7d106398a7ab15074f94c74277609b5ca5d113bd8b9cfb719ae028d59d9 2.559KiB
      registry.redhat.io/quay/quay-operator-bundle sha256:5b3482da81b3c4556b06484a0323e83376dcedcef525d324716b362e547829b9 40.52KiB
    manifests:
      sha256:0ff77676222483ee29496951eba594fbdbc925f78fc1dc7c35a3c79fde7c8dcc -> f4cf922b
  quay/quay-operator-rhel8
    blobs:
      registry.redhat.io/quay/quay-operator-rhel8 sha256:0344366a246a0f7590c2bae4536c01f15f20c6d802b4654ce96ac81047bc23f3 1.699KiB
      registry.redhat.io/quay/quay-operator-rhel8 sha256:830eb3ab27f8bbe9e75060888bb3c8423dd6e9172a3cf0582cd38a22c83b2fc5 3.755KiB
      registry.redhat.io/quay/quay-operator-rhel8 sha256:c44ed232d25c70e66906469d00e020f5afcf613d27dd36f6dcf8f37a0ade25bf 29.52MiB
      registry.redhat.io/quay/quay-operator-rhel8 sha256:4752687a61a97d6f352ae62c381c87564bcb2f5b6523a05510ca1fb60d640216 34.75MiB
    manifests:
      sha256:105be0f9237a6aeca8b885cbc6d0fa417edc5684746ae7e6b2c985e72a2c7239
      sha256:3b6e43d39859652d9ef7bc61ea6fe8b74aa5614f9859e8808087476fe16ae7f2
      sha256:105be0f9237a6aeca8b885cbc6d0fa417edc5684746ae7e6b2c985e72a2c7239 -> cba602ed
  quay/quay-rhel8
    blobs:
      registry.redhat.io/quay/quay-rhel8 sha256:545277d800059b32cf03377a9301094e9ac8aa4bb42d809766d7355ca9aa8652 1.753KiB
      registry.redhat.io/quay/quay-rhel8 sha256:7804825f6b290d5fa5cadf6ec86709d7b24689dd0cdd5092c013e5ced3939a0c 4.181KiB
      registry.redhat.io/quay/quay-rhel8 sha256:f70d60810c69edad990aaf0977a87c6d2bcc9cd52904fa6825f08507a9b6e7bc 74.8MiB
      registry.redhat.io/quay/quay-rhel8 sha256:1cc09c6f12d84c1e4841414b1188a2eb00e0d64be3be4ad61439b74f5903cccb 186MiB
    manifests:
      sha256:5576284ca4f57dce09f8f2e2ac2428dfb4a3128cdc9edc36de36408531524654
      sha256:7f4f6b0e2e3677bb39fc29015a11ad04df93c97c97adf57425d2e16fc247075f
      sha256:5576284ca4f57dce09f8f2e2ac2428dfb4a3128cdc9edc36de36408531524654 -> aa8610ea
  rhel8/postgresql-10
    blobs:
      registry.redhat.io/rhel8/postgresql-10 sha256:fa7d3d3fed5d2fc0d5c4b1cb4c1111b2ddb338b467c6d28bec0d7c0f2be2eee5 1.75KiB
      registry.redhat.io/rhel8/postgresql-10 sha256:b88304ccd20b48c3e167431fdaa53db68d449caf91511ca66a32b356f947b6ea 1.752KiB
      registry.redhat.io/rhel8/postgresql-10 sha256:545277d800059b32cf03377a9301094e9ac8aa4bb42d809766d7355ca9aa8652 1.753KiB
      registry.redhat.io/rhel8/postgresql-10 sha256:0a1c03975291cb2c4122f9a829d1747a3cf4a20e84b3cb01d4edf574201a1495 1.755KiB
      registry.redhat.io/rhel8/postgresql-10 sha256:179586c32b7b4e4a93c1b67d96777fe5ab1f62cb7e4f58c5b7b2b7996ebde2a8 6.212KiB
      registry.redhat.io/rhel8/postgresql-10 sha256:f008dd2efe5299a0e2dd4fc9cb3b205e907c6a2875da186c4cfa8635caa63edc 6.212KiB
      registry.redhat.io/rhel8/postgresql-10 sha256:818ae3229334a1835136ff5c70cee0a8a0b899438e9448bd168755b4f0f565d5 6.216KiB
      registry.redhat.io/rhel8/postgresql-10 sha256:17cba727c954ed30a451f5feb0cb8fabbca87907e6af1226167a6221d50c1b16 6.226KiB
      registry.redhat.io/rhel8/postgresql-10 sha256:65eddd4ebf48afabea25643c1557f7181013847b5a4f98063a03489130b65755 16.32MiB
      registry.redhat.io/rhel8/postgresql-10 sha256:da6cf90000f1e8c68029513a3674919c4c460ed472ba88ccbaa046c74ddcc951 16.34MiB
      registry.redhat.io/rhel8/postgresql-10 sha256:0c1fd83997e17b079085107d40f89cea2211f9ec3db88d5241019a85d06db5a7 16.48MiB
      registry.redhat.io/rhel8/postgresql-10 sha256:d2be686e74da7c701311c471acf80b269afb9a3165314de5aa2b9a6df6562fd7 16.91MiB
      registry.redhat.io/rhel8/postgresql-10 sha256:bddb3b212e72cb28ed50adefa64a3738bcc068fb04e21484b8f707cff661c6c6 68.11MiB
      registry.redhat.io/rhel8/postgresql-10 sha256:5378f3b015f1d6ead3bf0a97a11d967bb601eb681b0324ee9b7115eb4beec0fb 68.21MiB
      registry.redhat.io/rhel8/postgresql-10 sha256:61b52c83f91da62d88ddc5d95fe0d3b9f54214a378add1b0d373d63f43cc3f56 69.26MiB
      registry.redhat.io/rhel8/postgresql-10 sha256:d00ae2086eeeb84ad92da969da0ca56a614dfec03d67348236849e89c3a47c11 71.94MiB
      registry.redhat.io/rhel8/postgresql-10 sha256:e8d8cab5ec852ea3c5242b9727d32f9def59ec60c596fd0cf1693e17a8e1fc2c 72.01MiB
      registry.redhat.io/rhel8/postgresql-10 sha256:0f6e46285dbeaad8b2b8f01b5fe21771fc2b522ceafaf88d8f51ff88b51d87a9 72.9MiB
      registry.redhat.io/rhel8/postgresql-10 sha256:f70d60810c69edad990aaf0977a87c6d2bcc9cd52904fa6825f08507a9b6e7bc 74.8MiB
      registry.redhat.io/rhel8/postgresql-10 sha256:3535894aee571461a1e349f56efc71bd16510bb12c5893003f15aef9f272bc8e 81.1MiB
    manifests:
      sha256:80a71b80006dafd56a9b65ac933f2edb0a27a3dd95c556add3c706c7c135ae50
      sha256:88ab46c706b4299d96ccb70e9a6f3ecab1bd3e1f6fefb024a2241b448db5e4b2
      sha256:8ca9c1e162787e47f2f00dcee31833e832fe90b94c3d77c7e5f092ed7c3f34b7
      sha256:d006800f4f5fc2db85caf46b84f2da3b32f309f55c475f78f1e30388028a584c
      sha256:d9ece169050971d2a4104a7e2b2cf9ce382f36fa3f6f75ce9cae802ce29a107a
      sha256:80a71b80006dafd56a9b65ac933f2edb0a27a3dd95c556add3c706c7c135ae50 -> d08e2924
  rhel8/redis-5
    blobs:
      registry.redhat.io/rhel8/redis-5 sha256:fa7d3d3fed5d2fc0d5c4b1cb4c1111b2ddb338b467c6d28bec0d7c0f2be2eee5 1.75KiB
      registry.redhat.io/rhel8/redis-5 sha256:b88304ccd20b48c3e167431fdaa53db68d449caf91511ca66a32b356f947b6ea 1.752KiB
      registry.redhat.io/rhel8/redis-5 sha256:545277d800059b32cf03377a9301094e9ac8aa4bb42d809766d7355ca9aa8652 1.753KiB
      registry.redhat.io/rhel8/redis-5 sha256:0a1c03975291cb2c4122f9a829d1747a3cf4a20e84b3cb01d4edf574201a1495 1.755KiB
      registry.redhat.io/rhel8/redis-5 sha256:4f7d2c6127a14d1ec6b53e831891af75efa375d09cd134e2edb58cf2d31d703d 8.412KiB
      registry.redhat.io/rhel8/redis-5 sha256:8f2e315ff4d04f93641df9bcffc63dfe8f4b50fc9d65ef6c17994e44f38163ae 8.412KiB
      registry.redhat.io/rhel8/redis-5 sha256:2f803d358b80e4115847fb99779b0ebc70fe9c288ee3dfb46152d4def39058dd 8.416KiB
      registry.redhat.io/rhel8/redis-5 sha256:fc58382c6406e01bfec9b528d787bfceaa2fb281b56f6ba5983fc2a93ebea904 8.426KiB
      registry.redhat.io/rhel8/redis-5 sha256:122d976aec24e1788acb27977ba42e2df9265aca832a5a3cd5ac66b4cdcce43a 6.721MiB
      registry.redhat.io/rhel8/redis-5 sha256:58bdb6aeb6cc84823889608798bb6d6a2945f9642216f34e9794bd1cf2deb6db 6.817MiB
      registry.redhat.io/rhel8/redis-5 sha256:85a25a89cf703601963c2330e559b2af65093ec8bcf7ab60e202b99c1b345000 6.981MiB
      registry.redhat.io/rhel8/redis-5 sha256:7707fefa9b7a215a6e29eedf4c168ce52ab72df230bbeb24ba771b9a42169a73 7.07MiB
      registry.redhat.io/rhel8/redis-5 sha256:65eddd4ebf48afabea25643c1557f7181013847b5a4f98063a03489130b65755 16.32MiB
      registry.redhat.io/rhel8/redis-5 sha256:da6cf90000f1e8c68029513a3674919c4c460ed472ba88ccbaa046c74ddcc951 16.34MiB
      registry.redhat.io/rhel8/redis-5 sha256:0c1fd83997e17b079085107d40f89cea2211f9ec3db88d5241019a85d06db5a7 16.48MiB
      registry.redhat.io/rhel8/redis-5 sha256:d2be686e74da7c701311c471acf80b269afb9a3165314de5aa2b9a6df6562fd7 16.91MiB
      registry.redhat.io/rhel8/redis-5 sha256:e8d8cab5ec852ea3c5242b9727d32f9def59ec60c596fd0cf1693e17a8e1fc2c 72.01MiB
      registry.redhat.io/rhel8/redis-5 sha256:0f6e46285dbeaad8b2b8f01b5fe21771fc2b522ceafaf88d8f51ff88b51d87a9 72.9MiB
      registry.redhat.io/rhel8/redis-5 sha256:f70d60810c69edad990aaf0977a87c6d2bcc9cd52904fa6825f08507a9b6e7bc 74.8MiB
      registry.redhat.io/rhel8/redis-5 sha256:3535894aee571461a1e349f56efc71bd16510bb12c5893003f15aef9f272bc8e 81.1MiB
    manifests:
      sha256:13b909599cfb85fd366b18dca9265513f31646916b6fe2f0778ed292e0a457dd
      sha256:180ea46e33706b33b199edd3abf2a28c0700262ebf02131b855cf989bcfe2050
      sha256:5ece525b157b16b6fa41d7badbfd3081de317fb69e9940809804765489c88eaa
      sha256:84f28f53b43548e5c2821d26815e38e4dda0f84b241cf93f296458a8e146ab32
      sha256:f3cbea3e3e99cd84b717e98032675d5ee0ac59c8f2dc0d442fb84b3377e0b748
      sha256:84f28f53b43548e5c2821d26815e38e4dda0f84b241cf93f296458a8e146ab32 -> baad610
  stats: shared=14 unique=30 size=2.047GiB ratio=0.81

phase 0:
   quay/quay-operator-bundle blobs=3  mounts=0 manifests=1 shared=0
   rhel8/postgresql-10       blobs=20 mounts=0 manifests=6 shared=12
   quay/quay-operator-rhel8  blobs=4  mounts=0 manifests=3 shared=2
phase 1:
   rhel8/redis-5                      blobs=20 mounts=12 manifests=6 shared=12
   quay/clair-rhel8                   blobs=4  mounts=2  manifests=3 shared=2
   quay/quay-rhel8                    blobs=4  mounts=2  manifests=3 shared=2
   quay/quay-builder-qemu-rhcos-rhel8 blobs=4  mounts=2  manifests=3 shared=2
   quay/quay-builder-rhel8            blobs=5  mounts=2  manifests=3 shared=2

info: Planning completed in 24.39s
info: Dry run complete
writing image mapping to oc-mirror-workspace/mapping.txt

Comment 5 errata-xmlrpc 2022-08-10 11:12:25 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Important: OpenShift Container Platform 4.11.0 bug fix and security update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2022:5069

Note You need to log in before you can comment on or make changes to this bug.