14:30:13 #startmeeting Pulp Triage 2021-04-09 14:30:13 #info fao89 has joined triage 14:30:13 !start 14:30:13 Meeting started Fri Apr 9 14:30:13 2021 UTC. The chair is fao89. Information about MeetBot at http://wiki.debian.org/MeetBot. 14:30:13 Useful Commands: #action #agreed #help #info #idea #link #topic. 14:30:13 The meeting name has been set to 'pulp_triage_2021-04-09' 14:30:13 fao89: fao89 has joined triage 14:30:18 #info ggainey has joined triage 14:30:18 !here 14:30:18 ggainey: ggainey has joined triage 14:30:23 Open floor! 14:30:31 https://hackmd.io/@pulp/triage/edit 14:30:58 def need more ppl 14:31:07 yep 14:31:13 Modulemd is a pulp_rpm thing - PackageRelaseComponent is pulp_deb, yeah? 14:31:19 yeh 14:31:24 #info x9c4 has joined triage 14:31:24 !here 14:31:24 x9c4: x9c4 has joined triage 14:31:36 #info ttereshc has joined triage 14:31:36 !here 14:31:36 ttereshc: ttereshc has joined triage 14:31:39 #info daviddavis has joined triage 14:31:39 !here 14:31:39 daviddavis: daviddavis has joined triage 14:31:44 topic: How to properly use `PackageReleaseComponent` and `Modulemd` for creating repositories/distributions that target multiple distros & distro versions 14:31:47 #info ppicka has joined triage 14:31:47 !here 14:31:47 ppicka: ppicka has joined triage 14:32:07 is this in a debian context? 14:32:17 I think I'm confused here, sorry 14:32:24 ok, so let me explain 14:32:37 I think we need to tackle two different content types separately 14:32:48 I upload Artifacts then map them to a Content:Package 14:33:20 my ultimate goal is to have one distribution that handles different codestream (dist/debain/buster, dist/debian/stretch) etc 14:33:45 so, to my understanding this is done via the Content:Release and the `Content:Package` directive 14:34:21 Then there is a `Content:Release_Components` 14:34:43 and a `PackageReleaseComponent` 14:35:10 My main problem here is that I'm unsure which attributes they require 14:35:26 especially those which are flagged with (string) 14:35:40 Usually, I was fine with using the respective `pulp_href` from the referenced object 14:36:05 But for these resources I always get  `"Invalid hyperlink - No URL match."` 14:36:33 hrm - I'm not familiar enough w/ pulp_deb to be able to talk to this 14:36:34 soo, I guess the questions here is: Am I doing it wrong or is there a bug? 14:36:39 * ggainey digs into the models 14:36:45 As far as i know, those objects are used in the sync code to track which packages are part of which releases. 14:37:15 Right, also when using the `simple` mode 14:37:18 I do not know, that there is enough interface to create those associations by hand. 14:37:38 mh 14:37:46 When using simple they are completely ignored. 14:38:29 But in short, the Release unit us used to represent all releases (buster, stretch) in a repo 14:38:50 Right, I can create those 14:38:55 the components are subdeviding them as (main, contrib, nonfree) 14:39:48 and the package_release_component is meant as a jointable to describe that a package belongs into a component (which is part of a release) 14:40:14 This is basically what I want to achieve 14:40:38 I'd be fine without the subdivision, though 14:40:45 As i said, i don't know if the viewsets are able to create those associations properly. 14:40:54 x9c4: question - in this code https://github.com/pulp/pulp_deb/blob/main/pulp_deb/app/serializers/content_serializers.py#L551-L567 - why are package and release_component defined w/the same query? 14:40:59 i feel like I'm missing something 14:41:23 Does not work without the components. That is the layout of a deb repo. 14:41:57 ggainey, i think you found a bug. 14:42:00 ggainey++ 14:42:00 x9c4: ggainey's karma is now 118 14:42:02 ... 14:42:04 well 14:42:08 I wasn't trying, honest! :) 14:42:37 shall I open a pulp_deb issue then? 14:42:51 Yes! 14:42:58 coolio, onnit 14:43:11 ggainey++ 14:43:12 fao89: ggainey's karma is now 119 14:43:42 jxsxs, that might even explain your error message 14:44:05 It may be also worth looking into `Content: Release_Components` the error message looks pretty similar 14:44:46 to me it sounds like that the provided (pulp_href probably?)  isn't resolved properly 14:46:01 https://pulp.plan.io/issues/8533 14:46:46 thanks ggainey! 14:47:04 no worries - might want to add yourself as a watcher to get updates 14:47:10 That one looks right to me. 14:47:28 And maybe add some of your error messages. 14:48:08 will do! 14:48:23 jxsxs++ 14:48:23 x9c4: jxsxs's karma is now 1 14:48:25 +1 14:48:32 jxsxs++ 14:48:32 ggainey: jxsxs's karma is now 2 14:48:48 Is this btw the official way doing what I was planning on doing? 14:49:13 (as I wasn't able to find references for this in the docs) 14:49:28 More like the only way atm. 14:49:57 And it's not official. 14:50:04 heh, got it 14:50:35 ok, so since the RPM related questions is basically identical 14:51:01 `Modulemd` is the way to go? 14:51:21 modules are...Special. And generally not in fun ways. 14:52:03 jxsxs: have you been to https://docs.fedoraproject.org/en-US/modularity/building-modules/fedora/defining-modules/ and related docs? 14:52:05 alright, what'd be the best way to achieve distro/version type distributions in RPM land? 14:52:51 ggainey no, not yet.. _puts on the list_ 14:54:18 RPM repos (and clients) don't work like deb-repos/apt. If you had one repo that you wanted to have hold, say, F31/F32/F33 content, there isn't (that I can think of) any way to describe that in the debian buster/stretch/etc way 14:54:27 repos are assumed to be for one os-release 14:54:32 rpm repos, that is 14:54:34 same w/SUSE 14:55:07 (anybody noting anywhere I'm lying here, please jump in) 14:56:39 dalley: ttereshc: could we do this with distribution-paths? so the layout on-disk is more what jxsxs is thinking of? 14:57:13 I tried this with `base_path` where I just set `fedora/6` etc 14:57:43 ggainey, no, base_path overlap checks that no parts of other base paths are reused 14:57:46 I think 14:57:49 but it turns out that the content/link that is being created is not separate directories 14:57:58 hrm 14:58:58 yeah, we call that out explicitly as it turns out :) 15:00:15 I'm not sure you can get there from here in rpm-land, jxsxs 15:00:32 dammit :> 15:00:42 I would def need to think hard before I could figure out a way, at any rate 15:00:49 got you 15:01:05 thanks to all of you though! 15:01:33 Is there a feature request / story for this by chance? 15:01:35 jxsxs: if you opened an RFE that had a detailed description of what you're envisioning, we might be able to noodle out something. 15:01:49 we might end up regretfully closing it as "cant' get there, from here" too, tho 15:02:18 I can tinker something together 15:02:45 jxsxs: coolness - then you can just nag us w/a number until we do soemthing or close it, it'll be more efficient that way :) 15:03:08 will do 15:03:10 thanks again 15:03:17 ttereshc: I don't suppose you remember why base-Path can't overlap? 15:03:25 feels like there's a very good reason, I just don't know what it is 15:03:37 ggainey, I do not remember specific rules, so worth checking 15:03:40 yeah 15:03:54 ok, well, something to look into in all the copious spare time :) 15:03:55 maybe fedora/31, fedora/32 should work 15:04:01 yeah 15:04:50 * ggainey wonders if it's because of needing sometimes to climb up-and-over from, say, /os to /kickstart, or something like that 15:05:01 anyway, jxsxs good questions 15:05:07 also, I think potential conflicts 15:05:10 yeah 15:05:13 a/b/c and a/b are definitely not allow, so you do not break some other repo 15:05:27 maybe it's a docker repo under that path, or ansible one 15:05:27 a/b/c and a/b/d are allowed 15:05:36 hm 15:05:51 daviddavis, what about a/b/c and a/b ? 15:05:58 not allowed 15:06:01 cool 15:06:08 that's sounds right 15:06:14 daviddavis: The ``base_path`` must have no overlapping components. So if a Distribution with ``base_path`` 15:06:14 of ``a/path/foo`` existed, you could not make a second Distribution with a ``base_path`` of 15:06:14 ``a/path`` or ``a`` because both are subpaths of ``a/path/foo``. 15:06:38 so just the subpaths, interesting. maybe this will work 15:06:46 jxsxs: openm your rfe, and we can discuss therein 15:06:55 sorry all, I started designing off the top of my head 15:07:06 ggainey, yeah, it will ensure that a and b are only directories in daviddavis's example 15:07:14 yyeeahhhh 15:07:23 ok, I''m confused again, but more hopeful :) 15:08:15 I suggest to move on and we can have a discussion on the rfe 15:08:41 triage? 15:08:42 +1 15:08:47 yupper, sounds good 15:08:54 !next 15:08:55 #topic https://pulp.plan.io/issues/8524 15:08:56 fao89: 3 issues left to triage: 8524, 8521, 8514 15:08:57 RM 8524 - ipanova@redhat.com - POST - Disable guardians' AnonymousUser 15:08:58 https://pulp.plan.io/issues/8524 15:09:14 accept 15:09:16 #idea Proposed for #8524: Leave the issue as-is, accepting its current state. 15:09:16 !propose accept 15:09:16 fao89: Proposed for #8524: Leave the issue as-is, accepting its current state. 15:09:19 #agreed Leave the issue as-is, accepting its current state. 15:09:19 !accept 15:09:19 fao89: Current proposal accepted: Leave the issue as-is, accepting its current state. 15:09:20 #topic https://pulp.plan.io/issues/8521 15:09:20 fao89: 2 issues left to triage: 8521, 8514 15:09:21 RM 8521 - awcrosby - NEW - Allow plugins to retrieve backend storage url of artifact 15:09:22 https://pulp.plan.io/issues/8521 15:09:51 #idea Proposed for #8521: convert to task 15:09:51 !propose other convert to task 15:09:51 fao89: Proposed for #8521: convert to task 15:09:52 interesting. Story 15:09:55 task, yeah 15:10:13 yeah, and I feel like we used to have it and then removed because no plugin used it 15:10:19 heh 15:10:36 pulp_ansible is using it now 15:11:21 https://github.com/pulp/pulp_ansible/pull/550/files 15:11:50 yep, that azure bug broke galaxy-importer 15:11:57 fun! 15:12:04 phun 15:12:07 hehe 15:12:12 ouch 15:12:29 been pheeling phunny since I got my vax 15:12:39 pfeeling rather 15:12:40 operator is using azure now, so we'll be finding issues like that in the future 15:12:47 daviddavis: lol 15:12:50 I worked on VAX, but it was a looooooooooooooooooooooooooooooooooooooong time ago 15:13:07 +1 to convert to story 15:13:10 or task 15:13:11 +1 15:13:19 story, it's an RFE 15:13:22 +1 15:13:25 #idea Proposed for #8521: convert to story 15:13:25 !propose other convert to story 15:13:25 fao89: Proposed for #8521: convert to story 15:13:26 daviddavis: we need to a new commane to pulpbot !pfriday 15:13:30 #agreed convert to story 15:13:30 !accept 15:13:30 fao89: Current proposal accepted: convert to story 15:13:31 #topic https://pulp.plan.io/issues/8514 15:13:31 fao89: 1 issues left to triage: 8514 15:13:32 RM 8514 - amblikmees - NEW - Foreman Katello: Unable to migrate pulp2 to pulp3 15:13:33 https://pulp.plan.io/issues/8514 15:13:34 ipanova: lol 15:13:51 move to migration 15:13:59 fao89: good to hear operator uses azure 15:14:00 I commented on this - I think it's a dup of 8377, but not 100% certain 15:14:11 but yeah, move to migration, meant to do that yesterday and clearly did not 15:14:16 oh no wait 15:14:18 hang on 15:14:31 if it's a dup of 8377, it's the artifact_stages fix, which is in core 15:14:38 +1 15:14:38 migration just exercises the problem 15:14:51 ah ok 15:15:03 so - accept, leave in core, I'll close as dup once I hear back from user 15:15:05 #idea Proposed for #8514: close as duplicate 15:15:05 !propose other close as duplicate 15:15:05 fao89: Proposed for #8514: close as duplicate 15:15:11 ops 15:15:12 +1 15:15:13 heh 15:15:16 #idea Proposed for #8514: Leave the issue as-is, accepting its current state. 15:15:16 !propose accept 15:15:16 fao89: Proposed for #8514: Leave the issue as-is, accepting its current state. 15:15:19 +1 15:15:20 +1 15:15:25 I'm backporting it today to 3.7 15:15:34 #agreed Leave the issue as-is, accepting its current state. 15:15:34 !accept 15:15:34 fao89: Current proposal accepted: Leave the issue as-is, accepting its current state. 15:15:35 fao89: No issues to triage. 15:15:36 ttereshc++ 15:15:37 daviddavis: ttereshc's karma is now 341 15:15:38 ggainey, user would need 3 patches 15:15:40 if they try 15:15:42 not 1 15:15:46 ttereshc: fun! 15:15:51 ttereshc++ 15:15:51 fao89: ttereshc's karma is now 342 15:15:57 yeah, that whole sequence was ugly 15:16:02 ttereshc++ indeed 15:16:13 ttereshc++ 15:16:13 ggainey: ttereshc's karma is now 343 15:16:18 silly pulpbot 15:16:19 #endmeeting 15:16:19 !end