After an evaluation, GNOME has moved from Bugzilla to GitLab. Learn more about GitLab.
No new issues can be reported in GNOME Bugzilla anymore.
To report an issue in a GNOME project, go to GNOME GitLab.
Do not go to GNOME Gitlab for: Bluefish, Doxygen, GnuCash, GStreamer, java-gnome, LDTP, NetworkManager, Tomboy.
Bug 675873 - Separate modulesets
Separate modulesets
Status: RESOLVED OBSOLETE
Product: jhbuild
Classification: Infrastructure
Component: module sets
unspecified
Other Linux
: Normal normal
: ---
Assigned To: Jhbuild maintainers
Jhbuild QA
: 742041 (view as bug list)
Depends on: 675934
Blocks:
 
 
Reported: 2012-05-11 12:50 UTC by Matthias Clasen
Modified: 2021-05-17 15:53 UTC
See Also:
GNOME target: ---
GNOME version: ---


Attachments
Change fallback URI (963 bytes, patch)
2015-03-22 23:10 UTC, Javier Jardón (IRC: jjardon)
none Details | Review
defaults.jhbuildrc: change 'moduleset' variable to new location (842 bytes, patch)
2015-03-22 23:11 UTC, Javier Jardón (IRC: jjardon)
none Details | Review
docs: moduleset varialbe should be a URI (1.55 KB, patch)
2015-03-22 23:12 UTC, Javier Jardón (IRC: jjardon)
none Details | Review
moduleset.py: raise an error if moduleset varialbe is not an URI (1.48 KB, patch)
2015-03-22 23:12 UTC, Javier Jardón (IRC: jjardon)
none Details | Review
Remove the new obsolete use_local_moduleset config variable (3.81 KB, patch)
2015-03-22 23:13 UTC, Javier Jardón (IRC: jjardon)
none Details | Review
moduleset.py: raise an error if moduleset varialbe is not an URI.v2 (1.48 KB, patch)
2015-03-23 00:25 UTC, Javier Jardón (IRC: jjardon)
none Details | Review

Description Matthias Clasen 2012-05-11 12:50:13 UTC
As jhbuild grows into a standalone tool with tarball releases that is perhaps even shipped by distributions, it becomes more pressing to separate the data from tool, so we don't end up in murky situations where we co-develop the data format and the tool thats reading it.

At the same time, we can move from the somewhat odd -version suffixes to using proper branches and tags for modulesets.

We have a working module with the 3.4 and 3.6 modulesets here:
http://git.gnome.org/browse/gnome-modulesets

The other pieces that are needed are

1. publish the modulesets from that module on api.gnome.org

2. change jhbuild to default to that location

3. update documentation to point to the new, final location (hard to say where, but at least going over the jhbuild docs and live.gnome.org would be advisable)

4. drop the modulesets/ directory from jhbuild
Comment 1 Colin Walters 2012-05-11 13:26:36 UTC
Makes sense to me.  I in fact just did the same thing with ostree:

http://git.gnome.org/browse/gnome-ostree/tree/
Comment 2 Frederic Peters 2012-05-12 11:25:52 UTC
I filed bug 675934 for the sysadmin side of this bug.
Comment 3 Frederic Peters 2012-05-12 11:36:19 UTC
For jhbuild, what must be done:

- change defaults.jhbuildrc moduleset variable to be http://api.gnome.org/modulesets/$version/gnome.modules (or whatever location ends up decided in bug 675934)
- change jhbuild documentation to mention the moduleset variable should be a URI (or a list of URI)
- add fallback (or error message?) when that variable is just the moduleset name (important as jhbuildrc all over the place will have things like "moduleset = 'gnome-world-3.6'")
- remove the then obsolete use_local_modulesets config variable

As a transition measure we could keep the modulesets/ directory in jbhuild, with only 3.6 files changed to be a serie of <include ...> to the new location. This would avoid people commiting changes to those while giving some time to people upgrading their jhbuild copy.
Comment 4 Marcin Wojdyr 2012-10-09 17:24:27 UTC
It would be also convenient for me if jhbuild was distributed without gnome modules. Any chances this will happen?
Comment 5 Javier Jardón (IRC: jjardon) 2015-03-22 23:10:48 UTC
Created attachment 300097 [details] [review]
Change fallback URI
Comment 6 Javier Jardón (IRC: jjardon) 2015-03-22 23:11:30 UTC
Created attachment 300098 [details] [review]
defaults.jhbuildrc: change 'moduleset' variable to new location
Comment 7 Javier Jardón (IRC: jjardon) 2015-03-22 23:12:11 UTC
Created attachment 300099 [details] [review]
docs: moduleset varialbe should be a URI
Comment 8 Javier Jardón (IRC: jjardon) 2015-03-22 23:12:47 UTC
Created attachment 300100 [details] [review]
moduleset.py: raise an error if moduleset varialbe is not an URI
Comment 9 Javier Jardón (IRC: jjardon) 2015-03-22 23:13:36 UTC
Created attachment 300101 [details] [review]
Remove the new obsolete use_local_moduleset config variable
Comment 10 Javier Jardón (IRC: jjardon) 2015-03-23 00:25:48 UTC
Created attachment 300102 [details] [review]
moduleset.py: raise an error if moduleset varialbe is not an URI.v2
Comment 11 Javier Jardón (IRC: jjardon) 2015-03-23 00:26:43 UTC
Branch available here: https://git.gnome.org/browse/jhbuild/log/?h=jjardon/gnome-modulesets
Comment 12 Frederic Peters 2015-03-23 07:24:19 UTC
I wouldn't want to break compatibility with existing jhbuildrc files, modulesets should continue to allow strings.  Also they should allow file:/// URIs and that should be documented.
Comment 13 John Ralls 2015-03-23 08:08:48 UTC
As long as we're pushing URIs it would be nice to be able to set a base uri (file or https) and have string moduleset values appended to it.
Comment 14 Javier Jardón (IRC: jjardon) 2015-03-30 17:13:26 UTC
(In reply to Frederic Peters from comment #12)
> I wouldn't want to break compatibility with existing jhbuildrc files,
> modulesets should continue to allow strings.  Also they should allow
> file:/// URIs and that should be documented.

But we are changing the name of the moduleset from gnome-apps-3.16 to gnome-apps (or in a different branch, if you want to build a older version)
Are we sure we want to keep compatibility with this big change? If yes, any idea about the best approach in python (sorry, not a pythonic person here)
Comment 15 Frederic Peters 2015-04-09 16:32:27 UTC
I have now pushed support for a <redirect/> tag:

commit eea3ce6be0fbe8b6b9f0ca3ea9bb11c5d2835a9e
Author: Frédéric Péters <fpeters@0d.be>
Date:   Thu Apr 9 18:26:06 2015 +0200

    add support for a <redirect/> tag, to be used when modulesets are moved
    
    It will be used to keep existing instructions and configuration files working
    after modulesets are moved in their own repository.
    
    <redirect href="https://git.gnome.org/browse/gnome-modulesets/plain/gnome-core.modules?h=gnome-3-16"/>
Comment 16 Frederic Peters 2015-04-09 17:54:21 UTC
Writing down that URL as an example reminded me we need a stable location, we do not want to depend on cgit being installed on git.gnome.org and serving the files using those paths and query strings.

Bug 675934 was marked as obsolete when the sysadmin moved to RT, I'll reopen it now that they're back on bugzilla.
Comment 17 Javier Jardón (IRC: jjardon) 2015-04-21 16:58:12 UTC
(In reply to Frederic Peters from comment #15)
> I have now pushed support for a <redirect/> tag:
> 
> commit eea3ce6be0fbe8b6b9f0ca3ea9bb11c5d2835a9e
> Author: Frédéric Péters <fpeters@0d.be>
> Date:   Thu Apr 9 18:26:06 2015 +0200
> 
>     add support for a <redirect/> tag, to be used when modulesets are moved
>     
>     It will be used to keep existing instructions and configuration files
> working
>     after modulesets are moved in their own repository.
>     
>     <redirect
> href="https://git.gnome.org/browse/gnome-modulesets/plain/gnome-core.
> modules?h=gnome-3-16"/>

Great! I reworked the https://git.gnome.org/browse/jhbuild/log/?h=jjardon/gnome-modulesets branch to use the <redirect/> tag
I only left the gnome-apps-3.[18|16|14] and gnome-world modulesets files for compatibility. Is that enough or should we leave more files in the jhbuild repo?
Comment 18 Frederic Peters 2015-04-21 17:51:17 UTC
We should leave the moduleset.dtd/rnc/xsl and schemas.xml for validation purpose.

We also have to keep th bootstrap.modules as it's used internally, at least for now.

As far as the branch is concerned, I would also go with John Ralls' comment #13 to have a base uri setting; this would be set by default to https://api.gnome.org/jhbuild/modulesets/3.16/.

Talking about that URI, I thus reopened bug 675934 but this probably needs to be more actively pushed.
Comment 19 Frederic Peters 2016-01-27 16:11:12 UTC
*** Bug 742041 has been marked as a duplicate of this bug. ***
Comment 20 Alberts Muktupāvels 2017-04-27 18:56:50 UTC
Is there any plans to finish this?
Comment 21 GNOME Infrastructure Team 2021-05-17 15:53:27 UTC
-- GitLab Migration Automatic Message --

This bug has been migrated to GNOME's GitLab instance and has been closed from further activity.

You can subscribe and participate further through the new bug through this link to our GitLab instance: https://gitlab.gnome.org/GNOME/jhbuild/-/issues/132.