After an evaluation, GNOME has moved from Bugzilla to GitLab. Learn more about GitLab.
No new issues can be reported in GNOME Bugzilla anymore.
To report an issue in a GNOME project, go to GNOME GitLab.
Do not go to GNOME Gitlab for: Bluefish, Doxygen, GnuCash, GStreamer, java-gnome, LDTP, NetworkManager, Tomboy.
Bug 707827 - gnome-ostree: speed up compose process
gnome-ostree: speed up compose process
Status: RESOLVED OBSOLETE
Product: gnome-continuous
Classification: Other
Component: general
unspecified
Other Linux
: Normal normal
: ---
Assigned To: GNOME Continuous maintainer(s)
GNOME Continuous maintainer(s)
Depends on:
Blocks:
 
 
Reported: 2013-09-10 03:27 UTC by Colin Walters
Modified: 2021-06-05 16:29 UTC
See Also:
GNOME target: ---
GNOME version: ---


Attachments
Don't look for .la files twice when we're preparing build results (866 bytes, patch)
2014-06-04 14:03 UTC, Vadim Rutkovsky
reviewed Details | Review
Disable fsync in ostree repos (724 bytes, patch)
2014-06-04 14:04 UTC, Vadim Rutkovsky
needs-work Details | Review

Description Colin Walters 2013-09-10 03:27:22 UTC
Right now we:

Check out a union of all components.
Run the triggers, which generate new files like /usr/share/icons/icon-theme.cache
Re-commit the tree to the repo to pick up those new files, but we use --link-checkout-speedup to backreference from device/inode to checksum to avoid re-checksumming things.

Instead we could:
Check out a union of all components.
Gather the mtime on each directory
Run the triggers, which generate new files like /usr/share/icons/icon-theme.cache
Search the tree again, find directories which have changed
For each modified directory, look for new files
Make a new commit which does an in *memory* union of the components, plus those new files.
Comment 1 Vadim Rutkovsky 2014-06-04 14:03:37 UTC
Created attachment 277873 [details] [review]
Don't look for .la files twice when we're preparing build results

This patch has significanly increased build speed - for an average of 800s to 20-40s
Comment 2 Vadim Rutkovsky 2014-06-04 14:04:40 UTC
Created attachment 277874 [details] [review]
Disable fsync in ostree repos

This one is a bit dangerous and doesn't speed things up a lot, but might be useful for some people
Comment 3 Colin Walters 2014-06-04 15:13:49 UTC
Review of attachment 277873 [details] [review]:

Sure.
Comment 4 Colin Walters 2014-06-04 15:16:19 UTC
Review of attachment 277874 [details] [review]:

Mmm.  Maybe we should make this configurable somehow by the build server admin?
Comment 6 Vadim Rutkovsky 2014-06-04 15:24:15 UTC
Review of attachment 277874 [details] [review]:

Agreed, I think I can rework it later
Comment 7 Colin Walters 2014-06-04 16:38:36 UTC
(In reply to comment #6)
> Review of attachment 277874 [details] [review]:
> 
> Agreed, I think I can rework it later

Could change it to honor an environment variable or something for now?
Comment 8 André Klapper 2021-06-05 16:29:39 UTC
gnome-continuous is not under active development anymore. Its codebase has been archived: https://gitlab.gnome.org/Archive/gnome-continuous

Closing all its open tickets as part of housekeeping.