GNOME Bugzilla – Bug 793599
Please run testsuite with V=0
Last modified: 2018-04-14 10:49:44 UTC
Hello, seems that running testsuite with V=1 makes the testsuite fail, because of the verbosity introduced by the mkhtml and mkpdf tools: gtkdoc-mkhtml --uninstalled --path=/<<PKGBUILDDIR>>/tests/annotations/docs --verbose tester ../tester-docs.xml Computing chunks... Writing tester-GtkdocTester.html for refentry(tester-GtkdocTester) Writing main-api.html for chapter(main-api) Writing rn01.html for reference Writing api-index.html for index(api-index) Writing deprecated-api-index.html for index(deprecated-api-index) Writing glossary.html for glossary(glossary) Writing annotation-glossary.html for glossary(annotation-glossary) Writing pt01.html for part Writing index.html for book(index) Writing tester.devhelp2 for book(index) begin dump gtkdoc-mkpdf --uninstalled --path=/<<PKGBUILDDIR>>/tests/annotations/docs --verbose tester tester-docs.xml Build the book set list... Build the listings... XSLT stylesheets DocBook - LaTeX 2e (0.3.10) =================================================== Build tester-docs.pdf processing index /tmp/tmp6YodYY/tester-docs.idx... This is makeindex, version 2.15 [TeX Live 2017] (kpathsea + Thai support). Scanning style file /usr/share/dblatex/latex/scripts/doc.ist....done (4 attributes redefined, 0 ignored). Scanning input file /tmp/tmp6YodYY/tester-docs.idx....done (26 entries accepted, 0 rejected). Sorting entries....done (120 comparisons). Generating output file tester-docs.ind....done (40 lines written, 0 warnings). Output written in tester-docs.ind. Transcript written in tester-docs.ilg. 'tester.pdf' successfully built begin dump gtkdoc-mkhtml --uninstalled --path=/<<PKGBUILDDIR>>/tests/bugs/docs --verbose tester ../tester-docs.xml Computing chunks... Writing tester-GtkdocTester.html for refentry(tester-GtkdocTester) Writing ch01.html for chapter Writing api-index.html for index(api-index) Writing deprecated-api-index.html for index(deprecated-api-index) Writing api-index-0-1.html for index(api-index-0-1) Writing index.html for book(index) Writing tester.devhelp2 for book(index) begin dump gtkdoc-mkpdf --uninstalled --path=/<<PKGBUILDDIR>>/tests/bugs/docs --verbose tester tester-docs.xml Build the book set list... Build the listings... XSLT stylesheets DocBook - LaTeX 2e (0.3.10) =================================================== Build tester-docs.pdf processing index /tmp/tmpvGjUV4/tester-docs.idx... This is makeindex, version 2.15 [TeX Live 2017] (kpathsea + Thai support). Scanning style file /usr/share/dblatex/latex/scripts/doc.ist....done (4 attributes redefined, 0 ignored). Scanning input file /tmp/tmpvGjUV4/tester-docs.idx....done (69 entries accepted, 0 rejected). Sorting entries....done (483 comparisons). Generating output file tester-docs.ind....done (86 lines written, 0 warnings). Output written in tester-docs.ind. Transcript written in tester-docs.ilg. 'tester.pdf' successfully built begin dump gtkdoc-mkhtml --uninstalled --path=/<<PKGBUILDDIR>>/tests/empty/docs --verbose tester ../tester-docs.xml Computing chunks... Writing tester-GtkDocTestIf.html for refentry(tester-GtkDocTestIf) Writing ch01.html for chapter Writing object-tree.html for chapter(object-tree) Writing api-index-full.html for index(api-index-full) Writing deprecated-api-index.html for index(deprecated-api-index) Writing api-index-0-1.html for index(api-index-0-1) Writing index.html for book(index) Writing tester.devhelp2 for book(index) begin dump gtkdoc-mkpdf --uninstalled --path=/<<PKGBUILDDIR>>/tests/empty/docs --verbose tester tester-docs.xml Build the book set list... Build the listings... XSLT stylesheets DocBook - LaTeX 2e (0.3.10) =================================================== Build tester-docs.pdf processing index /tmp/tmpFir_ML/tester-docs.idx... This is makeindex, version 2.15 [TeX Live 2017] (kpathsea + Thai support). Scanning style file /usr/share/dblatex/latex/scripts/doc.ist....done (4 attributes redefined, 0 ignored). Scanning input file /tmp/tmpFir_ML/tester-docs.idx....done (4 entries accepted, 0 rejected). Sorting entries....done (9 comparisons). Generating output file tester-docs.ind....done (17 lines written, 0 warnings). Output written in tester-docs.ind. Transcript written in tester-docs.ilg. 'tester.pdf' successfully built begin dump gtkdoc-mkhtml --uninstalled --path=/<<PKGBUILDDIR>>/tests/fail/docs --verbose tester ../tester-docs.xml Computing chunks... Writing tester-GtkdocTesterBrokenDocs.html for refentry(tester-GtkdocTesterBrokenDocs) Writing ch01.html for chapter Writing api-index.html for index(api-index) Writing deprecated-api-index.html for index(deprecated-api-index) Writing index.html for book(index) Writing tester.devhelp2 for book(index) begin dump gtkdoc-mkpdf --uninstalled --path=/<<PKGBUILDDIR>>/tests/fail/docs --verbose tester tester-docs.xml Build the book set list... Build the listings... XSLT stylesheets DocBook - LaTeX 2e (0.3.10) =================================================== Build tester-docs.pdf processing index /tmp/tmpJ9pimC/tester-docs.idx... This is makeindex, version 2.15 [TeX Live 2017] (kpathsea + Thai support). Scanning style file /usr/share/dblatex/latex/scripts/doc.ist....done (4 attributes redefined, 0 ignored). Scanning input file /tmp/tmpJ9pimC/tester-docs.idx....done (13 entries accepted, 0 rejected). Sorting entries....done (48 comparisons). Generating output file tester-docs.ind....done (30 lines written, 0 warnings). Output written in tester-docs.ind. Transcript written in tester-docs.ilg. 'tester.pdf' successfully built begin dump gtkdoc-mkhtml --uninstalled --path=/<<PKGBUILDDIR>>/tests/gobject/docs --verbose tester ../tester-docs.xml Computing chunks... Writing intro.html for preface(intro) Writing Overview-building.html for chapter(Overview-building) Writing part.i.html for part(part.i) Writing GtkdocObject.html for refentry(GtkdocObject) Writing GtkdocObject2.html for refentry(GtkdocObject2) Writing GtkdocObject3.html for refentry(GtkdocObject3) Writing GtkdocIface.html for refentry(GtkdocIface) Writing GtkdocIface2.html for refentry(GtkdocIface2) Writing tester-GtkdocTypes.html for refentry(tester-GtkdocTypes) Writing main-api.html for chapter(main-api) Writing part.ii.html for reference(part.ii) Writing object-tree.html for chapter(object-tree) Writing object-index.html for chapter(object-index) Writing api-index-full.html for index(api-index-full) Writing api-index-deprecated.html for index(api-index-deprecated) Writing api-index-0-1.html for index(api-index-0-1) Writing api-index-0-5.html for index(api-index-0-5) Writing glossary.html for glossary(glossary) Writing annotation-glossary.html for glossary(annotation-glossary) Writing part.iii.html for part(part.iii) Writing index.html for book(index) Writing tester.devhelp2 for book(index) begin dump gtkdoc-mkpdf --uninstalled --path=/<<PKGBUILDDIR>>/tests/gobject/docs --verbose --imgdir=./images tester tester-docs.xml Build the book set list... Build the listings... XSLT stylesheets DocBook - LaTeX 2e (0.3.10) =================================================== Image 'xml/home.png' not found Image 'xml/home.png' not found Build tester-docs.pdf processing index /tmp/tmpGq7wlj/tester-docs.idx... This is makeindex, version 2.15 [TeX Live 2017] (kpathsea + Thai support). Scanning style file /usr/share/dblatex/latex/scripts/doc.ist....done (4 attributes redefined, 0 ignored). Scanning input file /tmp/tmpGq7wlj/tester-docs.idx....done (32 entries accepted, 0 rejected). Sorting entries....done (158 comparisons). Generating output file tester-docs.ind....done (36 lines written, 0 warnings). Output written in tester-docs.ind. Transcript written in tester-docs.ilg. 'tester.pdf' successfully built begin dump gtkdoc-scangobj --module=tester --verbose libtool: compile: gcc -Wdate-time -D_FORTIFY_SOURCE=2 -g -O2 -fdebug-prefix-map=/<<PKGBUILDDIR>>=. -fstack-protector-strong -Wformat -Werror=format-security -Wall -I../../../tests/gobject/src -I/usr/include/glib-2.0 -I/usr/lib/x86_64-linux-gnu/glib-2.0/include -g -O2 -fdebug-prefix-map=/<<PKGBUILDDIR>>=. -fstack-protector-strong -Wformat -Werror=format-security -Wall -c tester-scan.c -fPIC -DPIC -o .libs/tester-scan.o libtool: compile: gcc -Wdate-time -D_FORTIFY_SOURCE=2 -g -O2 -fdebug-prefix-map=/<<PKGBUILDDIR>>=. -fstack-protector-strong -Wformat -Werror=format-security -Wall -I../../../tests/gobject/src -I/usr/include/glib-2.0 -I/usr/lib/x86_64-linux-gnu/glib-2.0/include -g -O2 -fdebug-prefix-map=/<<PKGBUILDDIR>>=. -fstack-protector-strong -Wformat -Werror=format-security -Wall -c tester-scan.c -o tester-scan.o >/dev/null 2>&1 libtool: link: gcc -g -O2 -fdebug-prefix-map=/<<PKGBUILDDIR>>=. -fstack-protector-strong -Wformat -Werror=format-security -Wall -Wl,-Bsymbolic-functions -Wl,-z -Wl,relro .libs/tester-scan.o -Wl,-Bsymbolic-functions -Wl,-z -Wl,relro -o tester-scan -lgobject-2.0 -lglib-2.0 ../../../tests/gobject/src/.libs/libtester.a begin dump gtkdoc-mkhtml --uninstalled --path=/<<PKGBUILDDIR>>/tests/program/docs --verbose tester ../tester-docs.xml Computing chunks... Writing tester-test-program.html for refentry(tester-test-program) Writing ch01.html for chapter Writing api-index.html for index(api-index) Writing deprecated-api-index.html for index(deprecated-api-index) Writing index.html for book(index) Writing tester.devhelp2 for book(index) begin dump gtkdoc-mkpdf --uninstalled --path=/<<PKGBUILDDIR>>/tests/program/docs --verbose tester tester-docs.xml Build the book set list... Build the listings... XSLT stylesheets DocBook - LaTeX 2e (0.3.10) =================================================== Build tester-docs.pdf 'tester.pdf' successfully built begin dump gtkdoc-mkhtml --uninstalled --path=/<<PKGBUILDDIR>>/tests/repro/docs --verbose tester ../tester-docs.xml Computing chunks... Writing tester-tester.html for refentry(tester-tester) Writing ch01.html for chapter Writing api-index.html for index(api-index) Writing index.html for book(index) Writing tester.devhelp2 for book(index) begin dump gtkdoc-mkpdf --uninstalled --path=/<<PKGBUILDDIR>>/tests/repro/docs --verbose tester tester-docs.xml Build the book set list... Build the listings... XSLT stylesheets DocBook - LaTeX 2e (0.3.10) =================================================== so the check sanity.sh fails: expected no more than 1 log line in /<<PKGBUILDDIR>>/tests/annotations/docs/gtkdoc-mkhtml.log, but got 12 expected no more than 1 log line in /<<PKGBUILDDIR>>/tests/annotations/docs/gtkdoc-mkpdf.log, but got 15 expected no more than 1 log line in /<<PKGBUILDDIR>>/tests/bugs/docs/gtkdoc-mkhtml.log, but got 9 expected no more than 1 log line in /<<PKGBUILDDIR>>/tests/bugs/docs/gtkdoc-mkpdf.log, but got 15 expected no more than 1 log line in /<<PKGBUILDDIR>>/tests/empty/docs/gtkdoc-mkhtml.log, but got 10 expected no more than 1 log line in /<<PKGBUILDDIR>>/tests/empty/docs/gtkdoc-mkpdf.log, but got 15 expected no more than 1 log line in /<<PKGBUILDDIR>>/tests/fail/docs/gtkdoc-mkhtml.log, but got 8 expected no more than 1 log line in /<<PKGBUILDDIR>>/tests/fail/docs/gtkdoc-mkpdf.log, but got 15 expected no more than 1 log line in /<<PKGBUILDDIR>>/tests/gobject/docs/gtkdoc-mkhtml.log, but got 24 expected no more than 1 log line in /<<PKGBUILDDIR>>/tests/gobject/docs/gtkdoc-mkpdf.log, but got 17 expected no more than 1 log line in /<<PKGBUILDDIR>>/tests/gobject/docs/gtkdoc-scangobj.log, but got 4 expected no more than 1 log line in /<<PKGBUILDDIR>>/tests/program/docs/gtkdoc-mkhtml.log, but got 8 expected no more than 1 log line in /<<PKGBUILDDIR>>/tests/program/docs/gtkdoc-mkpdf.log, but got 7 expected no more than 1 log line in /<<PKGBUILDDIR>>/tests/repro/docs/gtkdoc-mkhtml.log, but got 7 expected no more than 1 log line in /<<PKGBUILDDIR>>/tests/repro/docs/gtkdoc-mkpdf.log, but got 15 85 %: Checks 7, Failures: 1 FAIL sanity.sh (exit status: 1) please export V=0 in the testsuite! thanks
Thanks for the report and feel free to send a patch. It does not seem to be as simple as just setting V=0 in TESTS_ENVIRONMENT :/
Hello, what about this patch? --- gtk-doc-1.27.orig/tests/gtk-doc.make +++ gtk-doc-1.27/tests/gtk-doc.make @@ -3,7 +3,7 @@ #################################### # Everything below here is generic # #################################### - +export V=0 if GTK_DOC_USE_LIBTOOL GTKDOC_CC = $(LIBTOOL) --tag=CC --mode=compile $(CC) $(INCLUDES) $(GTKDOC_DEPS_CFLAGS) $(AM_CPPFLAGS) $(CPPFLAGS) $(AM_CFLAGS) $(CFLAGS) GTKDOC_LD = $(LIBTOOL) --tag=CC --mode=link $(CC) $(GTKDOC_DEPS_LIBS) $(AM_CFLAGS) $(CFLAGS) $(AM_LDFLAGS) $(LDFLAGS) note: the V=0 needs to be done when *building* the files, not when running sanity.sh (that just check the output of the command)
Does this work for you? I have a change where instead I ignore the tests that check the number of output lines if run in verbose mode. I'll submit this for now. Feel free to re-open if you'd like to discuss this further though.
commit dbb4b84628a74eee4932fa7bd4e4a5b787c3ab82 Author: Stefan Sauer <ensonic@users.sf.net> Date: Fri Mar 23 22:08:56 2018 +0100 tests: skip some tests when run with V=1 Some tests verify the number of output lines and of course we get more output in verbose builds (V=1). Ideally we check stdout/stderr separately. For now just skip those checks if we run with V=1. Fixes #793599
thanks! 1.28 works correctly!