pg.ddx.io pgsql-hackers@postgresql.org mailing list archive
help / color / mirror / Atom feedconfigure and DocBook XML
16+ messages / 5 participants
[nested] [flat]
Commits from this thread:
2020-11-30 4823c4f6ac ef1a785fa4 8d0155962e d34916fee5 Remove configure-time probe for DocBook DTD.
* configure and DocBook XML
@ 2020-11-26 09:11 Paul Förster <paul.foerster@gmail.com>
0 siblings, 1 reply; 16+ messages in thread
From: Paul Förster @ 2020-11-26 09:11 UTC (permalink / raw)
To: pgsql-hackers@lists.postgresql.org
Hi,
I always compile PostgreSQL from source and never install a pre-compiled package. When I run configure, the last check, which is for DocBook XML always takes very long compared to all others. It's about 15 to 20 secs or so. I noticed that with many configure scripts, not only the one of PostgreSQL. Why is that?
Cheers,
Paul
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: configure and DocBook XML
@ 2020-11-26 13:47 Alvaro Herrera <alvherre@alvh.no-ip.org>
parent: Paul Förster <paul.foerster@gmail.com>
0 siblings, 1 reply; 16+ messages in thread
From: Alvaro Herrera @ 2020-11-26 13:47 UTC (permalink / raw)
To: Paul Förster <paul.foerster@gmail.com>; +Cc: pgsql-hackers@lists.postgresql.org
On 2020-Nov-26, Paul Förster wrote:
> Hi,
>
> I always compile PostgreSQL from source and never install a pre-compiled package. When I run configure, the last check, which is for DocBook XML always takes very long compared to all others. It's about 15 to 20 secs or so. I noticed that with many configure scripts, not only the one of PostgreSQL. Why is that?
My guess is that it's related to trying to obtain stylesheets from
remote Internet locations that are missing locally.
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: configure and DocBook XML
@ 2020-11-26 13:52 Paul Förster <paul.foerster@gmail.com>
parent: Alvaro Herrera <alvherre@alvh.no-ip.org>
0 siblings, 1 reply; 16+ messages in thread
From: Paul Förster @ 2020-11-26 13:52 UTC (permalink / raw)
To: Alvaro Herrera <alvherre@alvh.no-ip.org>; +Cc: pgsql-hackers@lists.postgresql.org
Hi Alvaro,
> On 26. Nov, 2020, at 14:47, Alvaro Herrera <alvherre@alvh.no-ip.org> wrote:
>
> My guess is that it's related to trying to obtain stylesheets from
> remote Internet locations that are missing locally.
I don't know DocBook at all, so I can't say. But it takes about the same time, whether I run configure on a machine that is connected to the internet or one that isn't.
Whatever it does, it's more out of curiosity. PostgreSQL compiles fine and this is what counts. :-)
Cheers,
Paul
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: configure and DocBook XML
@ 2020-11-26 14:19 Alvaro Herrera <alvherre@alvh.no-ip.org>
parent: Paul Förster <paul.foerster@gmail.com>
0 siblings, 2 replies; 16+ messages in thread
From: Alvaro Herrera @ 2020-11-26 14:19 UTC (permalink / raw)
To: Paul Förster <paul.foerster@gmail.com>; +Cc: pgsql-hackers@lists.postgresql.org
On 2020-Nov-26, Paul Förster wrote:
> Hi Alvaro,
>
> > On 26. Nov, 2020, at 14:47, Alvaro Herrera <alvherre@alvh.no-ip.org> wrote:
> >
> > My guess is that it's related to trying to obtain stylesheets from
> > remote Internet locations that are missing locally.
>
> I don't know DocBook at all, so I can't say. But it takes about the
> same time, whether I run configure on a machine that is connected to
> the internet or one that isn't.
It might be timing out, then. (The docbook test takes well under a
second for me, but that's probably because I have all stylesheets
locally).
One way to know for sure would be to run it under strace, and see where
it takes a large number of seconds. Maybe something like
strace -f -etrace=%network -T -tt -o/tmp/configure.trace ./configure <opts>
> Whatever it does, it's more out of curiosity. PostgreSQL compiles fine
> and this is what counts. :-)
Well, it is what it is partly because people have struggled to polish
these little annoyances :-)
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: configure and DocBook XML
@ 2020-11-26 14:24 Paul Förster <paul.foerster@gmail.com>
parent: Alvaro Herrera <alvherre@alvh.no-ip.org>
1 sibling, 0 replies; 16+ messages in thread
From: Paul Förster @ 2020-11-26 14:24 UTC (permalink / raw)
To: Alvaro Herrera <alvherre@alvh.no-ip.org>; +Cc: pgsql-hackers@lists.postgresql.org
Hi Alvaro,
> On 26. Nov, 2020, at 15:19, Alvaro Herrera <alvherre@alvh.no-ip.org> wrote:
>
> One way to know for sure would be to run it under strace, and see where
> it takes a large number of seconds. Maybe something like
> strace -f -etrace=%network -T -tt -o/tmp/configure.trace ./configure <opts>
ok, I'll try this. Thanks very much.
> Well, it is what it is partly because people have struggled to polish
> these little annoyances :-)
it's not an annoyance for me with a thing I do 3 or 4 times a year. I'm a DBA, not a developer, so I just build new packages when new versions are released. I don't have to build a couple of times per day. :-)
Cheers,
Paul
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: configure and DocBook XML
@ 2020-11-26 16:21 Tom Lane <tgl@sss.pgh.pa.us>
parent: Alvaro Herrera <alvherre@alvh.no-ip.org>
1 sibling, 1 reply; 16+ messages in thread
From: Tom Lane @ 2020-11-26 16:21 UTC (permalink / raw)
To: Alvaro Herrera <alvherre@alvh.no-ip.org>; +Cc: Paul Förster <paul.foerster@gmail.com>; pgsql-hackers@lists.postgresql.org
Alvaro Herrera <alvherre@alvh.no-ip.org> writes:
> On 2020-Nov-26, Paul Förster wrote:
>> On 26. Nov, 2020, at 14:47, Alvaro Herrera <alvherre@alvh.no-ip.org> wrote:
>>> My guess is that it's related to trying to obtain stylesheets from
>>> remote Internet locations that are missing locally.
>> I don't know DocBook at all, so I can't say. But it takes about the
>> same time, whether I run configure on a machine that is connected to
>> the internet or one that isn't.
> It might be timing out, then. (The docbook test takes well under a
> second for me, but that's probably because I have all stylesheets
> locally).
On machines where I don't have the stylesheets installed, it always
takes several seconds (2 or 3, I think, though I've not put a stopwatch
on it). 15 to 20 sec does seem like a lot, so it makes me wonder if
Paul's network environment is well-configured.
There's a nearby thread in which I was suggesting that we should just
not bother with this configure test [1].
regards, tom lane
[1] https://www.postgresql.org/message-id/flat/E2EE6B76-2D96-408A-B961-CAE47D1A86F0%40yesql.se
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: configure and DocBook XML
@ 2020-11-26 16:32 Paul Förster <paul.foerster@gmail.com>
parent: Tom Lane <tgl@sss.pgh.pa.us>
0 siblings, 1 reply; 16+ messages in thread
From: Paul Förster @ 2020-11-26 16:32 UTC (permalink / raw)
To: Tom Lane <tgl@sss.pgh.pa.us>; +Cc: Alvaro Herrera <alvherre@alvh.no-ip.org>; pgsql-hackers@lists.postgresql.org
Hi Tom,
> On 26. Nov, 2020, at 17:21, Tom Lane <tgl@sss.pgh.pa.us> wrote:
>
> On machines where I don't have the stylesheets installed, it always
> takes several seconds (2 or 3, I think, though I've not put a stopwatch
> on it). 15 to 20 sec does seem like a lot, so it makes me wonder if
> Paul's network environment is well-configured.
can't complain here. The net and all other stuff run smoothly. No timeouts, no things being slow or any other problem.
> There's a nearby thread in which I was suggesting that we should just
> not bother with this configure test [1].
> [1] https://www.postgresql.org/message-id/flat/E2EE6B76-2D96-408A-B961-CAE47D1A86F0%40yesql.se
I haven't installed DocBook at all. So the check for DocBook naturally always fails. Could that be the reason?
Cheers,
Paul
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: configure and DocBook XML
@ 2020-11-26 16:48 Tom Lane <tgl@sss.pgh.pa.us>
parent: Paul Förster <paul.foerster@gmail.com>
0 siblings, 2 replies; 16+ messages in thread
From: Tom Lane @ 2020-11-26 16:48 UTC (permalink / raw)
To: Paul Förster <paul.foerster@gmail.com>; +Cc: Alvaro Herrera <alvherre@alvh.no-ip.org>; pgsql-hackers@lists.postgresql.org
=?utf-8?Q?Paul_F=C3=B6rster?= <paul.foerster@gmail.com> writes:
> On 26. Nov, 2020, at 17:21, Tom Lane <tgl@sss.pgh.pa.us> wrote:
>> There's a nearby thread in which I was suggesting that we should just
>> not bother with this configure test [1].
>> [1] https://www.postgresql.org/message-id/flat/E2EE6B76-2D96-408A-B961-CAE47D1A86F0%40yesql.se
> I haven't installed DocBook at all. So the check for DocBook naturally always fails. Could that be the reason?
If you don't have the docbook stylesheets, but you do have xmllint,
configure's probe will cause xmllint to try to download those
stylesheets off the net. For me, that always succeeds, but it
takes two or three seconds. I find it curious that it seems to be
timing out for you.
regards, tom lane
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: configure and DocBook XML
@ 2020-11-27 08:46 Paul Förster <paul.foerster@gmail.com>
parent: Tom Lane <tgl@sss.pgh.pa.us>
1 sibling, 1 reply; 16+ messages in thread
From: Paul Förster @ 2020-11-27 08:46 UTC (permalink / raw)
To: Tom Lane <tgl@sss.pgh.pa.us>; +Cc: Alvaro Herrera <alvherre@alvh.no-ip.org>; pgsql-hackers@lists.postgresql.org
Hi Tom,
> On 26. Nov, 2020, at 17:48, Tom Lane <tgl@sss.pgh.pa.us> wrote:
>
> If you don't have the docbook stylesheets, but you do have xmllint,
> configure's probe will cause xmllint to try to download those
> stylesheets off the net. For me, that always succeeds, but it
> takes two or three seconds. I find it curious that it seems to be
> timing out for you.
well, openSUSE 15.2 Leap here:
paul@weasel:~$ xmllint --version
xmllint: using libxml version 20907
compiled with: Threads Tree Output Push Reader Patterns Writer SAXv1 FTP HTTP DTDValid HTML Legacy C14N Catalog XPath XPointer XInclude Iconv ISO8859X Unicode Regexps Automata Expr Schemas Schematron Modules Debug Zlib Lzma
paul@weasel:~$ type -a xmllint
xmllint is /usr/bin/xmllint
paul@weasel:~$ zypper se 'xmllint*'
Loading repository data...
Reading installed packages...
No matching items found.
I wonder why zypper tells me, it's not there. If I use yast2 (GUI) to search it, it's there.
Anyway, DocBook XML is definitely not there, neither in zypper se, nor in yast2.
So why would xmllint try to download DocBook XML stylesheets if DocBook is not installed? I'm not a developer but such a thing doesn't make sense to me.
Cheers,
Paul
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: configure and DocBook XML
@ 2020-11-27 15:29 Tom Lane <tgl@sss.pgh.pa.us>
parent: Paul Förster <paul.foerster@gmail.com>
0 siblings, 2 replies; 16+ messages in thread
From: Tom Lane @ 2020-11-27 15:29 UTC (permalink / raw)
To: Paul Förster <paul.foerster@gmail.com>; +Cc: Alvaro Herrera <alvherre@alvh.no-ip.org>; pgsql-hackers@lists.postgresql.org
=?utf-8?Q?Paul_F=C3=B6rster?= <paul.foerster@gmail.com> writes:
> So why would xmllint try to download DocBook XML stylesheets if DocBook is not installed? I'm not a developer but such a thing doesn't make sense to me.
You'd have to ask the authors of those programs.
To me, it makes sense to have an option to do that, but I do find it
surprising that it's the default.
regards, tom lane
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: configure and DocBook XML
@ 2020-11-27 17:11 Peter Eisentraut <peter.eisentraut@enterprisedb.com>
parent: Tom Lane <tgl@sss.pgh.pa.us>
1 sibling, 0 replies; 16+ messages in thread
From: Peter Eisentraut @ 2020-11-27 17:11 UTC (permalink / raw)
To: Tom Lane <tgl@sss.pgh.pa.us>; Paul Förster <paul.foerster@gmail.com>; +Cc: Alvaro Herrera <alvherre@alvh.no-ip.org>; pgsql-hackers@lists.postgresql.org
On 2020-11-26 17:48, Tom Lane wrote:
> =?utf-8?Q?Paul_F=C3=B6rster?= <paul.foerster@gmail.com> writes:
>> On 26. Nov, 2020, at 17:21, Tom Lane <tgl@sss.pgh.pa.us> wrote:
>>> There's a nearby thread in which I was suggesting that we should just
>>> not bother with this configure test [1].
>>> [1] https://www.postgresql.org/message-id/flat/E2EE6B76-2D96-408A-B961-CAE47D1A86F0%40yesql.se
>
>> I haven't installed DocBook at all. So the check for DocBook naturally always fails. Could that be the reason?
>
> If you don't have the docbook stylesheets, but you do have xmllint,
> configure's probe will cause xmllint to try to download those
> stylesheets off the net. For me, that always succeeds, but it
> takes two or three seconds. I find it curious that it seems to be
> timing out for you.
Correction: xmllint is interested in the DocBook XML DTD, which is
downloadable from
<http://www.oasis-open.org/docbook/xml/4.5/docbookx.dtd;. This is what
might be in a package named "docbook" or "docbook-xml". xsltproc is
interested in the DocBook XSLT stylesheets, which are at
<http://docbook.sourceforge.net/release/xsl/current/xhtml/chunk.xsl;, or
locally in a package named something like "docbook-xsl".
AFAICT, configure only runs an xmllint test, so your download issues (at
that point) are likely related to the DTD, not the stylesheets.
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: configure and DocBook XML
@ 2020-11-27 17:50 Paul Förster <paul.foerster@gmail.com>
parent: Tom Lane <tgl@sss.pgh.pa.us>
1 sibling, 1 reply; 16+ messages in thread
From: Paul Förster @ 2020-11-27 17:50 UTC (permalink / raw)
To: Tom Lane <tgl@sss.pgh.pa.us>; +Cc: Alvaro Herrera <alvherre@alvh.no-ip.org>; pgsql-hackers@lists.postgresql.org
Hi Tom,
> On 27. Nov, 2020, at 16:29, Tom Lane <tgl@sss.pgh.pa.us> wrote:
>
> To me, it makes sense to have an option to do that, but I do find it
> surprising that it's the default.
ok, last question: is there an option for configure to not check for DocBook? It's not installed and PostgreSQL doesn't need it to compile and run just fine.
As I said, it's not an annoyance or something as I only need to build new binaries after the versions (major and minor) are released, which is not often enough to call it an annoyance. :-) I just would like to switch it off if possible, but it's ok if it's not.
Cheers,
Paul
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: configure and DocBook XML
@ 2020-11-27 17:54 Tom Lane <tgl@sss.pgh.pa.us>
parent: Paul Förster <paul.foerster@gmail.com>
0 siblings, 1 reply; 16+ messages in thread
From: Tom Lane @ 2020-11-27 17:54 UTC (permalink / raw)
To: Paul Förster <paul.foerster@gmail.com>; +Cc: Alvaro Herrera <alvherre@alvh.no-ip.org>; pgsql-hackers@lists.postgresql.org
=?utf-8?Q?Paul_F=C3=B6rster?= <paul.foerster@gmail.com> writes:
> ok, last question: is there an option for configure to not check for DocBook? It's not installed and PostgreSQL doesn't need it to compile and run just fine.
See the other thread I pointed to.
regards, tom lane
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: configure and DocBook XML
@ 2020-11-27 17:56 Paul Förster <paul.foerster@gmail.com>
parent: Tom Lane <tgl@sss.pgh.pa.us>
0 siblings, 0 replies; 16+ messages in thread
From: Paul Förster @ 2020-11-27 17:56 UTC (permalink / raw)
To: Tom Lane <tgl@sss.pgh.pa.us>; +Cc: Alvaro Herrera <alvherre@alvh.no-ip.org>; pgsql-hackers@lists.postgresql.org
Hi Tom,
> On 27. Nov, 2020, at 18:54, Tom Lane <tgl@sss.pgh.pa.us> wrote:
>
> See the other thread I pointed to.
ok, thanks.
Cheers,
Paul
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: configure and DocBook XML
@ 2020-11-29 07:14 Michael Paquier <michael@paquier.xyz>
parent: Tom Lane <tgl@sss.pgh.pa.us>
1 sibling, 1 reply; 16+ messages in thread
From: Michael Paquier @ 2020-11-29 07:14 UTC (permalink / raw)
To: Tom Lane <tgl@sss.pgh.pa.us>; +Cc: Paul Förster <paul.foerster@gmail.com>; Alvaro Herrera <alvherre@alvh.no-ip.org>; pgsql-hackers@lists.postgresql.org
On Fri, Nov 27, 2020 at 10:29:24AM -0500, Tom Lane wrote:
> To me, it makes sense to have an option to do that, but I do find it
> surprising that it's the default.
But there is no need for an option, right? It is already possible to
override the location where xmllint looks for the catalogs by setting
SGML_CATALOG_FILES and XML_CATALOG_FILES. Not sure for SUSE, but one
can use /etc/{sgml,xml}/catalog on Debian, allowing the configure
check to rely on what's stored locally, making configure not rely on
any external resource.
--
Michael
Attachments:
signature.asc (application/pgp-signature, 832B) download
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: configure and DocBook XML
@ 2020-11-29 17:19 Tom Lane <tgl@sss.pgh.pa.us>
parent: Michael Paquier <michael@paquier.xyz>
0 siblings, 0 replies; 16+ messages in thread
From: Tom Lane @ 2020-11-29 17:19 UTC (permalink / raw)
To: Michael Paquier <michael@paquier.xyz>; +Cc: Paul Förster <paul.foerster@gmail.com>; Alvaro Herrera <alvherre@alvh.no-ip.org>; pgsql-hackers@lists.postgresql.org
Michael Paquier <michael@paquier.xyz> writes:
> On Fri, Nov 27, 2020 at 10:29:24AM -0500, Tom Lane wrote:
>> To me, it makes sense to have an option to do that, but I do find it
>> surprising that it's the default.
> But there is no need for an option, right? It is already possible to
> override the location where xmllint looks for the catalogs by setting
> SGML_CATALOG_FILES and XML_CATALOG_FILES.
But the issue here is about what happens when you don't have a local
copy of the DTD. I don't think adjusting those variables will
change that.
Anyway, I think that the other thread is coming to the conclusion
that it's okay to just document how to inject --nonet via configure,
so we don't need to touch the makefiles. As long as we get rid of
the unrequested network fetch during configure, it's okay by me if an
actual attempt to build the docs will possibly cause a network fetch.
regards, tom lane
^ permalink raw reply [nested|flat] 16+ messages in thread
end of thread, other threads:[~2020-11-29 17:19 UTC | newest]
Thread overview: 16+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2020-11-26 09:11 configure and DocBook XML Paul Förster <paul.foerster@gmail.com>
2020-11-26 13:47 ` Alvaro Herrera <alvherre@alvh.no-ip.org>
2020-11-26 13:52 ` Paul Förster <paul.foerster@gmail.com>
2020-11-26 14:19 ` Alvaro Herrera <alvherre@alvh.no-ip.org>
2020-11-26 14:24 ` Paul Förster <paul.foerster@gmail.com>
2020-11-26 16:21 ` Tom Lane <tgl@sss.pgh.pa.us>
2020-11-26 16:32 ` Paul Förster <paul.foerster@gmail.com>
2020-11-26 16:48 ` Tom Lane <tgl@sss.pgh.pa.us>
2020-11-27 08:46 ` Paul Förster <paul.foerster@gmail.com>
2020-11-27 15:29 ` Tom Lane <tgl@sss.pgh.pa.us>
2020-11-27 17:50 ` Paul Förster <paul.foerster@gmail.com>
2020-11-27 17:54 ` Tom Lane <tgl@sss.pgh.pa.us>
2020-11-27 17:56 ` Paul Förster <paul.foerster@gmail.com>
2020-11-29 07:14 ` Michael Paquier <michael@paquier.xyz>
2020-11-29 17:19 ` Tom Lane <tgl@sss.pgh.pa.us>
2020-11-27 17:11 ` Peter Eisentraut <peter.eisentraut@enterprisedb.com>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox