pg.ddx.io  pgsql-committers@postgresql.org mailing list archive  
help / color / mirror / Atom feed
pgsql: pgcrypto: Remove non-OpenSSL support
8+ messages / 4 participants
[nested] [flat]

* pgsql: pgcrypto: Remove non-OpenSSL support
@ 2021-11-05 13:09 Peter Eisentraut <peter@eisentraut.org>
  2021-11-06 22:04 ` Re: pgsql: pgcrypto: Remove non-OpenSSL support Andres Freund <andres@anarazel.de>
  0 siblings, 1 reply; 8+ messages in thread

From: Peter Eisentraut @ 2021-11-05 13:09 UTC (permalink / raw)
  To: pgsql-committers@lists.postgresql.org

pgcrypto: Remove non-OpenSSL support

pgcrypto had internal implementations of some encryption algorithms,
as an alternative to calling out to OpenSSL.  These were rarely used,
since most production installations are built with OpenSSL.  Moreover,
maintaining parallel code paths makes the code more complex and
difficult to maintain.

This patch removes these internal implementations.  Now, pgcrypto is
only built if OpenSSL support is configured.

Reviewed-by: Daniel Gustafsson <daniel@yesql.se>
Discussion: https://www.postgresql.org/message-id/flat/0b42f1df-8cba-6a30-77d7-acc241cc88c1%40enterprisedb.com

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/db7d1a7b0530e8cbd045744e1c75b0e63fb6916f

Modified Files
--------------
contrib/Makefile                    |    5 +-
contrib/pgcrypto/Makefile           |   73 +-
contrib/pgcrypto/blf.c              |  499 -----
contrib/pgcrypto/blf.h              |   46 -
contrib/pgcrypto/imath.c            | 3588 -----------------------------------
contrib/pgcrypto/imath.h            |  445 -----
contrib/pgcrypto/internal-sha2.c    |  206 --
contrib/pgcrypto/internal.c         |  585 ------
contrib/pgcrypto/pgp-mpi-internal.c |  304 ---
contrib/pgcrypto/rijndael.c         |  677 -------
contrib/pgcrypto/rijndael.h         |   59 -
contrib/pgcrypto/rijndael.tbl       | 1138 -----------
doc/src/sgml/pgcrypto.sgml          |  113 +-
src/tools/msvc/Mkvcbuild.pm         |   39 +-
src/tools/msvc/vcregress.pl         |    7 +-
15 files changed, 42 insertions(+), 7742 deletions(-)



^ permalink  raw  reply  [nested|flat] 8+ messages in thread

* Re: pgsql: pgcrypto: Remove non-OpenSSL support
  2021-11-05 13:09 pgsql: pgcrypto: Remove non-OpenSSL support Peter Eisentraut <peter@eisentraut.org>
@ 2021-11-06 22:04 ` Andres Freund <andres@anarazel.de>
  2021-11-06 22:07   ` Re: pgsql: pgcrypto: Remove non-OpenSSL support Tom Lane <tgl@sss.pgh.pa.us>
  0 siblings, 1 reply; 8+ messages in thread

From: Andres Freund @ 2021-11-06 22:04 UTC (permalink / raw)
  To: Peter Eisentraut <peter@eisentraut.org>; +Cc: pgsql-committers@lists.postgresql.org

Hi,

On 2021-11-05 13:09:55 +0000, Peter Eisentraut wrote:
> pgcrypto: Remove non-OpenSSL support
> 
> pgcrypto had internal implementations of some encryption algorithms,
> as an alternative to calling out to OpenSSL.  These were rarely used,
> since most production installations are built with OpenSSL.  Moreover,
> maintaining parallel code paths makes the code more complex and
> difficult to maintain.
> 
> This patch removes these internal implementations.  Now, pgcrypto is
> only built if OpenSSL support is configured.

This appears to have broken msvc pgcrypto being tested with msvc. I think
that's because pgcrypto is still listed in the "base" @contrib_excludes and
thus just isn't getting built anymore, now that the special-case build rule is
gone?

Greetings,

Andres Freund





^ permalink  raw  reply  [nested|flat] 8+ messages in thread

* Re: pgsql: pgcrypto: Remove non-OpenSSL support
  2021-11-05 13:09 pgsql: pgcrypto: Remove non-OpenSSL support Peter Eisentraut <peter@eisentraut.org>
  2021-11-06 22:04 ` Re: pgsql: pgcrypto: Remove non-OpenSSL support Andres Freund <andres@anarazel.de>
@ 2021-11-06 22:07   ` Tom Lane <tgl@sss.pgh.pa.us>
  2021-11-06 22:34     ` Re: pgsql: pgcrypto: Remove non-OpenSSL support Andres Freund <andres@anarazel.de>
  0 siblings, 1 reply; 8+ messages in thread

From: Tom Lane @ 2021-11-06 22:07 UTC (permalink / raw)
  To: Andres Freund <andres@anarazel.de>; +Cc: Peter Eisentraut <peter@eisentraut.org>; pgsql-committers@lists.postgresql.org

Andres Freund <andres@anarazel.de> writes:
> This appears to have broken msvc pgcrypto being tested with msvc. I think
> that's because pgcrypto is still listed in the "base" @contrib_excludes and
> thus just isn't getting built anymore, now that the special-case build rule is
> gone?

I came to the same conclusion and pushed that change.  We'll soon
see whether it's sufficient.

			regards, tom lane





^ permalink  raw  reply  [nested|flat] 8+ messages in thread

* Re: pgsql: pgcrypto: Remove non-OpenSSL support
  2021-11-05 13:09 pgsql: pgcrypto: Remove non-OpenSSL support Peter Eisentraut <peter@eisentraut.org>
  2021-11-06 22:04 ` Re: pgsql: pgcrypto: Remove non-OpenSSL support Andres Freund <andres@anarazel.de>
  2021-11-06 22:07   ` Re: pgsql: pgcrypto: Remove non-OpenSSL support Tom Lane <tgl@sss.pgh.pa.us>
@ 2021-11-06 22:34     ` Andres Freund <andres@anarazel.de>
  2021-11-07 01:38       ` Re: pgsql: pgcrypto: Remove non-OpenSSL support Michael Paquier <michael@paquier.xyz>
  0 siblings, 1 reply; 8+ messages in thread

From: Andres Freund @ 2021-11-06 22:34 UTC (permalink / raw)
  To: Tom Lane <tgl@sss.pgh.pa.us>; +Cc: Peter Eisentraut <peter@eisentraut.org>; pgsql-committers@lists.postgresql.org

Hi,

On 2021-11-06 18:07:09 -0400, Tom Lane wrote:
> Andres Freund <andres@anarazel.de> writes:
> > This appears to have broken msvc pgcrypto being tested with msvc. I think
> > that's because pgcrypto is still listed in the "base" @contrib_excludes and
> > thus just isn't getting built anymore, now that the special-case build rule is
> > gone?
> 
> I came to the same conclusion and pushed that change.  We'll soon
> see whether it's sufficient.

It was sufficient. The tests are still running, but the pgcrypto test just
passed (see contribcheck_test):
https://cirrus-ci.com/task/6128369478664192
vs previous run before rebasing:
https://cirrus-ci.com/task/5856750176829440

This is the meson branch, but testing the src/tools/msvc style build.

Greetings,

Andres Freund





^ permalink  raw  reply  [nested|flat] 8+ messages in thread

* Re: pgsql: pgcrypto: Remove non-OpenSSL support
  2021-11-05 13:09 pgsql: pgcrypto: Remove non-OpenSSL support Peter Eisentraut <peter@eisentraut.org>
  2021-11-06 22:04 ` Re: pgsql: pgcrypto: Remove non-OpenSSL support Andres Freund <andres@anarazel.de>
  2021-11-06 22:07   ` Re: pgsql: pgcrypto: Remove non-OpenSSL support Tom Lane <tgl@sss.pgh.pa.us>
  2021-11-06 22:34     ` Re: pgsql: pgcrypto: Remove non-OpenSSL support Andres Freund <andres@anarazel.de>
@ 2021-11-07 01:38       ` Michael Paquier <michael@paquier.xyz>
  2021-11-07 02:07         ` Re: pgsql: pgcrypto: Remove non-OpenSSL support Andres Freund <andres@anarazel.de>
  0 siblings, 1 reply; 8+ messages in thread

From: Michael Paquier @ 2021-11-07 01:38 UTC (permalink / raw)
  To: Andres Freund <andres@anarazel.de>; +Cc: Tom Lane <tgl@sss.pgh.pa.us>; Peter Eisentraut <peter@eisentraut.org>; pgsql-committers@lists.postgresql.org

On Sat, Nov 06, 2021 at 03:34:20PM -0700, Andres Freund wrote:
> It was sufficient. The tests are still running, but the pgcrypto test just
> passed (see contribcheck_test):
> https://cirrus-ci.com/task/6128369478664192
> vs previous run before rebasing:
> https://cirrus-ci.com/task/5856750176829440
> 
> This is the meson branch, but testing the src/tools/msvc style build.

The build is fixed, but not the buildfarm:
2021-11-06 15:49:48.623 EDT [21704:4] pg_regress/init LOG:  statement:
CREATE EXTENSION pgcrypto;
2021-11-06 15:49:48.637 EDT [21704:5] pg_regress/init ERROR:  could
not access file "$libdir/pgcrypto": No such file or directory
2021-11-06 15:49:48.637 EDT [21704:6] pg_regress/init STATEMENT:
CREATE EXTENSION pgcrypto;

It looks like this missed an installation path.  This should be
reproducible in my own environment, but I don't have the room to look
at it seriously today.
--
Michael

Attachments:

  signature.asc (application/pgp-signature, 832B) download

^ permalink  raw  reply  [nested|flat] 8+ messages in thread

* Re: pgsql: pgcrypto: Remove non-OpenSSL support
  2021-11-05 13:09 pgsql: pgcrypto: Remove non-OpenSSL support Peter Eisentraut <peter@eisentraut.org>
  2021-11-06 22:04 ` Re: pgsql: pgcrypto: Remove non-OpenSSL support Andres Freund <andres@anarazel.de>
  2021-11-06 22:07   ` Re: pgsql: pgcrypto: Remove non-OpenSSL support Tom Lane <tgl@sss.pgh.pa.us>
  2021-11-06 22:34     ` Re: pgsql: pgcrypto: Remove non-OpenSSL support Andres Freund <andres@anarazel.de>
  2021-11-07 01:38       ` Re: pgsql: pgcrypto: Remove non-OpenSSL support Michael Paquier <michael@paquier.xyz>
@ 2021-11-07 02:07         ` Andres Freund <andres@anarazel.de>
  2021-11-07 02:10           ` Re: pgsql: pgcrypto: Remove non-OpenSSL support Andres Freund <andres@anarazel.de>
  0 siblings, 1 reply; 8+ messages in thread

From: Andres Freund @ 2021-11-07 02:07 UTC (permalink / raw)
  To: Michael Paquier <michael@paquier.xyz>; +Cc: Tom Lane <tgl@sss.pgh.pa.us>; Peter Eisentraut <peter@eisentraut.org>; pgsql-committers@lists.postgresql.org

Hi,

On 2021-11-07 10:38:07 +0900, Michael Paquier wrote:
> On Sat, Nov 06, 2021 at 03:34:20PM -0700, Andres Freund wrote:
> > It was sufficient. The tests are still running, but the pgcrypto test just
> > passed (see contribcheck_test):
> > https://cirrus-ci.com/task/6128369478664192
> > vs previous run before rebasing:
> > https://cirrus-ci.com/task/5856750176829440
> > 
> > This is the meson branch, but testing the src/tools/msvc style build.
> 
> The build is fixed, but not the buildfarm:
> 2021-11-06 15:49:48.623 EDT [21704:4] pg_regress/init LOG:  statement:
> CREATE EXTENSION pgcrypto;
> 2021-11-06 15:49:48.637 EDT [21704:5] pg_regress/init ERROR:  could
> not access file "$libdir/pgcrypto": No such file or directory
> 2021-11-06 15:49:48.637 EDT [21704:6] pg_regress/init STATEMENT:
> CREATE EXTENSION pgcrypto;
> 
> It looks like this missed an installation path.  This should be
> reproducible in my own environment, but I don't have the room to look
> at it seriously today.

Hm? That's what I was seeing before, and what got fixed by
3c2c391dc9f82fae181508ebcc2f7621ffefd024

Greetings,

Andres Freund





^ permalink  raw  reply  [nested|flat] 8+ messages in thread

* Re: pgsql: pgcrypto: Remove non-OpenSSL support
  2021-11-05 13:09 pgsql: pgcrypto: Remove non-OpenSSL support Peter Eisentraut <peter@eisentraut.org>
  2021-11-06 22:04 ` Re: pgsql: pgcrypto: Remove non-OpenSSL support Andres Freund <andres@anarazel.de>
  2021-11-06 22:07   ` Re: pgsql: pgcrypto: Remove non-OpenSSL support Tom Lane <tgl@sss.pgh.pa.us>
  2021-11-06 22:34     ` Re: pgsql: pgcrypto: Remove non-OpenSSL support Andres Freund <andres@anarazel.de>
  2021-11-07 01:38       ` Re: pgsql: pgcrypto: Remove non-OpenSSL support Michael Paquier <michael@paquier.xyz>
  2021-11-07 02:07         ` Re: pgsql: pgcrypto: Remove non-OpenSSL support Andres Freund <andres@anarazel.de>
@ 2021-11-07 02:10           ` Andres Freund <andres@anarazel.de>
  2021-11-07 03:14             ` Re: pgsql: pgcrypto: Remove non-OpenSSL support Tom Lane <tgl@sss.pgh.pa.us>
  0 siblings, 1 reply; 8+ messages in thread

From: Andres Freund @ 2021-11-07 02:10 UTC (permalink / raw)
  To: Michael Paquier <michael@paquier.xyz>; +Cc: Tom Lane <tgl@sss.pgh.pa.us>; Peter Eisentraut <peter@eisentraut.org>; pgsql-committers@lists.postgresql.org

Hi,

On 2021-11-06 19:07:29 -0700, Andres Freund wrote:
> On 2021-11-07 10:38:07 +0900, Michael Paquier wrote:
> > On Sat, Nov 06, 2021 at 03:34:20PM -0700, Andres Freund wrote:
> > > It was sufficient. The tests are still running, but the pgcrypto test just
> > > passed (see contribcheck_test):
> > > https://cirrus-ci.com/task/6128369478664192
> > > vs previous run before rebasing:
> > > https://cirrus-ci.com/task/5856750176829440
> > > 
> > > This is the meson branch, but testing the src/tools/msvc style build.
> > 
> > The build is fixed, but not the buildfarm:
> > 2021-11-06 15:49:48.623 EDT [21704:4] pg_regress/init LOG:  statement:
> > CREATE EXTENSION pgcrypto;
> > 2021-11-06 15:49:48.637 EDT [21704:5] pg_regress/init ERROR:  could
> > not access file "$libdir/pgcrypto": No such file or directory
> > 2021-11-06 15:49:48.637 EDT [21704:6] pg_regress/init STATEMENT:
> > CREATE EXTENSION pgcrypto;
> > 
> > It looks like this missed an installation path.  This should be
> > reproducible in my own environment, but I don't have the room to look
> > at it seriously today.
> 
> Hm? That's what I was seeing before, and what got fixed by
> 3c2c391dc9f82fae181508ebcc2f7621ffefd024

The log excerpt appears to be from bowerbird [1], and predates that commit. I
didn't see any windows buildfarm run that completed since the above commit.

Greetings,

Andres Freund

[1] https://buildfarm.postgresql.org/cgi-bin/show_log.pl?nm=bowerbird&dt=2021-11-06%2019%3A13%3A40





^ permalink  raw  reply  [nested|flat] 8+ messages in thread

* Re: pgsql: pgcrypto: Remove non-OpenSSL support
  2021-11-05 13:09 pgsql: pgcrypto: Remove non-OpenSSL support Peter Eisentraut <peter@eisentraut.org>
  2021-11-06 22:04 ` Re: pgsql: pgcrypto: Remove non-OpenSSL support Andres Freund <andres@anarazel.de>
  2021-11-06 22:07   ` Re: pgsql: pgcrypto: Remove non-OpenSSL support Tom Lane <tgl@sss.pgh.pa.us>
  2021-11-06 22:34     ` Re: pgsql: pgcrypto: Remove non-OpenSSL support Andres Freund <andres@anarazel.de>
  2021-11-07 01:38       ` Re: pgsql: pgcrypto: Remove non-OpenSSL support Michael Paquier <michael@paquier.xyz>
  2021-11-07 02:07         ` Re: pgsql: pgcrypto: Remove non-OpenSSL support Andres Freund <andres@anarazel.de>
  2021-11-07 02:10           ` Re: pgsql: pgcrypto: Remove non-OpenSSL support Andres Freund <andres@anarazel.de>
@ 2021-11-07 03:14             ` Tom Lane <tgl@sss.pgh.pa.us>
  0 siblings, 0 replies; 8+ messages in thread

From: Tom Lane @ 2021-11-07 03:14 UTC (permalink / raw)
  To: Andres Freund <andres@anarazel.de>; +Cc: Michael Paquier <michael@paquier.xyz>; Peter Eisentraut <peter@eisentraut.org>; pgsql-committers@lists.postgresql.org

Andres Freund <andres@anarazel.de> writes:
> The log excerpt appears to be from bowerbird [1], and predates that commit. I
> didn't see any windows buildfarm run that completed since the above commit.

bowerbird just came through with a green run.

			regards, tom lane





^ permalink  raw  reply  [nested|flat] 8+ messages in thread


end of thread, other threads:[~2021-11-07 03:14 UTC | newest]

Thread overview: 8+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2021-11-05 13:09 pgsql: pgcrypto: Remove non-OpenSSL support Peter Eisentraut <peter@eisentraut.org>
2021-11-06 22:04 ` Andres Freund <andres@anarazel.de>
2021-11-06 22:07   ` Tom Lane <tgl@sss.pgh.pa.us>
2021-11-06 22:34     ` Andres Freund <andres@anarazel.de>
2021-11-07 01:38       ` Michael Paquier <michael@paquier.xyz>
2021-11-07 02:07         ` Andres Freund <andres@anarazel.de>
2021-11-07 02:10           ` Andres Freund <andres@anarazel.de>
2021-11-07 03:14             ` Tom Lane <tgl@sss.pgh.pa.us>

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox