From: Peter M. Groen <peter@osdev.nl>
To: Scott Whitney <scott@journyx.com>
Cc: pgsql-admin@lists.postgresql.org <pgsql-admin@lists.postgresql.org>
Cc: Ron <ronljohnsonjr@gmail.com>
Subject: Re: How to insert from linux to postgreSQL
Date: Tue, 9 Apr 2019 18:07:19 +0200
Message-ID: <20190409180719.1902610a@skullcandy.osdev.nl> (raw)
In-Reply-To: <MWHPR11MB1279CD7498B9F15E049FEF19A72C0@MWHPR11MB1279.namprd11.prod.outlook.com>
References: <4FB9BF8B-D26C-40FB-9A9C-DEB4FB016292@illinois.edu>
<ecfa6666-5334-7811-8328-2a953b76c932@gmail.com>
<MWHPR11MB1279CD7498B9F15E049FEF19A72C0@MWHPR11MB1279.namprd11.prod.outlook.com>
Or just use PERL as it was designed to (pre)process large amounts of
texts... psql support is pretty great....
--
Open Systems Development B.V.
Peter M. Groen
Rooseveltstraat 18P
2321 BM Leiden
Telef :
Mobile : +31 6 811 0 3537
Email : pgroen@osdev.nl
On Mon, 8 Apr 2019 19:20:03 +0000, Scott Whitney wrote :
>Is the log file "ready" for INSERT, line by line? If not, you need to
>preprocess it. The 2 solutions I would use are psycopg for Python or
>sed + INSERT depending. ________________________________ From: Ron
><ronljohnsonjr@gmail.com> Sent: Monday, April 8, 2019 2:18:18 PM
>To: pgsql-admin@lists.postgresql.org
>Subject: Re: How to insert from linux to postgreSQL
>
>On 4/8/19 2:03 PM, Campbell, Lance wrote:
>PostgreSQL 10.x
>
>Use case:
>I want to read a log file on my linux server and write each line out
>to a row in a postgreSQL table.
>
>Presumably some manipulations need to be performed so that you can't
>just do COPY FROM STDIN?
>
>When I do inserts however I want to make sure I am using prepared
>statements to avoid SQL injections. I know how to do this is Java but
>I have not found an example using a linux bash scripts.
>
>Does anyone have an example they could point me to?
>
>I think the problem is that you need an open connection to use
>prepared statements, and you can't do that in bash. What about using
>Python? (After all, that's a scripting language, too.)
>
>
>--
>Angular momentum makes the world go 'round.
>
>
>
>[http://journyx.com/emailImages/ScottWhitney.png]
>
>[http://journyx.com/emailImages/linkedin.png]<https://www.linkedin.com/company/journyx-inc/;
>[http://journyx.com/emailImages/twitter.png]
><https://www.twitter.com/journyxinc;
> [http://journyx.com/emailImages/bluebar.jpg]
>
>Scott Whitney
>Director of IT
>
>[http://journyx.com/emailImages/journyx.jpg]
>
>scott@journyx.com<mailto:scott@journyx.com> | +1 (800) 755-9878
>
>7600 Burnet Road, Ste. 300
>Austin, TX 78757
>
>Visit us at www.journyx.com<https://www.journyx.com/;
>
>
>
>To unsubscribe from Journyx promotional emails, click here
><http://journyx.com/communication-preferences; or visit
>http://journyx.com/communication-preferences.
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-admin@postgresql.org
Cc: peter@osdev.nl, scott@journyx.com, pgsql-admin@lists.postgresql.org, ronljohnsonjr@gmail.com
Subject: Re: How to insert from linux to postgreSQL
In-Reply-To: <20190409180719.1902610a@skullcandy.osdev.nl>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox