From: Marc Spitzer <marc@oscar.eng.cv.net>
To: pgsql-sql <pgsql-sql@postgresql.org>
Subject: Re: 1 milion data insertion
Date: Fri, 26 Jul 2002 14:46:00 -0400
Message-ID: <20020726144600.C16887@oscar.eng.cv.net> (raw)
In-Reply-To: <A799F7647794D311924A005004ACEA97080DDEC4@cprodamibs249.prodam>
References: <A799F7647794D311924A005004ACEA97080DDEC4@cprodamibs249.prodam>
On Fri, Jul 26, 2002 at 03:34:12PM -0300, Elielson Fontanezi wrote:
> Hi fellows!
>
> I have tried to insert 1.000.000 of record to the following table;
>
> --------------------------------------------------
> zakal=# \d teste;
> codigo | bigint | not null
> nome | character varying(100) |
> --------------------------------------------------
>
> and I got these errors:
>
> --------------------------------------------------
> zakal$ psql -c "copy teste from 'teste.dat' using delimeters '|'"
> ERROR: parser: parse error at or near "delimeters"
> ERROR: parser: parse error at or near "delimeters"
> zakal$ psql -c "copy teste from 'teste.dat' using delimiters '|'"
> ERROR: COPY command, running in backend with effective uid 504, could not
> open
> file 'teste.dat' for reading. Errno = No such file or directory (2).
> ERROR: COPY command, running in backend with effective uid 504, could not
> open
> file 'teste.dat' for reading. Errno = No such file or directory (2).
> zakal$ pwd
> /home/zakal/tmp
> zakal$ psql -c "copy teste from '`pwd`/teste.dat' using delimiters '|'"
> DEBUG: copy: line 27536, XLogWrite: new log file created - consider
> increasing
> WAL_FILES
> DEBUG: copy: line 93146, XLogWrite: new log file created - consider
> increasing
> WAL_FILES
> DEBUG: recycled transaction log file 0000000000000000
>
>
> ERROR: copy: line 164723, Bad int8 external representation "16722"
> ERROR: copy: line 164723, Bad int8 external representation "16722"
> zakal$
> zakal$
> zakal$ DEBUG: recycled transaction log file 0000000000000001
> ----------------------------------------------------------------------
>
> the log has overflowed.
>
> Ok, this was a test. I'd like to know what would be happen.
> But, from you, great PostGres DBA's, what is the best way to
> insert a large number of data?
> Is there a way to turn off the log?
> Is there a way to commit each 100 records?
>
> regards,
in relativly small chuncks, do 100 10,000 record transactions and
you should be fine.
marc
>
> ..............................................
> A Question...
> Since before your sun burned hot in space and before your race was born, I
> have awaited a question.
>
> Elielson Fontanezi
> DBA Technical Support - PRODAM
> +55 11 5080 9493
>
>
>
> ---------------------------(end of broadcast)---------------------------
> TIP 1: subscribe and unsubscribe commands go to majordomo@postgresql.org
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-sql@postgresql.org
Cc: marc@oscar.eng.cv.net
Subject: Re: 1 milion data insertion
In-Reply-To: <20020726144600.C16887@oscar.eng.cv.net>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox