Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1romHU-003J4U-0V for pgsql-admin@arkaria.postgresql.org; Mon, 25 Mar 2024 15:30:36 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1romHS-0050Cl-M0 for pgsql-admin@arkaria.postgresql.org; Mon, 25 Mar 2024 15:30:35 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1romHB-004w1i-Ji for pgsql-admin@lists.postgresql.org; Mon, 25 Mar 2024 15:30:18 +0000 Received: from mail-lj1-x22d.google.com ([2a00:1450:4864:20::22d]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.94.2) (envelope-from ) id 1romH8-006M4c-20 for pgsql-admin@lists.postgresql.org; Mon, 25 Mar 2024 15:30:16 +0000 Received: by mail-lj1-x22d.google.com with SMTP id 38308e7fff4ca-2d6a1ad08b8so62115641fa.1 for ; Mon, 25 Mar 2024 08:30:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cybertec-at.20230601.gappssmtp.com; s=20230601; t=1711380613; x=1711985413; darn=lists.postgresql.org; h=mime-version:user-agent:content-transfer-encoding:autocrypt :references:in-reply-to:date:cc:to:from:subject:message-id:from:to :cc:subject:date:message-id:reply-to; bh=4Q4XuT6u0KX9NsMtqiQafoTyJ8zITe/NJy9iOCeB6M8=; b=Xgi4AYY4LbivyfnyEirENJbkcA7hMJ99A9h55tX103Rf7DJqzSehfz0na3L2lFou9N ZQc07Ve8lRNX5p9uqlOUXTfHFT1gbLxbrF7CxqfPO0zqrxOwGvd6A0936tU8CbY+ns/M 5OslOuriLNgOZs1eED86ZoNkZd5zvgP7lA/HjbMoVvqTjzRLT7a7fUQJoZGDSQHdl10N tyKQT7mMDGlDetS4WcwhaFGwtjdZY2CgCR+rEAizSpg6t8Rcl5J7rvsBolChJ/T2dsey a9z6b+e6CZnF8soKPsMIGldVpmLf3foFQwlweRh4J/aNqP/o8gZevnX9fhKQ8P+fiTQG pO8g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1711380613; x=1711985413; h=mime-version:user-agent:content-transfer-encoding:autocrypt :references:in-reply-to:date:cc:to:from:subject:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=4Q4XuT6u0KX9NsMtqiQafoTyJ8zITe/NJy9iOCeB6M8=; b=wk2xu5Jb/1xupousOy8v0nq/ln7t0RcXQedr+8xnRT63RcB3ajF8W46nDlLVdad7Fw c4g1W8ySDbxy+19wbKPWAu2U+a4hID3loLL+5x1VsxDjRA/aISKj4k1a7wPvTtaWgNN6 Idyswz/qIcWUaN+PpgerD7bRMc2u9d8+K7ia90nDgrANz/Viw3tI2uvOTZdOgA9GebQN xtcx5XbWFUyfO55cvYeD7VrW2aM/3PtOgejhurV1ufGN5/v49GgRyxpyDG8zqbpjRL0B gl428VIBhlUvxMvsXdswMvXznK16bUIq3o8ysC0gw0u90Cl1KmctQePAVsJ0DgyYhCDE PQDA== X-Gm-Message-State: AOJu0Yz5dlc4RTVCLTBx2GIW21YNFotAFwhADVLXIyuqlUq9WoPfiQIk Yr/mcBfNdaSuPZmpWW85rFepBsGLprH5n29f3fHVoueHvRlfwEGPwPL06cqnuEe+kC9bs/rwgUt 9 X-Google-Smtp-Source: AGHT+IHHk85qqFsf5Qke6v/7QfIkZ9sUtAH8rbyS6r6NoAJqnnzYJxor8WPZs/l7iME4gNi+HuPqwA== X-Received: by 2002:a05:651c:1047:b0:2d2:ef14:593e with SMTP id x7-20020a05651c104700b002d2ef14593emr5231611ljm.48.1711380613511; Mon, 25 Mar 2024 08:30:13 -0700 (PDT) Received: from localhost.localdomain ([2001:871:5e:cf3e:59ca:6901:2af:1feb]) by smtp.gmail.com with ESMTPSA id dh16-20020a0564021d3000b0056c1c4b870asm420355edb.16.2024.03.25.08.30.13 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 25 Mar 2024 08:30:13 -0700 (PDT) Message-ID: Subject: Re: Ora2pg migration From: Laurenz Albe To: "Narendran .j" Cc: pgsql-admin@lists.postgresql.org Date: Mon, 25 Mar 2024 16:30:12 +0100 In-Reply-To: References: <353421c01d9645555244d41fc111304dcf66d051.camel@cybertec.at> Autocrypt: addr=laurenz.albe@cybertec.at; prefer-encrypt=mutual; keydata=mQINBGGDwAQBEADgbWy5cKXQld3N2mF+DFyiNFbi2oBl2T+XgxpPF8wTRw2D/u4bBKXP0SYSE/lA86jIVNWWU0gf1KODIkVvgJm2w4vH2VBV1b7ddVViGl1Iu+9zaRnv9wulhnH42KefepXnoean6UT1EzLM0opF/Ik0j+40TxdRtobkBprkQUyHDXWlHc2ffPs3SipyFEP9AVLf7ejRC46CXWDnsqjOBSMEW8Z4HiK/8RrPZBsKLts8dJxKF4pygOdJb0CWk8k/X1jbcfdxo+zOLjOMvJcSJ2pFdJmQHU+JufB3rePziqQ2S9Ur6sccr9XnTC1GVBWN4Lf5VHq+vf+bFJjVwg+2hrySZnAVfcOrxoqFLErr7ug1zN2nM1kcpgA4VWn4gxlJtYNYYq+9WxX5dtvnNANlG3ZCrRKQzl8lxtzoF6Zo7LUhEqPaHDwn7Rvs+IdbOn41lF5UDTJGqmC4gS/bZydW2Fy3YWm4aSaN9fgFf8D+PVkrlKAZB7gBLz1TyHjbcRf85cYF+GKKrDld5SzMB/V60VX3oP/Eo8ikFpyWaqiz1f9X7MBot3/PjJkY+wDzp3nmb19QEcOBuQiSQ4xds2r0HewbuHTAR68u8jNNMGmpm2j4x+g09Jd/WQDjqlTBZ/jEltH41fYCCPWMfljXTOOXu2eLNGdfi7ETZogtwjM9oTtSPQARAQABtCdMYXVyZW56IEFsYmUgPGxhdXJlbnouYWxiZUBjeWJlcnRlYy5hdD6JAk4EEwEIADgWIQR0CqhbZGGABqoaSbdi8bhXA2EdmAUCYYPABAIbAwULCQgHAgYVCgkICwIEFgIDAQIeAQIXgAAKCRBi8bhXA2EdmM/6EADK232JCwmBzhlj8h7U9CjG6kx0JHP3uJGv+XfsHtHAlmY/RCwF1BHMEsRlk bT5UrLvJ2jb99bA9QARzhFaxzyn0F/BUKzuIjRGNs/n6d5dNUFA0kOt8sX+TacmC GEyjEBCrVCm4ranBiUyePn9NhHNWnaex7pJyqvMLLdwW9BEMJx0Fqo+DN8ukbXmYRsmhEtd3ue+x/luYmOmJnaGtzInaY5aOJYbW9XqoRIZkZvOCgbi1FfvNmoqWa+3oVxTOgw9RafjJDyW0lTHzKGjbGI5ofMU98l+/hKJFYJqWUF6VpFJY5YIcN/1lf4ZICMwDl+MPIVo/tpq8L10seJL28nLlvw3K+cI+TVW8IW/qL/LyVoDofI3USeOORuYmhpWRhik8JXX6xf3v6GrRilJIPWNFIJbxm1ZblQiQnOw3IOW7T+8nAmPin1HKqM3VrOrJQ2VtShsefNBibNAsr1oFaqcDBkn3yGG8i6CTW+FyO4PZ+/EwNxMVgktxbYdy5AT1/lpXr5tB+phhLIyVfiBvrWs5EThxYMQ/L8Y85c3GMsAy1l/x4h3jqySIYy3SCU9+jc5UVuNnXljbvkEzJ+NLWJ6C1rACFWrMszgPdh5tCrlRY9PpmYll4JbCgb8BtxEIUmR+xr50/ZElEK5iml7Q00KUekCcDt+36PsyGFTXBzNOrkCDQRhg8AEARAAzOZ2tLHlI4rrhG411h6cdCFjBZxuljaFCxFyHn3m6wbGLqwBUWC5k8UrRqjHMz88KcTSaNO7XGAmCqPdWd2SeflPZRnNTbjsVpw7mLdffsBm4JX7kki2Pvk5h0NtYeidXT1PSpc2ri4DutYXuT9uD8RAm1wUDCE5HQNUihT/WH6opt+hskHW21uHao0+y822tG0QQcGMqdQR5Vxdxj89wiEPdqW+HpU/oOZIhrf2E7prduAppxixjHy/o1rcnoznnJvc8D3+YgI9O0LrBMij89dM55pRGbLovTR1oGR3U74sX774+0xmSzeIKwZfiMUz7Atlvfk5SHOsRUFPN2Ux9kaXiiBibQpHFxt7b lDrT4wxdLJ/XCdbPPAyl+lZtOLsaHEEZvYNyTXwZc35dVf3R4/oz20HoG6s7ct8e1 AQygj43XAERzty9SkWgxs8+grp1PrGx6FHVSYRqBM8dS/ZR6yRVwOwJXPyaSSqfIF21DkE4j1y4n+ItSewPGoRp8K/yWCikt6qlkVkO2ASNIiX04fAbtzwVOaNn8ZMRNqyvLc1fED4sr49onE4cAIcBLjcC3KL+w9DUGRQCdziROj5H2Yl/sXGPdMciUHo/Uz2rggc+2th3bQiMhrHWSsBpUkDQp0yWewemstPpPgBL3h2fHKaX8B9oH5Qu/H1IgrOuX8AEQEAAYkCNgQYAQgAIBYhBHQKqFtkYYAGqhpJt2LxuFcDYR2YBQJhg8AEAhsMAAoJEGLxuFcDYR2YuPwQAMkpGtR80pQ1gVsONhdkqj0H2eU66efP/gO3CoyaoIcvrpKYj7C2HipVSmkt1gpByL0X4AMQ/vKuknUz3wd28Ba+G1dCfbVs/Xiusq+SmpUj5rTwmYqdSjWMuCo1R6oS5hdJMdUUJYGMT0QkVlm1KnW8jkmCTl9GzjDxOAsN9O6/6lPzaGFtk9XF+34Bry/N4HKiJkqpC4+UTd0AprPfzJ2jdT64e1F0+W88X8y1bTTgNrHwK4mDiLnlE4SKRuEm54lNhJz//ar86Or5BErzNpM6TL7lk44QS06hwsMrEdKIy8J/SYJPjfzR8tIUnKscclVpOgjKaBqC+0iFiVaRqAgfOlIEiezX6kMh5Q2FIUfqs46qWhhXjRrdKOEoStYAaikdLu5ZXr7vfb0ZaDh+ZwTQtbSMFolyOkecwI81MCdbMfT/1TqIGTOdAj5as9fAakk0jb2pXgUYQ8X1DVTR8ahSDVEaw9VTmWiSvTxvguVJ1Mb7gG4Gmh6aviDTJhfXtH4rPUNXhDLqrTH8JkJjyKROOMakIF68Hjse5vUfUxreBEOtb5r1Coa2Fe7ncJayaSE7ryrDbFqpZ 36UMAx4ulWMyqJajLNGY0DdG8qIsR5nxRhrnK/mrCidZ8F9/D3bWAl4rjtHlsztN59 +AnW5l0HsQcY9ntFL/zEBOaonjdJf Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable User-Agent: Evolution 3.50.4 (3.50.4-1.fc39) MIME-Version: 1.0 List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk > On Fri, 22 Mar 2024, 3:33 pm Laurenz Albe, wro= te: > > On Fri, 2024-03-22 at 11:08 +0530, Narendran .j wrote: > > > I have export one table which has blob data type by ora2pg tool.while= Importing insert file in postgres I'm getting this error . > > > psql:ERROR: out of memory=C2=A0 > > > DETAIL: Cannot enlarge string buffer containing 1073741808 bytes by 8= 191 more bytes. > > >=20 > > > Please give me any suggestions and I adjust shared_buffer it didn't w= ork. > >=20 > > 1GB is a hard limit for memory allocations. > >=20 > > How big are those BLOBs?=C2=A0 The theoretical limit in PostgreSQL is 1= GB, but in > > practice things start getting difficult around 500MB, unless you use bi= nary > > transfer. > > It's almost 8gb, could you explain me how can I transfer as binary file?.= I'm new on this. With 8GB, you cannot use "bytea" on PostgreSQL. There is support for PostgreSQL Large Objects with ora2pg; you'd have to re= ad the documentation to find out more. I cannot help you with the memory allocation error, mostly because you didn't tell us what exactly you did to trigger it. Yours, Laurenz Albe