Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.84_2) (envelope-from ) id 1cMeX9-0008Og-RI for pgsql-admin@arkaria.postgresql.org; Thu, 29 Dec 2016 17:30:31 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84_2) (envelope-from ) id 1cMeX9-0008EQ-9b for pgsql-admin@arkaria.postgresql.org; Thu, 29 Dec 2016 17:30:31 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1cMeVS-0006HX-0s for pgsql-admin@postgresql.org; Thu, 29 Dec 2016 17:28:46 +0000 Received: from mail-qk0-x233.google.com ([2607:f8b0:400d:c09::233]) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.84_2) (envelope-from ) id 1cMeVO-0002VS-MR for pgsql-admin@postgresql.org; Thu, 29 Dec 2016 17:28:45 +0000 Received: by mail-qk0-x233.google.com with SMTP id t184so277532302qkd.0 for ; Thu, 29 Dec 2016 09:28:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=openscg-com.20150623.gappssmtp.com; s=20150623; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=fzOl69m/guTVBSsWZvwOUV9aUHpNn7mvWiJf7NkoCPU=; b=Iqmc05Wqhz7oDxr93ygBpx4sUScUgZZzbLFdxWmxZyFsn+FaesC3CR2HafDwwdB9UC 3PRUjg6UyS0SziEO1e7p0vgQemA4zqPk2ETSjgR4rALe1Tf2YmIZ8icnZIsWd+0JItn0 tK2wWlr/4iwE7ZCabCYkasus+awxna+oM7T97TgpQTmytMKQbfCMknKET5VgV9GZVaBB +5aZJU9YCzkfdZBEhMA08Kw2lTPicFHMoKcHYN3VHcZ06xwUghyosde27+wWH+uJH9Ge BXZV5dg7PZmF4x3SIulXvtupzCGpiWkWrqwSxXB5cO6yLa3nJU9hm+VsAar2At4JyINe Xg7A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=fzOl69m/guTVBSsWZvwOUV9aUHpNn7mvWiJf7NkoCPU=; b=UEZUvihn/pI3rkzRXM8XrlvmHQA2krWXkSb+FIk6ji/QMCoG44rqvj4wVgSbVBUYeK 4xmfYsdtauUKSaHvoWRpaGEnflFUaJuc3J+pCBQcypj1Ce9Xavm3ceBdqhDqpoKJsN+4 jPebTPSNzY6O5pplFEbgaXNVjaUb3XgQ+T2KWQ5EgMOv2cDtWKMmWlCC8vHoHSHXwql/ zrM2dNY0oavDRacla1JVrrsjMEHFhUH2cTI/RLaIxGg3TSs+raDVfO+eWs8eCoEZgcS7 9jMouqSYsPZXl8LuK+IWH5hlQ0w6XqT1ulMK/3E68RhH6g+qRGoBmeQuAJjvh+OBDsJo 3jCA== X-Gm-Message-State: AIkVDXK4PZ4ALpSP0KqRQaSoqaHaozzXkalzNQr0kYEC9vIuW1bND3GYj6MGhOcFc6RWfYtM X-Received: by 10.55.207.199 with SMTP id v68mr34431851qkl.232.1483032520421; Thu, 29 Dec 2016 09:28:40 -0800 (PST) Received: from [10.166.72.70] (mobile-107-107-63-201.mycingular.net. [107.107.63.201]) by smtp.gmail.com with ESMTPSA id s11sm19871949qte.28.2016.12.29.09.28.39 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 29 Dec 2016 09:28:39 -0800 (PST) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (1.0) Subject: Re: Data replication to PostgreSQL From: Scott Mead X-Mailer: iPhone Mail (14C92) In-Reply-To: Date: Thu, 29 Dec 2016 12:28:38 -0500 Cc: pgsql-admin@postgresql.org Content-Transfer-Encoding: quoted-printable Message-Id: References: To: Ram DBA X-Pg-Spam-Score: -2.6 (--) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-admin Precedence: bulk Sender: pgsql-admin-owner@postgresql.org > On Dec 29, 2016, at 09:35, Ram DBA wrote: >=20 > Hi team, >=20 > We have an use case to copy the data from Salesforce to PostgreSQL enviro= nment but because of DDL changes that can happen to tables from Salesforce = application side, replication would eventually fail. Do we have any open so= urce tools that can also capture the DDL changes and replicate to PostgreSQ= L? Are you using an export tool provided by salesforce, or a custom tool again= st their APIs?=20=20 Either way, you don't have access to their database, you should be dumpin= g the data to a CSV and importing the CSV to postgres. It's been a while si= nce I've monkeyed with it, There may be a new way of doing this, but I doub= t it. As long as your export tool always creates a csv in the right format,= you'll be fine. If you aren't ordering your columns or are using *, you'll= never get a good read. Use the toon or API to create a consistent file eac= h time in some standard format and you'll be as okay as possible.=20 -- Scott Mead via mobile Skype : scottm.openscg Gtalk : scottm@openscg.com >=20 > Thank you in advance, > Ram --=20 Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin