Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1jIqYd-0005EY-4S for psycopg@arkaria.postgresql.org; Mon, 30 Mar 2020 09:18:11 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1jIqYb-0004hC-Pm for psycopg@arkaria.postgresql.org; Mon, 30 Mar 2020 09:18:09 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1jIqYb-0004h4-KL for psycopg@lists.postgresql.org; Mon, 30 Mar 2020 09:18:09 +0000 Received: from mail-lj1-x22f.google.com ([2a00:1450:4864:20::22f]) by magus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1jIqYZ-0003eP-1A for psycopg@postgresql.org; Mon, 30 Mar 2020 09:18:09 +0000 Received: by mail-lj1-x22f.google.com with SMTP id n17so17247365lji.8 for ; Mon, 30 Mar 2020 02:18:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=5YcZRQJPJyvAy1ux2A3lG3zSq3tDyIcW12EPxLgwzkc=; b=eP2cKer42kujLJksypoiiegXl536uqd5YFM4S/ZoaS1fYpQ6JZYGse5WvxD3fwqeF0 wqvVPoKcFtVqOgKKxD2w3kLyjJ0T3Ve7pjyW/yF3+veREHG2e/72ImCW//4TfkMGteCH rsCQWf8hy0ejFTes0njT7l+IP7+RYmmp65erIG5VEmGlciz3DuKSxXuLFt5jXGqOSJjP B5tx5isDthFePxJFXT48udDPWHCpTOLsYnDgQuVmglfkVCDAV+BjfD1paHuIX5zZRa9h A92dDIFwmr/hD6hOyQrPT1XcZXORA1zV8XvpaKsy4rB9frXdGMGk+Fd+PDu9CSiP/fC4 H8Lg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=5YcZRQJPJyvAy1ux2A3lG3zSq3tDyIcW12EPxLgwzkc=; b=FH6zmgdeDLmPx5c1cP2OdzDau+J/sjEdbmV4LHmSN8bxjsNvXU0Q5NGcC3ECxH1gZw mpTSFcWf+zseY2spdJyMyxgySrrI0mt0qxYkCuBmfEfFryS5Q3tBKRO9oB4R3wXM94AJ +2wz9LuDm0GdDItvniVZB/hervcRNJ0UgtwYdZ9csXs7vWG4B6SUnhN4AFB0wAueiRMy RM9w3h1F+zQKQ6N0zFzT+YXor/nCH7cSC583m0xJr5c3i0Mxf1Sz8BuNd1jD5iBltVdZ jbiCj4ZovzoQRWxSxT8CvUHx8NIVmqk16/0jN3WNFzpnGaWzLY3p9DUfpi6Q8fhob1hk 6ykg== X-Gm-Message-State: AGi0PuZidEUZeg8pAyvmtR04Jos8YCmeImM+yfIKYMHRDpM7GqAZ2Bn4 eax1L/WUTpnhUzY3NsYq8o540HAABr9JxFZPfoI= X-Google-Smtp-Source: APiQypLa67xe3C/gX05HJmmYPY0DuzRUq9j/4XlC7i6HNU4ZIVOLpmwZGxNVcxKWJRjvZLcXL3wXIkgfY1ntUjaGLe4= X-Received: by 2002:a2e:a310:: with SMTP id l16mr6726720lje.255.1585559885890; Mon, 30 Mar 2020 02:18:05 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Daniele Varrazzo Date: Mon, 30 Mar 2020 22:17:53 +1300 Message-ID: Subject: Re: psycopg3: a first report To: Stefan Knecht Cc: psycopg@postgresql.org Content-Type: multipart/alternative; boundary="000000000000c4c63905a20eedde" List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk --000000000000c4c63905a20eedde Content-Type: text/plain; charset="UTF-8" Hi Stefan, On Mon, 30 Mar 2020, 17:27 Stefan Knecht, wrote: > If I may, one thing that has been a constant troublemaker for us - running > primarily on AWS - is timeouts. I would love to see a fundamental > implementation of timeouts at the connection level, regardless of activity > - e.g. in the middle of a query, between queries, etc.. If the connection > hangs (because the server disappeared or failed over) or does not respond > (particularly in the weird cases like when the destination IP just vanishes > and the tcp timeout kicks in) - I'd like to know about it within a > reasonable time and be able to react to that. > It would be interesting to set up integration tests wirh connections being disrupted in various ways and at different moments during connection and query processes. I'd rather do them in a test framework rather than one-off. Mitmproxy could be a nice tool to build them. https://mitmproxy.org/ -- Daniele > --000000000000c4c63905a20eedde Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi Stefan,

On Mon, 30 Mar 2020, 17:27 Stefan Knecht, &l= t;knecht.stefan@gmail.com>= ; wrote:

If I may, one thing that has been a constant troublemak= er for us - running primarily on AWS - is timeouts. I would love to see a f= undamental implementation of timeouts at the connection level, regardless o= f activity - e.g. in the middle of a query, between queries, etc.. If the c= onnection hangs (because the server disappeared or failed over) or does not= respond (particularly in the weird cases like when the destination IP just= vanishes and the tcp timeout kicks in) - I'd like to know about it wit= hin a reasonable time and be able to react to that.

It would be = interesting to set up integration tests wirh connections being disrupted in= various ways and at different moments during connection and query processe= s. I'd rather do them in a test framework rather than one-off.

Mitmproxy could be a nice tool t= o build them.


-- Daniele
--000000000000c4c63905a20eedde--