Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1qooNf-002zqL-W6 for pgsql-www@arkaria.postgresql.org; Fri, 06 Oct 2023 17:12:52 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1qooNc-009Zmo-7o for pgsql-www@arkaria.postgresql.org; Fri, 06 Oct 2023 17:12:49 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1qooNb-009Zmf-VA for pgsql-www@lists.postgresql.org; Fri, 06 Oct 2023 17:12:48 +0000 Received: from mail-lf1-x141.google.com ([2a00:1450:4864:20::141]) by magus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.94.2) (envelope-from ) id 1qooNV-000d3j-KE for pgsql-www@lists.postgresql.org; Fri, 06 Oct 2023 17:12:48 +0000 Received: by mail-lf1-x141.google.com with SMTP id 2adb3069b0e04-50305abe5f0so3124810e87.2 for ; Fri, 06 Oct 2023 10:12:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1696612360; x=1697217160; darn=lists.postgresql.org; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :from:to:cc:subject:date:message-id:reply-to; bh=AzdCw3wzLcp+8Ro6oFoDPul1JDIA514wP/BHKKPJVS0=; b=j4I45ax2lYrWmPijaFD2U9Jjo4Ehe0x5vkkqlQ5VsMZ1xbnsWL2GRZZABD6XamM/vc idSoHbmZMDSv/4IkBJpqETGQoAXJu63v0zCFLTdwgOYl4GkR5Ue8j6xk2IdoXV5IUtU4 ZJ9o3lcG9jL0O+x/881jeBR/GObB+fyAONeNPaVQtxqLDYktW22cWGv1TTu5c+iND4x1 cfA2p+N1Kbl1hfXUmciSJM1+jw4gYocWRwJKjfBXPvv9MxHHYX6ciKnwenPMEdxIqKSJ mqn6Pximh9vTytZ1ohJGDtKqkZkA800WVTac4Grlc3rcYftgrI1qXDIVOxOqBvdTY2tw 8mlQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1696612360; x=1697217160; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=AzdCw3wzLcp+8Ro6oFoDPul1JDIA514wP/BHKKPJVS0=; b=KiSlKW3ECl+jr1ddTco9XNeIIiuM4BfEjXbfPzpATMax4vxsns9zJkjRu10iKf09Gl 8WED91CPqHRndfXlmQw/FPpXHy3S88FIGwmtUlZMuX1fbL7mlTsjKqt6k9br3gzNEnhO EElZ3JxzVXLEY+YhtNWzDHetDa/SJOttSONCRa20CI6F9u3hCkLtuy1wgEMVQmF0AniX qewjLtpx9ncLKeujxLTxFfxYyZUWfN25Mgv9SNYbz2tLjr78s2rnpaR9pLzdTnu8PObA xOecvwPlrUy7YMv/l4m4MlQib2TCEP/g31rziyAfIXnWTcCHR/UfL8g0oD7a+uT+aOPR ajWg== X-Gm-Message-State: AOJu0YwbIOObwvnvmP0SCI5j8wIBXWxxhKdNnvlaFXB4C8gH7dV43Kj1 rQHaMwOlPoPj0oC+b+4AGKMWpEma9WZPrcGfxKA= X-Google-Smtp-Source: AGHT+IHHpQzT6Tl+xsajmJ+Kt3CIYO7kJjmr5dbhQnrRVH7SdKibAYoqfNHjAH5FXsYo5zyAUyCfWT6ip46VTY92VmU= X-Received: by 2002:a05:6512:532:b0:505:7113:1d12 with SMTP id o18-20020a056512053200b0050571131d12mr6887711lfc.3.1696612359840; Fri, 06 Oct 2023 10:12:39 -0700 (PDT) MIME-Version: 1.0 References: <7F99AF5A-8D5D-47A3-B238-4E34004C3DFE@yesql.se> <433F3C16-B91E-45D1-8C5A-E1AAEAA2541C@yesql.se> In-Reply-To: <433F3C16-B91E-45D1-8C5A-E1AAEAA2541C@yesql.se> From: Akshat Jaimini Date: Fri, 6 Oct 2023 22:42:28 +0530 Message-ID: Subject: Re: Permission to allow testing harness to send error reports for pgweb directly to mailing list. To: Daniel Gustafsson , pgsql-www@lists.postgresql.org, Magnus Hagander Content-Type: multipart/alternative; boundary="00000000000007a76906070f59ba" List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk --00000000000007a76906070f59ba Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable > I clicked through the linked repo but I was unable to see an example testrun. You can find the reports here: https://github.com/destrex271/pgweb-testing-harness/actions/runs/6189299124 . You can check the 'report', 'test-log' and 'failure_logs' artifacts, the other ones are experimental for now. > For tests like that we must really think about scope, limiting the report isn't useful if we publish the tests for anyone to run themselves and thus generate the report. > Malicious actors are no doubt probing the website continuously regardless of this, but we don't necessarily need to do the job for them. Oh yes, that is a valid point, I guess we might need to separate these tests then in some private repo? I don't know if this is possible though but we can think of some other approaches. Because if we keep those tests publicly available that will just create more problems for us, as you mentioned in your reply. I'll try to find more approaches to this because the private repository does not seem to go with the idea of open source. I might be wrong about this, so please let me know if I am wrong. Regards, Akshat Jaimini On Fri, Oct 6, 2023 at 6:09=E2=80=AFPM Daniel Gustafsson = wrote: > > On 6 Oct 2023, at 08:05, Akshat Jaimini wrote: > > > > > Publishing this report to a website would handle that I think. > > I had sent a proposal/tried to start a discussion for this a few days > earlier > > It would probably help if you could link to a report from a run of the te= st > suite. I clicked through the linked repo but I was unable to see an > example > testrun. > > > > One question, would this test harness detect and report potential > security issues like XSS? > > Security related tests were not added in the Gsoc timeline but we are > planning to add them. Maybe when we add those tests we can create a > separate section on the proposed website only available to some 'admins' > with all these sensitive reports being displayed there. > > For tests like that we must really think about scope, limiting the report > isn't > useful if we publish the tests for anyone to run themselves and thus > generate > the report. Malicious actors are no doubt probing the website continuous= ly > regardless of this, but we don't necessarily need to do the job for them. > > -- > Daniel Gustafsson --00000000000007a76906070f59ba Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
> I clic= ked through the linked repo but I was unable to see an example testrun.=C2= =A0
=C2=A0You can find the reports here:=C2=A0https://github.com/destrex271/pgweb-testing-harness/acti= ons/runs/6189299124 . You can check the 'report', 'test-log= ' and 'failure_logs' artifacts, the other ones are experimental= for now.

> For tests like that we must really think about scope, limiting the=20 report isn't useful if we publish the tests for anyone to run themselve= s and thus generate the report.=C2=A0
> Malicious actors are no= =20 doubt probing the website continuously regardless of this, but we don't= =20 necessarily need to do the job for them.

Oh yes, that is a valid point, I guess we might need to separate these=20 tests then in some private repo? I don't know if this is possible thoug= h but we can think of some other approaches. Because if we keep those=20 tests publicly available that will just create more problems for us,=C2=A0a= s=20 you mentioned in your reply.

I'll try to find= =20 more approaches to this because the private repository does not seem to=20 go with the idea of open source. I might be wrong about this, so please=20 let me know if I am wrong.

Regards,
Aksh= at Jaimini

On Fri, Oct 6, 2023 at 6:09=E2=80=AFPM Daniel Gustafs= son <daniel@yesql.se> wrote:
> On 6 Oct 202= 3, at 08:05, Akshat Jaimini <destrex271@gmail.com> wrote:
>
> > Publishing this report to a website would handle that I think. > I had sent a proposal/tried to start a discussion for this a few days = earlier

It would probably help if you could link to a report from a run of the test=
suite.=C2=A0 I clicked through the linked repo but I was unable to see an e= xample
testrun.

> > One question, would this test harness detect and report potential= security issues like XSS?
> Security related tests were not added in the Gsoc timeline but we are = planning to add them. Maybe when we add those tests we can create a separat= e section on the proposed website only available to some 'admins' w= ith all these sensitive reports being displayed there.

For tests like that we must really think about scope, limiting the report i= sn't
useful if we publish the tests for anyone to run themselves and thus genera= te
the report.=C2=A0 Malicious actors are no doubt probing the website continu= ously
regardless of this, but we don't necessarily need to do the job for the= m.

--
Daniel Gustafsson
--00000000000007a76906070f59ba--