pg.ddx.io pgsql-hackers@postgresql.org mailing list archive
help / color / mirror / Atom feedA small step towards more organized beta testing
17+ messages / 7 participants
[nested] [flat]
* A small step towards more organized beta testing
@ 2011-05-02 18:12 Josh Berkus <josh@agliodbs.com>
0 siblings, 2 replies; 17+ messages in thread
From: Josh Berkus @ 2011-05-02 18:12 UTC (permalink / raw)
To: pgsql-hackers
Hackers,
I've replaced test-report-by-email with a GoogleDocs application for Beta1.
The form for submitting test reports is here:
https://spreadsheets.google.com/viewform?hl=en&formkey=dEh3WEwzOFhKWWw4dHdRS2VQTExRdVE6MQ&if...
The accumulated test reports are here:
https://spreadsheets.google.com/spreadsheet/pub?hl=en&hl=en&key=0AoeuP3g2YZsFdEh3WEwzOFhKWWw...
Instructions are here:
http://wiki.postgresql.org/wiki/HowToBetaTest#Reporting_Tests
Obviously, this is a temporary solution. I'm working on a Django app to
replace it. But for now, it lets us take test reports, and lets hackers
view them.
--
Josh Berkus
PostgreSQL Experts Inc.
http://pgexperts.com
^ permalink raw reply [nested|flat] 17+ messages in thread
* Re: A small step towards more organized beta testing
@ 2011-05-02 19:23 Dickson S. Guedes <listas@guedesoft.net>
parent: Josh Berkus <josh@agliodbs.com>
1 sibling, 1 reply; 17+ messages in thread
From: Dickson S. Guedes @ 2011-05-02 19:23 UTC (permalink / raw)
To: Josh Berkus <josh@agliodbs.com>; +Cc: pgsql-hackers
2011/5/2 Josh Berkus <josh@agliodbs.com>:
> Hackers,
>
> I've replaced test-report-by-email with a GoogleDocs application for Beta1.
>
> The form for submitting test reports is here:
>
> https://spreadsheets.google.com/viewform?hl=en&formkey=dEh3WEwzOFhKWWw4dHdRS2VQTExRdVE6MQ&if...
[... cut ...]
It's very good Josh.
For filter purpose, could have the form a 32bits/64bits choice?
--
Dickson S. Guedes
mail/xmpp: guedes@guedesoft.net - skype: guediz
http://guedesoft.net - http://www.postgresql.org.br
^ permalink raw reply [nested|flat] 17+ messages in thread
* Re: A small step towards more organized beta testing
@ 2011-05-03 01:41 Josh Berkus <josh@agliodbs.com>
parent: Dickson S. Guedes <listas@guedesoft.net>
0 siblings, 0 replies; 17+ messages in thread
From: Josh Berkus @ 2011-05-03 01:41 UTC (permalink / raw)
To: Dickson S. Guedes <listas@guedesoft.net>; +Cc: pgsql-hackers
> For filter purpose, could have the form a 32bits/64bits choice?
That would go into the "platform details" field.
Adding new fields in Googledocs is problematic, so I'd rather not add
one at this point, and spend my time on replacing it with a Django app
instead.
--
Josh Berkus
PostgreSQL Experts Inc.
http://pgexperts.com
^ permalink raw reply [nested|flat] 17+ messages in thread
* Re: A small step towards more organized beta testing
@ 2011-05-03 08:28 Dave Page <dpage@pgadmin.org>
parent: Josh Berkus <josh@agliodbs.com>
1 sibling, 1 reply; 17+ messages in thread
From: Dave Page @ 2011-05-03 08:28 UTC (permalink / raw)
To: Josh Berkus <josh@agliodbs.com>; +Cc: pgsql-hackers
On Mon, May 2, 2011 at 7:12 PM, Josh Berkus <josh@agliodbs.com> wrote:
> Hackers,
>
> I've replaced test-report-by-email with a GoogleDocs application for Beta1.
Didn't we stop doing that when the buildfarm came along?
--
Dave Page
Blog: http://pgsnake.blogspot.com
Twitter: @pgsnake
EnterpriseDB UK: http://www.enterprisedb.com
The Enterprise PostgreSQL Company
^ permalink raw reply [nested|flat] 17+ messages in thread
* Re: A small step towards more organized beta testing
@ 2011-05-03 18:51 Josh Berkus <josh@agliodbs.com>
parent: Dave Page <dpage@pgadmin.org>
0 siblings, 2 replies; 17+ messages in thread
From: Josh Berkus @ 2011-05-03 18:51 UTC (permalink / raw)
To: pgsql-hackers
On 5/3/11 1:28 AM, Dave Page wrote:
> On Mon, May 2, 2011 at 7:12 PM, Josh Berkus <josh@agliodbs.com> wrote:
>> Hackers,
>>
>> I've replaced test-report-by-email with a GoogleDocs application for Beta1.
>
> Didn't we stop doing that when the buildfarm came along?
This is user beta tests, not build tests. If you looked at the form,
you'd see that it's for a completely different kind of test.
--
Josh Berkus
PostgreSQL Experts Inc.
http://pgexperts.com
^ permalink raw reply [nested|flat] 17+ messages in thread
* Re: A small step towards more organized beta testing
@ 2011-05-03 18:59 Dave Page <dpage@pgadmin.org>
parent: Josh Berkus <josh@agliodbs.com>
1 sibling, 0 replies; 17+ messages in thread
From: Dave Page @ 2011-05-03 18:59 UTC (permalink / raw)
To: Josh Berkus <josh@agliodbs.com>; +Cc: pgsql-hackers
On Tue, May 3, 2011 at 7:51 PM, Josh Berkus <josh@agliodbs.com> wrote:
> On 5/3/11 1:28 AM, Dave Page wrote:
>> On Mon, May 2, 2011 at 7:12 PM, Josh Berkus <josh@agliodbs.com> wrote:
>>> Hackers,
>>>
>>> I've replaced test-report-by-email with a GoogleDocs application for Beta1.
>>
>> Didn't we stop doing that when the buildfarm came along?
>
> This is user beta tests, not build tests. If you looked at the form,
> you'd see that it's for a completely different kind of test.
I did, I just don't recall doing anything other than the old platform
support emails in the past. Even the pgsql-testers list seems to be
almost entirely full of bug reports, though I do see two or three
emails claiming to be test reports now I look more closely.
--
Dave Page
Blog: http://pgsnake.blogspot.com
Twitter: @pgsnake
EnterpriseDB UK: http://www.enterprisedb.com
The Enterprise PostgreSQL Company
^ permalink raw reply [nested|flat] 17+ messages in thread
* Re: A small step towards more organized beta testing
@ 2011-05-03 19:59 Josh Berkus <josh@agliodbs.com>
parent: Josh Berkus <josh@agliodbs.com>
1 sibling, 3 replies; 17+ messages in thread
From: Josh Berkus @ 2011-05-03 19:59 UTC (permalink / raw)
To: pgsql-hackers
Hackers,
And we have our first useful test reports. Please see these tests:
5/3/2011 8:01:29 -- issue with escaping quotes in functions.
5/3/2011 11:06:16 -- core dump with pg_restore
Also, Dave, there's a complaint about the one-click packages:
5/3/2011 8:04:02
(and yes, it's annouying that there's no way to create links to
individual rows)
--
Josh Berkus
PostgreSQL Experts Inc.
http://pgexperts.com
^ permalink raw reply [nested|flat] 17+ messages in thread
* Re: A small step towards more organized beta testing
@ 2011-05-03 20:03 Andrew Dunstan <andrew@dunslane.net>
parent: Josh Berkus <josh@agliodbs.com>
2 siblings, 1 reply; 17+ messages in thread
From: Andrew Dunstan @ 2011-05-03 20:03 UTC (permalink / raw)
To: Josh Berkus <josh@agliodbs.com>; +Cc: pgsql-hackers
On 05/03/2011 03:59 PM, Josh Berkus wrote:
> Hackers,
>
> And we have our first useful test reports. Please see these tests:
>
> 5/3/2011 8:01:29 -- issue with escaping quotes in functions.
>
> 5/3/2011 11:06:16 -- core dump with pg_restore
>
> Also, Dave, there's a complaint about the one-click packages:
>
> 5/3/2011 8:04:02
>
> (and yes, it's annouying that there's no way to create links to
> individual rows)
>
Are we really running a Google spreadsheet as in effect a bug tracker?
cheers
andrew
^ permalink raw reply [nested|flat] 17+ messages in thread
* Re: A small step towards more organized beta testing
@ 2011-05-03 20:06 Magnus Hagander <magnus@hagander.net>
parent: Andrew Dunstan <andrew@dunslane.net>
0 siblings, 2 replies; 17+ messages in thread
From: Magnus Hagander @ 2011-05-03 20:06 UTC (permalink / raw)
To: Andrew Dunstan <andrew@dunslane.net>; +Cc: Josh Berkus <josh@agliodbs.com>; pgsql-hackers
On Tue, May 3, 2011 at 22:03, Andrew Dunstan <andrew@dunslane.net> wrote:
>
>
> On 05/03/2011 03:59 PM, Josh Berkus wrote:
>>
>> Hackers,
>>
>> And we have our first useful test reports. Please see these tests:
>>
>> 5/3/2011 8:01:29 -- issue with escaping quotes in functions.
>>
>> 5/3/2011 11:06:16 -- core dump with pg_restore
>>
>> Also, Dave, there's a complaint about the one-click packages:
>>
>> 5/3/2011 8:04:02
>>
>> (and yes, it's annouying that there's no way to create links to
>> individual rows)
>>
>
> Are we really running a Google spreadsheet as in effect a bug tracker?
And why are we so inistant on not posting bug reports to pgsql-bugs?
--
Magnus Hagander
Me: http://www.hagander.net/
Work: http://www.redpill-linpro.com/
^ permalink raw reply [nested|flat] 17+ messages in thread
* Re: A small step towards more organized beta testing
@ 2011-05-03 20:12 Andres Freund <andres@anarazel.de>
parent: Magnus Hagander <magnus@hagander.net>
1 sibling, 0 replies; 17+ messages in thread
From: Andres Freund @ 2011-05-03 20:12 UTC (permalink / raw)
To: pgsql-hackers; +Cc: Magnus Hagander <magnus@hagander.net>; Andrew Dunstan <andrew@dunslane.net>; Josh Berkus <josh@agliodbs.com>
On Tuesday, May 03, 2011 10:06:08 PM Magnus Hagander wrote:
> On Tue, May 3, 2011 at 22:03, Andrew Dunstan <andrew@dunslane.net> wrote:
> > On 05/03/2011 03:59 PM, Josh Berkus wrote:
> >> Hackers,
> >>
> >> And we have our first useful test reports. Please see these tests:
> >>
> >> 5/3/2011 8:01:29 -- issue with escaping quotes in functions.
> >>
> >> 5/3/2011 11:06:16 -- core dump with pg_restore
> >>
> >> Also, Dave, there's a complaint about the one-click packages:
> >>
> >> 5/3/2011 8:04:02
> >>
> >> (and yes, it's annouying that there's no way to create links to
> >> individual rows)
> >
> > Are we really running a Google spreadsheet as in effect a bug tracker?
>
> And why are we so inistant on not posting bug reports to pgsql-bugs?
Thats especially strange as the spreadsheet doesn't have contact information
available for everybody. So basically only people having some form of extra
access can ask for information about bugs.
Andres
^ permalink raw reply [nested|flat] 17+ messages in thread
* Re: A small step towards more organized beta testing
@ 2011-05-03 20:14 Dave Page <dpage@pgadmin.org>
parent: Josh Berkus <josh@agliodbs.com>
2 siblings, 0 replies; 17+ messages in thread
From: Dave Page @ 2011-05-03 20:14 UTC (permalink / raw)
To: Josh Berkus <josh@agliodbs.com>; +Cc: pgsql-hackers
On Tue, May 3, 2011 at 8:59 PM, Josh Berkus <josh@agliodbs.com> wrote:
>
> Also, Dave, there's a complaint about the one-click packages:
pgsql-bugs@postgresql.org please.
--
Dave Page
Blog: http://pgsnake.blogspot.com
Twitter: @pgsnake
EnterpriseDB UK: http://www.enterprisedb.com
The Enterprise PostgreSQL Company
^ permalink raw reply [nested|flat] 17+ messages in thread
* Re: A small step towards more organized beta testing
@ 2011-05-03 20:25 Josh Berkus <josh@agliodbs.com>
parent: Magnus Hagander <magnus@hagander.net>
1 sibling, 2 replies; 17+ messages in thread
From: Josh Berkus @ 2011-05-03 20:25 UTC (permalink / raw)
To: Magnus Hagander <magnus@hagander.net>; +Cc: Andrew Dunstan <andrew@dunslane.net>; pgsql-hackers
>> Are we really running a Google spreadsheet as in effect a bug tracker?
>
> And why are we so inistant on not posting bug reports to pgsql-bugs?
We're not. However:
a) pgsql-bugs doesn't help us to get all of the various test information
without a lot of back-and-forth with the submitter (platform, version,
install method, test run, etc.)
b) pgsql-bugs is for failures only, and not for successful tests, and we
need successful tests as well to know how we're doing.
However, that does suggest that having the eventual test report app
(working on it), post failures to pgsql-bugs on some kind of moderated
basis.
BTW, if anyone knows of a specific *testing* application out there which
handles user testing, then please speak up before I write one.
--
Josh Berkus
PostgreSQL Experts Inc.
http://pgexperts.com
^ permalink raw reply [nested|flat] 17+ messages in thread
* Re: A small step towards more organized beta testing
@ 2011-05-03 20:29 Andres Freund <andres@anarazel.de>
parent: Josh Berkus <josh@agliodbs.com>
1 sibling, 1 reply; 17+ messages in thread
From: Andres Freund @ 2011-05-03 20:29 UTC (permalink / raw)
To: pgsql-hackers; +Cc: Josh Berkus <josh@agliodbs.com>; Magnus Hagander <magnus@hagander.net>; Andrew Dunstan <andrew@dunslane.net>
On Tuesday, May 03, 2011 10:25:13 PM Josh Berkus wrote:
> >> Are we really running a Google spreadsheet as in effect a bug tracker?
> >
> >
> >
> > And why are we so inistant on not posting bug reports to pgsql-bugs?
>
> We're not. However:
The HowToBetaTest guide only refers to that app. Not to anything else.
*At least* it should instruct people sending bugs additionally to pgsql-
bugs/the web form.
Andres
^ permalink raw reply [nested|flat] 17+ messages in thread
* Re: A small step towards more organized beta testing
@ 2011-05-03 20:31 Josh Berkus <josh@agliodbs.com>
parent: Andres Freund <andres@anarazel.de>
0 siblings, 0 replies; 17+ messages in thread
From: Josh Berkus @ 2011-05-03 20:31 UTC (permalink / raw)
To: Andres Freund <andres@anarazel.de>; +Cc: pgsql-hackers@postgresql.org, Magnus Hagander <magnus@hagander.net>; Andrew Dunstan <andrew@dunslane.net>
> The HowToBetaTest guide only refers to that app. Not to anything else.
> *At least* it should instruct people sending bugs additionally to pgsql-
> bugs/the web form.
It's a wiki; feel free to add it.
BTW, I'll point out to everyone that I posted my idea to do this more
than 2 weeks ago. So it shouldn't be news ...
--
Josh Berkus
PostgreSQL Experts Inc.
http://pgexperts.com
^ permalink raw reply [nested|flat] 17+ messages in thread
* Re: A small step towards more organized beta testing
@ 2011-05-03 20:33 Alvaro Herrera <alvherre@commandprompt.com>
parent: Josh Berkus <josh@agliodbs.com>
2 siblings, 1 reply; 17+ messages in thread
From: Alvaro Herrera @ 2011-05-03 20:33 UTC (permalink / raw)
To: Josh Berkus <josh@agliodbs.com>; +Cc: pgsql-hackers
Excerpts from Josh Berkus's message of mar may 03 16:59:54 -0300 2011:
> Hackers,
>
> And we have our first useful test reports. Please see these tests:
>
> 5/3/2011 8:01:29 -- issue with escaping quotes in functions.
Is this about standard_conforming_strings flipping default?
--
Álvaro Herrera <alvherre@commandprompt.com>
The PostgreSQL Company - Command Prompt, Inc.
PostgreSQL Replication, Consulting, Custom Development, 24x7 support
^ permalink raw reply [nested|flat] 17+ messages in thread
* Re: A small step towards more organized beta testing
@ 2011-05-03 20:36 Andres Freund <andres@anarazel.de>
parent: Alvaro Herrera <alvherre@commandprompt.com>
0 siblings, 0 replies; 17+ messages in thread
From: Andres Freund @ 2011-05-03 20:36 UTC (permalink / raw)
To: pgsql-hackers; +Cc: Alvaro Herrera <alvherre@commandprompt.com>; Josh Berkus <josh@agliodbs.com>
On Tuesday, May 03, 2011 10:33:03 PM Alvaro Herrera wrote:
> Excerpts from Josh Berkus's message of mar may 03 16:59:54 -0300 2011:
> > Hackers,
> >
> > And we have our first useful test reports. Please see these tests:
> >
> > 5/3/2011 8:01:29 -- issue with escaping quotes in functions.
>
> Is this about standard_conforming_strings flipping default?
The report on the website cites the example:
CREATE OR REPLACE FUNCTION test() RETURNS void AS '
DECLARE
BEGIN
SELECT \'test\';
END;
' LANGUAGE plpgsql;
So yes, thats standard_conforming_strings.
Andres
^ permalink raw reply [nested|flat] 17+ messages in thread
* Re: A small step towards more organized beta testing
@ 2011-05-03 20:38 Josh Berkus <josh@agliodbs.com>
parent: Josh Berkus <josh@agliodbs.com>
1 sibling, 0 replies; 17+ messages in thread
From: Josh Berkus @ 2011-05-03 20:38 UTC (permalink / raw)
To: pgsql-hackers
All,
I've added a check box giving permission to forward failure reports to
pgsql-bugs.
--
Josh Berkus
PostgreSQL Experts Inc.
http://pgexperts.com
^ permalink raw reply [nested|flat] 17+ messages in thread
end of thread, other threads:[~2011-05-03 20:38 UTC | newest]
Thread overview: 17+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2011-05-02 18:12 A small step towards more organized beta testing Josh Berkus <josh@agliodbs.com>
2011-05-02 19:23 ` Dickson S. Guedes <listas@guedesoft.net>
2011-05-03 01:41 ` Josh Berkus <josh@agliodbs.com>
2011-05-03 08:28 ` Dave Page <dpage@pgadmin.org>
2011-05-03 18:51 ` Josh Berkus <josh@agliodbs.com>
2011-05-03 18:59 ` Dave Page <dpage@pgadmin.org>
2011-05-03 19:59 ` Josh Berkus <josh@agliodbs.com>
2011-05-03 20:03 ` Andrew Dunstan <andrew@dunslane.net>
2011-05-03 20:06 ` Magnus Hagander <magnus@hagander.net>
2011-05-03 20:12 ` Andres Freund <andres@anarazel.de>
2011-05-03 20:25 ` Josh Berkus <josh@agliodbs.com>
2011-05-03 20:29 ` Andres Freund <andres@anarazel.de>
2011-05-03 20:31 ` Josh Berkus <josh@agliodbs.com>
2011-05-03 20:38 ` Josh Berkus <josh@agliodbs.com>
2011-05-03 20:14 ` Dave Page <dpage@pgadmin.org>
2011-05-03 20:33 ` Alvaro Herrera <alvherre@commandprompt.com>
2011-05-03 20:36 ` Andres Freund <andres@anarazel.de>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox