Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1Xnu58-0000cX-HW for pgsql-sql@arkaria.postgresql.org; Mon, 10 Nov 2014 18:52:54 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.80) (envelope-from ) id 1Xnu58-0007uY-17 for pgsql-sql@arkaria.postgresql.org; Mon, 10 Nov 2014 18:52:54 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:DHE_RSA_AES_256_CBC_SHA256:256) (Exim 4.80) (envelope-from ) id 1Xnu56-0007sP-Fi for pgsql-sql@postgresql.org; Mon, 10 Nov 2014 18:52:52 +0000 Received: from post.visena.com ([46.226.10.50]) by magus.postgresql.org with esmtps (TLS1.2:DHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.80) (envelope-from ) id 1Xnu52-0002tk-LP for pgsql-sql@postgresql.org; Mon, 10 Nov 2014 18:52:51 +0000 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=visena.com; s=20141101.wh; h=Content-Type:MIME-Version:Subject:In-Reply-To:Message-ID:To:From:Date; bh=3uuB9AlCJQwJSHb6RcCw9qnY6C1pdH+79tuRYKUtjrA=; b=HrrFMAgUDoilRi8/e+4yL9xPsJmNxSI1/BAm/csWg+Jw8lirQ8KpJJT/CV9oKGC1p4cENs+82A1MLMTSFMb/1KRsQQ5PfuTNCyFnpbCod1egHdfJSjFtGYPKkgY2IIEicbUDMmTDV+oNGEidMW7hZlISpwq1ZOG0mBOPJyretOQ=; Received: from [10.0.1.10] (helo=tc7-visena.wh.internal.visena.com) by post.visena.com with esmtp (Exim 4.82) (envelope-from ) id 1Xnu4x-00023B-5J for pgsql-sql@postgresql.org; Mon, 10 Nov 2014 19:52:47 +0100 Received: from localhost ([127.0.0.1] helo=tc7-visena.wh.internal.visena.com) by tc7-visena.wh.internal.visena.com with esmtp (Exim 4.82) (envelope-from ) id 1Xnu4x-0005Db-41 for pgsql-sql@postgresql.org; Mon, 10 Nov 2014 19:52:43 +0100 Date: Mon, 10 Nov 2014 19:52:42 +0100 (CET) From: Andreas Joseph Krogh To: pgsql-sql@postgresql.org Message-ID: In-Reply-To: <1415636350305-5826346.post@n5.nabble.com> Subject: Re: Using aggregates to get sums and partial sums in one query MIME-Version: 1.0 X-Mailer: Visena Mail 1.9.0-SNAPSHOT X-Spam-Score: -0.3 X-Spam-Report: SpamAssasin (score=-0.3, required 5.0 ALL_TRUSTED=-1, HTML_IMAGE_ONLY_28=0.726, HTML_MESSAGE=0.001) X-Pg-Spam-Score: -1.2 (-) Content-Type: multipart/related; boundary="----=_Part_421_983964847.1415645562921" List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-sql Precedence: bulk Sender: pgsql-sql-owner@postgresql.org ------=_Part_420_1020838390.1415645562921 Content-Type: multipart/related; boundary="----=_Part_421_983964847.1415645562921" ------=_Part_421_983964847.1415645562921 Content-Type: multipart/alternative; boundary="----=_Part_422_620669498.1415645562938" ------=_Part_422_620669498.1415645562938 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable P=C3=A5 mandag 10. november 2014 kl. 17:19:10, skrev David G Johnston < david.g.johnston@gmail.com >: Igor Neyma= n=20 wrote > select p.name, sum(distinct m.years_experience) as years_exp_in_project, This is wrong on its face; two different people with the same experience will result in under-counting You need to figure out some way for the DISTINCT to include a personID and then just sum up the year_experience for each individual.=C2=A0 My initial thought was to use "ARRAY_AGG(DISTINCT composite_type)" to construct the unique dataset then pass the result through a custom function that would unnest(...) that array, pull out the years, sum them, and return the sum. > count(distinct (m.id, m.role)) Not technically a true role count if two people share the same role - it i= s unclear from the query what constraints the problem domain imposes.=C2=A0 = This can be a solution for this column. I don't really see how using a couple of CTEs to build up summaries for ea= ch table and then joining them together in an outer query is problematic.=C2= =A0 TBH it would probably be easier to maintain than one single super query with a bunch of distinct aggregates; and I doubt there would be much if any performance hit. =C2=A0 Using CTEs is what I am doing, just wondered if th= ere is=20 any other viable solution. In reality the query uses paging with "total cou= nt"=20 (count(*) with the same FROM-clause) because the dataset is large. The quer= y is=20 dynamically built up and counting totals with the "group by" required (when= not=20 using CTEs) in main-query easily messes up the total-count. =C2=A0 -- Andre= as Joseph=20 Krogh CTO / Partner - Visena AS Mobile: +47 909 56 963 andreas@visena.com= =20 www.visena.com =20 =C2=A0 ------=_Part_422_620669498.1415645562938 Content-Type: text/html;charset=UTF-8 Content-Transfer-Encoding: quoted-printable
P=C3=A5 mandag 10. november 2014 kl. 17:19:10, skrev David G Johnston = <david.g.johnston@gmail.co= m>:
Igo= r Neyman wrote
> select p.name, sum(distinct m.years_experience) as years_exp_in_projec= t,

This is wrong on its face; two different people with the same experience will result in under-counting

You need to figure out some way for the DISTINCT to include a personID and<= br> then just sum up the year_experience for each individual.=C2=A0 My initial<= br> thought was to use "ARRAY_AGG(DISTINCT composite_type)" to constr= uct the
unique dataset then pass the result through a custom function that would unnest(...) that array, pull out the years, sum them, and return the sum.

> count(distinct (m.id, m.role))

Not technically a true role count if two people share the same role - it is=
unclear from the query what constraints the problem domain imposes.=C2=A0 T= his
can be a solution for this column.

I don't really see how using a couple of CTEs to build up summaries for eac= h
table and then joining them together in an outer query is problematic.=C2= =A0 TBH
it would probably be easier to maintain than one single super query with a<= br> bunch of distinct aggregates; and I doubt there would be much if any
performance hit.
=C2=A0
Using CTEs is what I am doing, just wondered if there is any other via= ble solution. In reality the query uses paging with "total count"= (count(*) with the same FROM-clause) because the dataset is large. The que= ry is dynamically built up and counting totals with the "group by"= ; required (when not using CTEs) in main-query easily messes up the total-c= ount.
=C2=A0
--
Andrea= s Joseph Krogh
CTO / Partner<= /span> - Visena AS
Mobile: +47 90= 9 56 963
=3D""
=C2=A0
------=_Part_422_620669498.1415645562938-- ------=_Part_421_983964847.1415645562921 Content-Type: image/png Content-Transfer-Encoding: base64 Content-Disposition: inline Content-ID: iVBORw0KGgoAAAANSUhEUgAAAIUAAAAYCAYAAADUIj6hAAAABHNCSVQICAgIfAhkiAAABzBJREFU aEPtmNFxHDcMhmVP3i1VECpvnjzkVIHWFfhcgVcVRKrAUgWRK/C6Al8H3lTgy0PGbzFdQc4VJP/H ADs43q6kROeJNbOYgQACIAgCWJKng4MZ5gxUGXh0U0b+SIuF9G+EWXj2Q15vbrE/NPtk9uub7Gfd t5mBx1NhqSEo8HshjbEUtlO2yIM9tsx5dZP9rPt2MzDZFAqZE4LGcFjdsg3saQaHt7fY70X949On aS+OZidDBkavD33157L4xaw2os+Mp/DAC10l2XhOCeStj0W5ajrJL8WfCi80Xgf9vVlrhg9yRONe /f7xI2vNsIcM7JwU9o6oGyJrLT8JOA1aX9sKP4wl94bAniukEbo/n7YPmuTETzIab4Y9ZWCrKexd 8M58lxPCvvD6aihfvexbEQoPYO8NQRO0JnddGO6FJYaVsBde7cXj7KRk4LsqDxQzCYeGsJNgaXZe +JXkyGgWINq3Gp+bHNILz+wEYs5qH1eJrouNrpDXtk4O6x1IvtD40GWyJYYdkF0jIbYZlN16xygI gl9smbMDsmFdfAKb23xGB8H/mv3tOJfArs1kukk79DEPdQ5u0g1vCvvqKXIW8mZYW+F3Tg4r8HvZ kQCCLydK8EFMQCe5N8RgL9mRG0SqQFuNvdE6beSs0qPDBuCdg0+gvClso8SbTO4ki7mQzQqBrcMH QPwReg2wW8umEe/+L8T/LEzBGF9nXjzZ46s+ITHvhegW8LL39xm6App7KYL/GE+vcYnFbJiP/0aY hdiCnRC7jaj7eiK2ETInC5PRF6LYkSN0+HabF75WuT6syCyI0YkVGGMvUC33AmfZTDUEj8u6IVhu EhRUJ2U2g6UlugyNb03Hl9obHwlxJbcRzcYjO4QPjVfGFTQav4vrmp7cpMp2qbHnBxWJbisbho2Q XI6C1sIHDUFhH4Hij4UbIev66eANeiwbkA+LBsO36zAHzoXU7AhbqLAXEiOYTXcSdO8VS9L4wN8U BIYhBd6oSUgYMijOkecRuTdQa/YiBXhbXFcnCnI2SrfeBG9NydrLYMhGHa5qB9pQIxlzAE6Okjzx JO5afGe6kmhBicWKQNKuTZ5EW+MjQY8v/9rQ0bhJSJyNGUe/JH1t8h1iMbdSPAvxHYin6YmN9YBX QmTYZZNh14vHhhhal5vtcIrJjmvszPRJdExH3MWHvykoBEc9CoCGWJisOLOGoCORs1FvIMbYA8z3 kwM59oemy6LlWrLxFLmWgiQAfEGd8S+NssbK+EhyGLxUkhhiy717waBqHOJYSEacwBejkFNhjJNj v/gANOdQxPfciP/JVBCK2cOIcg3RRJ+CPrLPNVhhN6F38VKMF3XLlIJrjU5C8gMFxvKDvOcPc4rV NjCn7KM0BV+161V8viSCuJZ8SITGJGEh7IUUlxOFMYUH1kJOCN4Wh+I5pqCuK01k40kSNtnKiKIl UfxAgW5sU5JlS05rtt5YFJF1SWoqHv6BRgQcA4/bdb9WRjmMk3jyUMAbIoyJq9e4cVmgzKt9j5gN J/aYDhk+hhjExwaPcz5PObA5Zd9bvz5UzCTZuZDidu5AchpiKSwPR+TV1bCWqBQ9nCjJ5neivC82 Nr4LeS2j1gw5LUqwBuhGQQU5UwHeSslXkwIynz2U2A2yKDgG7OffwLA3TpGRpk0Tzpj3ZEJXi/GR a6GN0e0NtppChePdcAz1FTS+FN8Kpxoiykk+J8fC5tenjbu9kSqpHLu9jBrhUuhNwVGbpyZrzrl0 HPVD8SXj5EOOD/eDC64VjvYBZLuUbIVAfBN1t/C/SU+cAGtdGo+fVnzycUX5wmn6eCKPmWYJG2E/ ppTsuRCbvUD9fwquksG5GqLVKhzDQ3GrEyLKSXhsiK3T5j9EyxffCFOYi2wUlPyFFDQAhehESDjQ GoX0ho0oj8RPou6TxHJdcT0NTcWkO0AnG7+uXsnHqcas/72wvWF+mSf7N/Watp9kTXoluzeS0fB9 9CcZ/hvhSZTfh99pispZOXL9KrGrARkNUMu9ITbScZWs7xOYNt9pwxSZtYDsX/GE3xTkrXgwAsXm fud08FiTeC+m2/o7ppo+PTS/NBK5ARpDG5YHr++DpmVfreYdiX8mnp+DzPEG9WbqJON0JBenZofs sxBA1gj5NXGvfJu/Qh7HwQh/VDUEyUxCit5hH94QfKkEdu+GwK8BX0hvCF+D67xhjmXQCXMwJCZ+ olK0A1EKRCE4snsh42w8Mv/Zhxw9iD7Cjo7CyQC/KyF6oBfShL4PYgG+CHsYKyZxvxZSZBAgjhIz YDz+AbfD37GtbaoSKzgGt+lKfI/GZtay6vG4VXTpPsh+IcQhOk9I7WYeP5AM3HZ9+DaSGIp9HIuu huC4pCGGx+YD2fcc5tfIAA0h/Et4/jX8zz4fWAasIf4UbR9Y6HO4d8jAnd4U0Y8ageuCB+c+H5R3 CHU2mTMwZ+B/y8DfSMBLLOYXVuEAAAAASUVORK5CYII= ------=_Part_421_983964847.1415645562921-- ------=_Part_420_1020838390.1415645562921--