pg.ddx.io pgsql-admin@postgresql.org mailing list archive
help / color / mirror / Atom feedQuerying the same column and table across schemas
7+ messages / 3 participants
[nested] [flat]
* Querying the same column and table across schemas
@ 2010-03-05 19:44 John A. Sullivan III <jsullivan@opensourcedevel.com>
0 siblings, 2 replies; 7+ messages in thread
From: John A. Sullivan III @ 2010-03-05 19:44 UTC (permalink / raw)
To: pgsql-admin
Hello, all. I'm working on a project using the X2Go terminal server
project (www.x2go.org). They record session data in a postgresql
database. Our environment is a little more secure than typical and we
do not want it possible for one user to see another's session data. We
thus have divided the session database into schemas each with an
identical set of tables. Each user only writes and reads from their
schema.
However, we need to query all schemas as if they were one. Is there a
way to do that?
In other words, if we were a single schema database, we could do
select session_id from sessions;
to list all sessions. How can we accomplish the same thing to list all
the sessions across all the schemas in a single query?
I'm trying to avoid making a thousand call like
select user1.session_id from user1.sessions;
when I could do it in a single query especially since the database is
remote and secured with SSL.
Thanks - John
^ permalink raw reply [nested|flat] 7+ messages in thread
* Re: Querying the same column and table across schemas
@ 2010-03-05 19:59 Daniel J. Summers <daniel.lists@djs-consulting.com>
parent: John A. Sullivan III <jsullivan@opensourcedevel.com>
1 sibling, 1 reply; 7+ messages in thread
From: Daniel J. Summers @ 2010-03-05 19:59 UTC (permalink / raw)
To: pgsql-admin
On 03/05/2010 07:44 PM, John A. Sullivan III wrote:
> I'm trying to avoid making a thousand call like
>
> select user1.session_id from user1.sessions;
>
> when I could do it in a single query especially since the database is
> remote and secured with SSL.
>
CREATE VIEW all_sessions AS
SELECT user1.session_id, 1 as user_number
FROM user1.sessions
UNION
SELECT user2.session_id, 2 AS user_number
FROM user2.sessions
UNION
...more schemas...
Then, "SELECT * FROM all_sessions" would show you each session ID (and,
with the user_number field, what user - you could use a string literal
there too). Of course, the user creating and running this would need
SELECT privileges on each schema's "sessions" table.
Daniel
^ permalink raw reply [nested|flat] 7+ messages in thread
* Re: Querying the same column and table across schemas
@ 2010-03-05 20:44 John A. Sullivan III <jsullivan@opensourcedevel.com>
parent: Daniel J. Summers <daniel.lists@djs-consulting.com>
0 siblings, 1 reply; 7+ messages in thread
From: John A. Sullivan III @ 2010-03-05 20:44 UTC (permalink / raw)
To: Daniel J. Summers <daniel.lists@djs-consulting.com>; +Cc: pgsql-admin
On Fri, 2010-03-05 at 19:59 +0000, Daniel J. Summers wrote:
> On 03/05/2010 07:44 PM, John A. Sullivan III wrote:
> > I'm trying to avoid making a thousand call like
> >
> > select user1.session_id from user1.sessions;
> >
> > when I could do it in a single query especially since the database is
> > remote and secured with SSL.
> >
> CREATE VIEW all_sessions AS
> SELECT user1.session_id, 1 as user_number
> FROM user1.sessions
> UNION
> SELECT user2.session_id, 2 AS user_number
> FROM user2.sessions
> UNION
> ...more schemas...
>
> Then, "SELECT * FROM all_sessions" would show you each session ID (and,
> with the user_number field, what user - you could use a string literal
> there too). Of course, the user creating and running this would need
> SELECT privileges on each schema's "sessions" table.
>
>
> Daniel
>
That sounds quite reasonable. I'm guessing that a view is superior to
creating a new schema with tables derived from selects from all the
schemas because it would be less overhead and dynamic, i.e., I only
create the view once and it always has the most current data. Is that
correct?
As we add new schemas, is there an easy way to update the view? That was
not obvious to me looking at the documentation for ALTER VIEW and CREATE
OR REPLACE VIEW seems to be sensitive to ensuring the new view is
identical to the old except for appends. It would be nice if we could
simply append
UNION SELECT * from user3.sessions
to the view. Thanks very, very much - John
^ permalink raw reply [nested|flat] 7+ messages in thread
* Re: Querying the same column and table across schemas
@ 2010-03-05 22:13 Bob Lunney <bob_lunney@yahoo.com>
parent: John A. Sullivan III <jsullivan@opensourcedevel.com>
1 sibling, 1 reply; 7+ messages in thread
From: Bob Lunney @ 2010-03-05 22:13 UTC (permalink / raw)
To: pgsql-admin
--- On Fri, 3/5/10, John A. Sullivan III <jsullivan@opensourcedevel.com> wrote:
> From: John A. Sullivan III <jsullivan@opensourcedevel.com>
> Subject: [ADMIN] Querying the same column and table across schemas
> To: pgsql-admin@postgresql.org
> Date: Friday, March 5, 2010, 2:44 PM
> Hello, all. I'm working on a
> project using the X2Go terminal server
> project (www.x2go.org). They record session data in a
> postgresql
> database. Our environment is a little more secure
> than typical and we
> do not want it possible for one user to see another's
> session data. We
> thus have divided the session database into schemas each
> with an
> identical set of tables. Each user only writes and
> reads from their
> schema.
>
> However, we need to query all schemas as if they were
> one. Is there a
> way to do that?
>
> In other words, if we were a single schema database, we
> could do
>
> select session_id from sessions;
>
> to list all sessions. How can we accomplish the same
> thing to list all
> the sessions across all the schemas in a single query?
>
> I'm trying to avoid making a thousand call like
>
> select user1.session_id from user1.sessions;
>
> when I could do it in a single query especially since the
> database is
> remote and secured with SSL.
>
> Thanks - John
>
John,
How about creating a central admin schema and putting a trigger on all the sessions tables to write changes to the central admin schema's session table? The function could belong to the admin role and run with definer's security.
Bob
^ permalink raw reply [nested|flat] 7+ messages in thread
* Re: Querying the same column and table across schemas
@ 2010-03-05 22:39 John A. Sullivan III <jsullivan@opensourcedevel.com>
parent: Bob Lunney <bob_lunney@yahoo.com>
0 siblings, 1 reply; 7+ messages in thread
From: John A. Sullivan III @ 2010-03-05 22:39 UTC (permalink / raw)
To: Bob Lunney <bob_lunney@yahoo.com>; +Cc: pgsql-admin
On Fri, 2010-03-05 at 14:13 -0800, Bob Lunney wrote:
>
> --- On Fri, 3/5/10, John A. Sullivan III <jsullivan@opensourcedevel.com> wrote:
>
> > From: John A. Sullivan III <jsullivan@opensourcedevel.com>
> > Subject: [ADMIN] Querying the same column and table across schemas
> > To: pgsql-admin@postgresql.org
> > Date: Friday, March 5, 2010, 2:44 PM
> > Hello, all. I'm working on a
> > project using the X2Go terminal server
> > project (www.x2go.org). They record session data in a
> > postgresql
> > database. Our environment is a little more secure
> > than typical and we
> > do not want it possible for one user to see another's
> > session data. We
> > thus have divided the session database into schemas each
> > with an
> > identical set of tables. Each user only writes and
> > reads from their
> > schema.
> >
> > However, we need to query all schemas as if they were
> > one. Is there a
> > way to do that?
> >
> > In other words, if we were a single schema database, we
> > could do
> >
> > select session_id from sessions;
> >
> > to list all sessions. How can we accomplish the same
> > thing to list all
> > the sessions across all the schemas in a single query?
> >
> > I'm trying to avoid making a thousand call like
> >
> > select user1.session_id from user1.sessions;
> >
> > when I could do it in a single query especially since the
> > database is
> > remote and secured with SSL.
> >
> > Thanks - John
> >
>
> John,
>
> How about creating a central admin schema and putting a trigger on all the sessions tables to write changes to the central admin schema's session table? The function could belong to the admin role and run with definer's security.
>
> Bob
>
>
>
>
That sounds ideal and perhaps lower overhead than rerunning the view
build query every time I query the view but, being a database ignoramus,
it is quite beyond my skills :-( If I can scrape up the time, I'll do
some research on triggers and functions. I have used functions before
but never triggers. Thanks - John
^ permalink raw reply [nested|flat] 7+ messages in thread
* Re: Querying the same column and table across schemas
@ 2010-03-06 00:11 Daniel J. Summers <daniel.lists@djs-consulting.com>
parent: John A. Sullivan III <jsullivan@opensourcedevel.com>
0 siblings, 0 replies; 7+ messages in thread
From: Daniel J. Summers @ 2010-03-06 00:11 UTC (permalink / raw)
To: pgsql-admin
On 03/05/2010 08:44 PM, John A. Sullivan III wrote:
> On Fri, 2010-03-05 at 19:59 +0000, Daniel J. Summers wrote:
>
>> On 03/05/2010 07:44 PM, John A. Sullivan III wrote:
>>
>>> I'm trying to avoid making a thousand call like
>>>
>>> select user1.session_id from user1.sessions;
>>>
>>> when I could do it in a single query especially since the database is
>>> remote and secured with SSL.
>>>
>>>
>> CREATE VIEW all_sessions AS
>> ...
>>
> That sounds quite reasonable. I'm guessing that a view is superior to
> creating a new schema with tables derived from selects from all the
> schemas because it would be less overhead and dynamic, i.e., I only
> create the view once and it always has the most current data. Is that
> correct?
>
Right - the view is the window to the tables. It will query each of
those, so it might take some time - but, hopefully the session tables
would be pretty small, so it should run adequately.
> As we add new schemas, is there an easy way to update the view? That was
> not obvious to me looking at the documentation for ALTER VIEW and CREATE
> OR REPLACE VIEW seems to be sensitive to ensuring the new view is
> identical to the old except for appends. It would be nice if we could
> simply append
> UNION SELECT * from user3.sessions
> to the view.
What I usually do with views is simply save the SQL in source control,
then append a drop right in front of it (i.e., "DROP VIEW view_name;
CREATE..."). I actually end up saving it like that because, as I'm
developing it, I often don't get it right the first time. :) As there
are no foreign key constraints to worry about with views, they can be
dropped and recreated pretty easily.
Daniel
^ permalink raw reply [nested|flat] 7+ messages in thread
* Re: Querying the same column and table across schemas
@ 2010-03-09 08:02 John A. Sullivan III <jsullivan@opensourcedevel.com>
parent: John A. Sullivan III <jsullivan@opensourcedevel.com>
0 siblings, 0 replies; 7+ messages in thread
From: John A. Sullivan III @ 2010-03-09 08:02 UTC (permalink / raw)
To: Bob Lunney <bob_lunney@yahoo.com>; +Cc: pgsql-admin
On Fri, 2010-03-05 at 17:39 -0500, John A. Sullivan III wrote:
> On Fri, 2010-03-05 at 14:13 -0800, Bob Lunney wrote:
> >
> > --- On Fri, 3/5/10, John A. Sullivan III <jsullivan@opensourcedevel.com> wrote:
> >
> > > From: John A. Sullivan III <jsullivan@opensourcedevel.com>
> > > Subject: [ADMIN] Querying the same column and table across schemas
> > > To: pgsql-admin@postgresql.org
> > > Date: Friday, March 5, 2010, 2:44 PM
> > > Hello, all. I'm working on a
> > > project using the X2Go terminal server
> > > project (www.x2go.org). They record session data in a
> > > postgresql
> > > database. Our environment is a little more secure
> > > than typical and we
> > > do not want it possible for one user to see another's
> > > session data. We
> > > thus have divided the session database into schemas each
> > > with an
> > > identical set of tables. Each user only writes and
> > > reads from their
> > > schema.
> > >
> > > However, we need to query all schemas as if they were
> > > one. Is there a
> > > way to do that?
> > >
> > > In other words, if we were a single schema database, we
> > > could do
> > >
> > > select session_id from sessions;
> > >
> > > to list all sessions. How can we accomplish the same
> > > thing to list all
> > > the sessions across all the schemas in a single query?
> > >
> > > I'm trying to avoid making a thousand call like
> > >
> > > select user1.session_id from user1.sessions;
> > >
> > > when I could do it in a single query especially since the
> > > database is
> > > remote and secured with SSL.
> > >
> > > Thanks - John
> > >
> >
> > John,
> >
> > How about creating a central admin schema and putting a trigger on all the sessions tables to write changes to the central admin schema's session table? The function could belong to the admin role and run with definer's security.
> >
> > Bob
> >
> >
> >
> >
> That sounds ideal and perhaps lower overhead than rerunning the view
> build query every time I query the view but, being a database ignoramus,
> it is quite beyond my skills :-( If I can scrape up the time, I'll do
> some research on triggers and functions. I have used functions before
> but never triggers. Thanks - John
>
>
After thinking about it quite a while, the advantages seemed to be so
great for doing this considering we are anticipating hundreds of
schemas, we jumped in and gave it a try. The following seems to be
working find after creating a postgres schema, the needed sessions table
inside that schema, and adding plpgsql language to the cluster:
CREATE OR REPLACE FUNCTION public.syncschema() RETURNS trigger AS '
DECLARE old_path TEXT;
BEGIN
-- Save old search_path; notice we must qualify current_setting
-- to ensure we invoke the right function
old_path := pg_catalog.current_setting(''search_path'');
-- Set a secure search_path: trusted schemas, then pg_temp.
-- We set is_local = true so that the old value will be restored
-- in event of an error before we reach the function end.
PERFORM pg_catalog.set_config(''search_path'', ''postgres, pg_temp'', true);
IF tg_op = ''INSERT'' THEN
insert into postgres.sessions (session_id,display,uname,server,client,status,init_time,last_time,cookie,agent_pid,gr_port,sound_port,fs_port) values (new.session_id,new.display,new.uname,new.server,new.client,new.status,new.init_time,new.last_time,new.cookie,new.agent_pid,new.gr_port,new.sound_port,new.fs_port);
ELSEIF tg_op = ''DELETE'' THEN
delete from postgres.sessions where session_id=old.session_id;
ELSEIF tg_op = ''UPDATE'' THEN
update postgres.sessions set display=new.display,uname=new.uname,server=new.server,client=new.client,status=new.status,init_time=new.init_time,last_time=new.last_time,cookie=new.cookie,agent_pid=new.agent_pid,gr_port=new.gr_port,sound_port=new.sound_port,fs_port=new.fs_port where session_id=old.session_id;
END IF;
-- Restore the search_path of the caller
PERFORM pg_catalog.set_config(''search_path'', old_path, true);
RETURN NULL;
END ' LANGUAGE plpgsql SECURITY DEFINER;
CREATE TRIGGER syncschema AFTER INSERT OR DELETE OR UPDATE ON <schema name>.sessions FOR EACH ROW EXECUTE PROCEDURE public.syncschema();
Thanks very much - John
^ permalink raw reply [nested|flat] 7+ messages in thread
end of thread, other threads:[~2010-03-09 08:02 UTC | newest]
Thread overview: 7+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2010-03-05 19:44 Querying the same column and table across schemas John A. Sullivan III <jsullivan@opensourcedevel.com>
2010-03-05 19:59 ` Daniel J. Summers <daniel.lists@djs-consulting.com>
2010-03-05 20:44 ` John A. Sullivan III <jsullivan@opensourcedevel.com>
2010-03-06 00:11 ` Daniel J. Summers <daniel.lists@djs-consulting.com>
2010-03-05 22:13 ` Bob Lunney <bob_lunney@yahoo.com>
2010-03-05 22:39 ` John A. Sullivan III <jsullivan@opensourcedevel.com>
2010-03-09 08:02 ` John A. Sullivan III <jsullivan@opensourcedevel.com>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox