pg.ddx.io pgsql-students@postgresql.org mailing list archive
help / color / mirror / Atom feedGoogle Summer of Code 2013
19+ messages / 8 participants
[nested] [flat]
* Google Summer of Code 2013
@ 2013-04-12 07:02 Karel K. Rozhoň <karel.rozhon@gmail.com>
0 siblings, 0 replies; 19+ messages in thread
From: Karel K. Rozhoň @ 2013-04-12 07:02 UTC (permalink / raw)
To: pgsql-students
Hello everybody,
My name is Karel Rozhoň and I am in the third year of bachelor study at CTU, Faculty of information technology in Prague (Czech Republic).
I would like to contribute to PostgreSQL and participate in the Google Summer of Code 2013. I would like to implement parallelization of a hash table. I am considering to use processes, because of PostgreSQL is not a thread safe, which means that there could be problems with memory management. I would like learn more about bg_workers, which are in version 9.3 and when it will be appropriate use them. In the end of this project I would like to have functional version of parallelization of a hash aggregate. I have some basic knowledgement about hacking PostgreSQL - I am trying to make a few similar stuffs with Posix threads as a part of my bachelor thesis at this moment (My mentor in bachelor thesis is Pavel Stěhule).
I have spoken about this project with Tomáš Vondra and he agreed to be my mentor.
What do you think about this project?
Thank you for your response and advice
Karel K. Rozhoň
--
Karel K. Rozhoň <karel.rozhon@gmail.com>
--
Sent via pgsql-students mailing list (pgsql-students@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-students
^ permalink raw reply [nested|flat] 19+ messages in thread
* Google Summer of code 2013
@ 2013-04-13 16:39 Karel K. Rozhoň <karel.rozhon@gmail.com>
2013-04-14 22:16 ` Re: Google Summer of code 2013 Stephen Frost <sfrost@snowman.net>
0 siblings, 1 reply; 19+ messages in thread
From: Karel K. Rozhoň @ 2013-04-13 16:39 UTC (permalink / raw)
To: pgsql-students
Hello everybody,
My name is Karel Rozhoň and I am in the third year of bachelor study at CTU, Faculty of information technology in Prague (Czech Republic).
I would like to contribute to PostgreSQL and participate in the Google Summer of Code 2013. I would like to implement parallelization of a hash table. I am considering to use processes, because of PostgreSQL is not a thread safe, which means that there could be problems with memory management. I would like learn more about bg_workers, which are in version 9.3 and when it will be appropriate use them. In the end of this project I would like to have functional version of parallelization of a hash aggregate. I have some basic knowledgement about hacking PostgreSQL - I am trying to make a few similar stuffs with Posix threads as a part of my bachelor thesis at this moment (My mentor in bachelor thesis is Pavel Stěhule).
I have spoken about this project with Tomáš Vondra and he agreed to be my mentor.
What do you think about this project?
Thank you for your response and advice
Karel K. Rozhoň
--
Karel K. Rozhoň <karel.rozhon@gmail.com>
--
Sent via pgsql-students mailing list (pgsql-students@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-students
^ permalink raw reply [nested|flat] 19+ messages in thread
* Re: Google Summer of code 2013
2013-04-13 16:39 Google Summer of code 2013 Karel K. Rozhoň <karel.rozhon@gmail.com>
@ 2013-04-14 22:16 ` Stephen Frost <sfrost@snowman.net>
2013-04-15 01:37 ` Re: Google Summer of code 2013 Tomas Vondra <tv@fuzzy.cz>
0 siblings, 1 reply; 19+ messages in thread
From: Stephen Frost @ 2013-04-14 22:16 UTC (permalink / raw)
To: Karel K. Rozhoň <karel.rozhon@gmail.com>; +Cc: pgsql-students
* Karel K. Rozhoň (karel.rozhon@gmail.com) wrote:
> What do you think about this project?
Parallelization in PG is a pretty massive discussion and probably not
suited to a GSoC project. Once we have the groundwork for doing
parallel processing for a given query, I doubt that hash tables will be
the first piece implemented.
Thanks,
Stephen
Attachments:
signature.asc (application/pgp-signature, 197B) download
^ permalink raw reply [nested|flat] 19+ messages in thread
* Re: Google Summer of code 2013
2013-04-13 16:39 Google Summer of code 2013 Karel K. Rozhoň <karel.rozhon@gmail.com>
2013-04-14 22:16 ` Re: Google Summer of code 2013 Stephen Frost <sfrost@snowman.net>
@ 2013-04-15 01:37 ` Tomas Vondra <tv@fuzzy.cz>
2013-04-15 01:54 ` Re: Google Summer of code 2013 Stephen Frost <sfrost@snowman.net>
0 siblings, 1 reply; 19+ messages in thread
From: Tomas Vondra @ 2013-04-15 01:37 UTC (permalink / raw)
To: pgsql-students
Hi,
I've briefly discussed the project with the student a while back, so a
few thoughts on the project:
On 15.4.2013 00:16, Stephen Frost wrote:
> * Karel K. Rozhoň (karel.rozhon@gmail.com) wrote:
>> What do you think about this project?
>
> Parallelization in PG is a pretty massive discussion and probably not
> suited to a GSoC project. Once we have the groundwork for doing
There's certainly a lot of groundwork to do, and I do share the concern
that the project will have to deal with a lot of dirty work (e.g. when
transfering data between the processes). But couldn't it be a useful
part of the discussion?
I don't expect a commitable patch at the end, but rather something that
"works" and may be used as a basis for improvements and to build the
actual groundwork.
> parallel processing for a given query, I doubt that hash tables will be
> the first piece implemented.
I think that depends on the workload type. For example for databases
handling DWH-like queries, parallel hash aggregate is going to be a
major improvement.
Karel mentioned he's currently working on his bachelor thesis, which is
about hash tables too. That's another reason why he proposed this topic.
regards
Tomas
--
Sent via pgsql-students mailing list (pgsql-students@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-students
^ permalink raw reply [nested|flat] 19+ messages in thread
* Re: Google Summer of code 2013
2013-04-13 16:39 Google Summer of code 2013 Karel K. Rozhoň <karel.rozhon@gmail.com>
2013-04-14 22:16 ` Re: Google Summer of code 2013 Stephen Frost <sfrost@snowman.net>
2013-04-15 01:37 ` Re: Google Summer of code 2013 Tomas Vondra <tv@fuzzy.cz>
@ 2013-04-15 01:54 ` Stephen Frost <sfrost@snowman.net>
2013-04-15 15:51 ` Re: Google Summer of code 2013 Karel K. Rozhoň <karel.rozhon@gmail.com>
0 siblings, 1 reply; 19+ messages in thread
From: Stephen Frost @ 2013-04-15 01:54 UTC (permalink / raw)
To: Tomas Vondra <tv@fuzzy.cz>; +Cc: pgsql-students
Tomas,
* Tomas Vondra (tv@fuzzy.cz) wrote:
> There's certainly a lot of groundwork to do, and I do share the concern
> that the project will have to deal with a lot of dirty work (e.g. when
> transfering data between the processes). But couldn't it be a useful
> part of the discussion?
A one-off implementation of parallelized hash table building and/or
usage..? No, I don't see that as particularly relevant to the
discussion around how to do parallelize queries. There are a ton of
examples already of parallel hash table building and various other
independent pieces (parallel sort, parallel aggregation, etc). What is
needed for parallel query processing in PG is to figure out what we mean
by it and how to actually implement it. Following that would be making
the query planner and optimizer aware of it, last would be picking a
specific parallelized implementation of each node and writing it (and
that, really, is the 'easy' part in all of this...).
> I don't expect a commitable patch at the end, but rather something that
> "works" and may be used as a basis for improvements and to build the
> actual groundwork.
I don't think it'd really help us get any farther with parallel query
execution. To be honest, I'd be a bit surprised if this hasn't been
done already and patches posted to the list in the past..
> I think that depends on the workload type. For example for databases
> handling DWH-like queries, parallel hash aggregate is going to be a
> major improvement.
DWH is what I deal with day-in and day-out and I certainly agree that
parallelizing hash builds would be wonderful- but that doesn't mean that
a patch which implements it without any consideration for the rest of
the challenges around parallel query execution will actually move us, as
a project, any closer to getting it. In fact, I'd expect most DWH
implementations to do what we've done already- massive partitioning and
parallelizing through multiple client connections.
> Karel mentioned he's currently working on his bachelor thesis, which is
> about hash tables too. That's another reason why he proposed this topic.
That's wonderful, I'd love to hear about some ways to improve our
hashing system (I've even proposed one modification a few days ago that
I'd like to see tested more). I believe that costing around hashing
needs to be improved too.
Parallel-anything is a 'sexy' project, but unless it's focused on how we
answer the hard questions around how do we do parallel work efficiently
while maintaining scalability and portability then it's not moving us
forward.
Thanks,
Stephen
Attachments:
signature.asc (application/pgp-signature, 197B) download
^ permalink raw reply [nested|flat] 19+ messages in thread
* Re: Google Summer of code 2013
2013-04-13 16:39 Google Summer of code 2013 Karel K. Rozhoň <karel.rozhon@gmail.com>
2013-04-14 22:16 ` Re: Google Summer of code 2013 Stephen Frost <sfrost@snowman.net>
2013-04-15 01:37 ` Re: Google Summer of code 2013 Tomas Vondra <tv@fuzzy.cz>
2013-04-15 01:54 ` Re: Google Summer of code 2013 Stephen Frost <sfrost@snowman.net>
@ 2013-04-15 15:51 ` Karel K. Rozhoň <karel.rozhon@gmail.com>
2013-04-15 16:27 ` Re: Google Summer of code 2013 Stephen Frost <sfrost@snowman.net>
0 siblings, 1 reply; 19+ messages in thread
From: Karel K. Rozhoň @ 2013-04-15 15:51 UTC (permalink / raw)
To: pgsql-students
At first I would like to thank you for your responses and opinions.
Of course I don't see all aspects of this problem, so I cannot tell what should be good for future. But I have done some profiles of group by select and I believe, parallel calling of some hash procedures could help.
Set an examle:
postgres=# \d charlie
Table "public.charlie"
Column | Type | Modifiers
--------+---------+-----------
a | integer | not null
b | integer |
c | integer |
Indexes:
"charlie_pkey" PRIMARY KEY, btree (a)
insert into charlie (a,b,c) values (generate_series(1,15000000), 5, generate_series(1,100000));
postgres=# explain select count(*) from (select min(a), max(b) from charlie group by c offset 0) x;
QUERY PLAN
--------------------------------------------------------------------------------
------------
Aggregate (cost=3196549.18..3196549.19 rows=1 width=0)
-> Limit (cost=3044301.02..3195298.60 rows=100047 width=12)
-> GroupAggregate (cost=3044301.02..3195298.60 rows=100047 width=12)
-> Sort (cost=3044301.02..3081800.29 rows=14999711 width=12)
Sort Key: charlie.c
-> Seq Scan on charlie (cost=0.00..231079.11 rows=1499971
1 width=12)
(6 rows)
Oprofile output:
CPU: Intel Westmere microarchitecture, speed 2.267e+06 MHz (estimated)
Counted CPU_CLK_UNHALTED events (Clock cycles when not halted) with a unit mask of 0x00 (No unit mask) count 100000
samples % symbol name
85519 38.0101 hash_search_with_hash_value
14009 6.2265 slot_deform_tuple
11808 5.2482 ExecProject
7675 3.4113 slot_getattr
7539 3.3508 advance_aggregates
6932 3.0810 ExecAgg
Of course I know, these simply case is only teoretical and in real tables are data much more complicated, but as I can see, almost 40% of CPU time was computed only one hash function: hash_search_with_hash_value.
On Sun, 14 Apr 2013 21:54:00 -0400
Stephen Frost <sfrost@snowman.net> wrote:
> Tomas,
>
> * Tomas Vondra (tv@fuzzy.cz) wrote:
> > There's certainly a lot of groundwork to do, and I do share the concern
> > that the project will have to deal with a lot of dirty work (e.g. when
> > transfering data between the processes). But couldn't it be a useful
> > part of the discussion?
>
> A one-off implementation of parallelized hash table building and/or
> usage..? No, I don't see that as particularly relevant to the
> discussion around how to do parallelize queries. There are a ton of
> examples already of parallel hash table building and various other
> independent pieces (parallel sort, parallel aggregation, etc). What is
> needed for parallel query processing in PG is to figure out what we mean
> by it and how to actually implement it. Following that would be making
> the query planner and optimizer aware of it, last would be picking a
> specific parallelized implementation of each node and writing it (and
> that, really, is the 'easy' part in all of this...).
>
> > I don't expect a commitable patch at the end, but rather something that
> > "works" and may be used as a basis for improvements and to build the
> > actual groundwork.
>
> I don't think it'd really help us get any farther with parallel query
> execution. To be honest, I'd be a bit surprised if this hasn't been
> done already and patches posted to the list in the past..
>
> > I think that depends on the workload type. For example for databases
> > handling DWH-like queries, parallel hash aggregate is going to be a
> > major improvement.
>
> DWH is what I deal with day-in and day-out and I certainly agree that
> parallelizing hash builds would be wonderful- but that doesn't mean that
> a patch which implements it without any consideration for the rest of
> the challenges around parallel query execution will actually move us, as
> a project, any closer to getting it. In fact, I'd expect most DWH
> implementations to do what we've done already- massive partitioning and
> parallelizing through multiple client connections.
>
> > Karel mentioned he's currently working on his bachelor thesis, which is
> > about hash tables too. That's another reason why he proposed this topic.
>
> That's wonderful, I'd love to hear about some ways to improve our
> hashing system (I've even proposed one modification a few days ago that
> I'd like to see tested more). I believe that costing around hashing
> needs to be improved too.
>
> Parallel-anything is a 'sexy' project, but unless it's focused on how we
> answer the hard questions around how do we do parallel work efficiently
> while maintaining scalability and portability then it's not moving us
> forward.
>
> Thanks,
>
> Stephen
--
Karel K. Rozhoň <karel.rozhon@gmail.com>
--
Sent via pgsql-students mailing list (pgsql-students@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-students
^ permalink raw reply [nested|flat] 19+ messages in thread
* Re: Google Summer of code 2013
2013-04-13 16:39 Google Summer of code 2013 Karel K. Rozhoň <karel.rozhon@gmail.com>
2013-04-14 22:16 ` Re: Google Summer of code 2013 Stephen Frost <sfrost@snowman.net>
2013-04-15 01:37 ` Re: Google Summer of code 2013 Tomas Vondra <tv@fuzzy.cz>
2013-04-15 01:54 ` Re: Google Summer of code 2013 Stephen Frost <sfrost@snowman.net>
2013-04-15 15:51 ` Re: Google Summer of code 2013 Karel K. Rozhoň <karel.rozhon@gmail.com>
@ 2013-04-15 16:27 ` Stephen Frost <sfrost@snowman.net>
0 siblings, 0 replies; 19+ messages in thread
From: Stephen Frost @ 2013-04-15 16:27 UTC (permalink / raw)
To: Karel K. Rozhoň <karel.rozhon@gmail.com>; +Cc: pgsql-students
* Karel K. Rozhoň (karel.rozhon@gmail.com) wrote:
> Of course I don't see all aspects of this problem, so I cannot tell what should be good for future. But I have done some profiles of group by select and I believe, parallel calling of some hash procedures could help.
There seems to be some confuison here. It's certainly true that *many*
(most? all?) pieces of query processing would benefit from parallel
execution; there is no debate on that.
The issue is that PG is not currently set up to do *any* per-query
parallel processing and it is *not* a trival thing to change that. We
can talk all day about how wonderful it'd be to do parallel hashing,
parallel sorting, etc, but until PG has a way to parallelize query
processing, there's really no point to writing code to parallelize
individual nodes.
> Of course I know, these simply case is only teoretical and in real tables are data much more complicated, but as I can see, almost 40% of CPU time was computed only one hash function: hash_search_with_hash_value.
Improvements to that would be great, but you can't simply call
pthread_create() in a PG backend and expect things to work.
Thanks,
Stephen
Attachments:
signature.asc (application/pgp-signature, 197B) download
^ permalink raw reply [nested|flat] 19+ messages in thread
* Google Summer of code 2013
@ 2013-04-15 14:56 Akansha Singh <akansha.singh@oracle.com>
0 siblings, 0 replies; 19+ messages in thread
From: Akansha Singh @ 2013-04-15 14:56 UTC (permalink / raw)
To: sfrost@snowman.net; +Cc: tv@fuzzy.cz; pgsql-students
Hi,
I guess parallel query wont be fruitful or most probably
it might have been already implemented..
> There's certainly a lot of groundwork to do, and I do share the concern
> that the project will have to deal with a lot of dirty work (e.g. when
> transfering data between the processes). But couldn't it be a useful
> part of the discussion?
A one-off implementation of parallelized hash table building and/or
usage..? No, I don't see that as particularly relevant to the
discussion around how to do parallelize queries. There are a ton of
examples already of parallel hash table building and various other
independent pieces (parallel sort, parallel aggregation, etc). What is
needed for parallel query processing in PG is to figure out what we mean
by it and how to actually implement it. Following that would be making
the query planner and optimizer aware of it, last would be picking a
specific parallelized implementation of each node and writing it (and
that, really, is the 'easy' part in all of this...).
> I don't expect a commitable patch at the end, but rather something that
> "works" and may be used as a basis for improvements and to build the
> actual groundwork.
I don't think it'd really help us get any farther with parallel query
execution. To be honest, I'd be a bit surprised if this hasn't been
done already and patches posted to the list in the past..
> I think that depends on the workload type. For example for databases
> handling DWH-like queries, parallel hash aggregate is going to be a
> major improvement.
DWH is what I deal with day-in and day-out and I certainly agree that
parallelizing hash builds would be wonderful- but that doesn't mean that
a patch which implements it without any consideration for the rest of
the challenges around parallel query execution will actually move us, as
a project, any closer to getting it. In fact, I'd expect most DWH
implementations to do what we've done already- massive partitioning and
parallelizing through multiple client connections.
> Karel mentioned he's currently working on his bachelor thesis, which is
> about hash tables too. That's another reason why he proposed this topic.
That's wonderful, I'd love to hear about some ways to improve our
hashing system (I've even proposed one modification a few days ago that
I'd like to see tested more). I believe that costing around hashing
needs to be improved too.
Parallel-anything is a 'sexy' project, but unless it's focused on how we
answer the hard questions around how do we do parallel work efficiently
while maintaining scalability and portability then it's not moving us
forward.
regards
Akansha Singh
--
Sent via pgsql-students mailing list (pgsql-students@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-students
^ permalink raw reply [nested|flat] 19+ messages in thread
* Google Summer of code 2013
@ 2013-04-15 15:08 Akansha Singh <akansha.singh@oracle.com>
2013-04-15 15:12 ` Re: Google Summer of code 2013 Atri Sharma <atri.jiit@gmail.com>
0 siblings, 1 reply; 19+ messages in thread
From: Akansha Singh @ 2013-04-15 15:08 UTC (permalink / raw)
To: sfrost@snowman.net; +Cc: karel.rozhon@gmail.com; pgsql-students
HI all
I am Akansha Singh. I am a Java developer with experience of designing
databases.i have been an intern in Oracle , i had worked on Oracle database
I have also did project using JDBC before .I will be highly obliged if some one can
give ur suggestions for the project idea.
I would be interested to work on PL/Java and JDBC.
>
> Please let me know of any project that currently need attention.I would
> be honored to contribute to the community.
regards
Akansha Singh
--
Sent via pgsql-students mailing list (pgsql-students@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-students
^ permalink raw reply [nested|flat] 19+ messages in thread
* Re: Google Summer of code 2013
2013-04-15 15:08 Google Summer of code 2013 Akansha Singh <akansha.singh@oracle.com>
@ 2013-04-15 15:12 ` Atri Sharma <atri.jiit@gmail.com>
2013-04-15 15:42 ` Re: Google Summer of code 2013 viod <viod.len@gmail.com>
0 siblings, 1 reply; 19+ messages in thread
From: Atri Sharma @ 2013-04-15 15:12 UTC (permalink / raw)
To: Akansha Singh <akansha.singh@oracle.com>; +Cc: Stephen Frost <sfrost@snowman.net>; karel.rozhon@gmail.com; pgsql-students
> HI all
>
> I am Akansha Singh. I am a Java developer with experience of designing
> databases.i have been an intern in Oracle , i had worked on Oracle database
> I have also did project using JDBC before .I will be highly obliged if some one can
> give ur suggestions for the project idea.
>
> I would be interested to work on PL/Java and JDBC.
>>
>> Please let me know of any project that currently need attention.I would
>> be honored to contribute to the community.
>
> regards
> Akansha Singh
>
>
I think a new JDBC driver is being worked on.You could have a look there.
Do you have any interest in data analytics? I proposed a couple of
ideas in that field.If you are interested, we could talk over them.
Regards,
Atri
--
Regards,
Atri
l'apprenant
--
Sent via pgsql-students mailing list (pgsql-students@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-students
^ permalink raw reply [nested|flat] 19+ messages in thread
* Re: Google Summer of code 2013
2013-04-15 15:08 Google Summer of code 2013 Akansha Singh <akansha.singh@oracle.com>
2013-04-15 15:12 ` Re: Google Summer of code 2013 Atri Sharma <atri.jiit@gmail.com>
@ 2013-04-15 15:42 ` viod <viod.len@gmail.com>
2013-04-15 15:46 ` Re: Google Summer of code 2013 Atri Sharma <atri.jiit@gmail.com>
0 siblings, 1 reply; 19+ messages in thread
From: viod @ 2013-04-15 15:42 UTC (permalink / raw)
To: Atri Sharma <atri.jiit@gmail.com>; +Cc: Akansha Singh <akansha.singh@oracle.com>; Stephen Frost <sfrost@snowman.net>; karel.rozhon@gmail.com; pgsql-students
Hello all!
> Do you have any interest in data analytics? I proposed a couple of
> ideas in that field.If you are interested, we could talk over them.
>
> Regards,
>
> Atri
I am pretty much interested in the ideas you posted on the mailing list
(particularly in implementing the K-medoids algorithm). I've asked MADlib
if they could mentor me, but unfortunately their org has not been accepted
in GSoC, and they haven't answered since then.
Do you think I could still do it with PostgreSQL? I would really like to do
this project, as an initiation to classification algorithms.
Still, I don't really understand how this would be used by PostgreSQL?
And don't hesitate if you want me to present myself further :)
Regards,
Maxence
^ permalink raw reply [nested|flat] 19+ messages in thread
* Re: Google Summer of code 2013
2013-04-15 15:08 Google Summer of code 2013 Akansha Singh <akansha.singh@oracle.com>
2013-04-15 15:12 ` Re: Google Summer of code 2013 Atri Sharma <atri.jiit@gmail.com>
2013-04-15 15:42 ` Re: Google Summer of code 2013 viod <viod.len@gmail.com>
@ 2013-04-15 15:46 ` Atri Sharma <atri.jiit@gmail.com>
2013-04-15 16:45 ` Re: Google Summer of code 2013 viod <viod.len@gmail.com>
0 siblings, 1 reply; 19+ messages in thread
From: Atri Sharma @ 2013-04-15 15:46 UTC (permalink / raw)
To: viod <viod.len@gmail.com>; +Cc: Akansha Singh <akansha.singh@oracle.com>; Stephen Frost <sfrost@snowman.net>; pgsql-students
On Mon, Apr 15, 2013 at 9:12 PM, viod <viod.len@gmail.com> wrote:
> Hello all!
>
>
>>
>> Do you have any interest in data analytics? I proposed a couple of
>> ideas in that field.If you are interested, we could talk over them.
>>
>> Regards,
>>
>> Atri
>
>
> I am pretty much interested in the ideas you posted on the mailing list
> (particularly in implementing the K-medoids algorithm). I've asked MADlib if
> they could mentor me, but unfortunately their org has not been accepted in
> GSoC, and they haven't answered since then.
No issues, I can try to help you out.
> Do you think I could still do it with PostgreSQL? I would really like to do
> this project, as an initiation to classification algorithms.
>
> Still, I don't really understand how this would be used by PostgreSQL?
MADLib is the de facto library for in database analytics in PostgreSQL.
Download,install MADLib, run a few programs, and think more about the
implementation and discuss here.
Regards,
Atri
--
Regards,
Atri
l'apprenant
--
Sent via pgsql-students mailing list (pgsql-students@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-students
^ permalink raw reply [nested|flat] 19+ messages in thread
* Re: Google Summer of code 2013
2013-04-15 15:08 Google Summer of code 2013 Akansha Singh <akansha.singh@oracle.com>
2013-04-15 15:12 ` Re: Google Summer of code 2013 Atri Sharma <atri.jiit@gmail.com>
2013-04-15 15:42 ` Re: Google Summer of code 2013 viod <viod.len@gmail.com>
2013-04-15 15:46 ` Re: Google Summer of code 2013 Atri Sharma <atri.jiit@gmail.com>
@ 2013-04-15 16:45 ` viod <viod.len@gmail.com>
0 siblings, 0 replies; 19+ messages in thread
From: viod @ 2013-04-15 16:45 UTC (permalink / raw)
To: Atri Sharma <atri.jiit@gmail.com>; +Cc: pgsql-students
Le 15 avr. 2013 17:46, "Atri Sharma" <atri.jiit@gmail.com> a écrit :
> No issues, I can try to help you out.
That would be nice, thanks a lot!
> > Do you think I could still do it with PostgreSQL? I would really like
to do
> > this project, as an initiation to classification algorithms.
> >
> > Still, I don't really understand how this would be used by PostgreSQL?
>
> MADLib is the de facto library for in database analytics in PostgreSQL.
>
> Download,install MADLib, run a few programs, and think more about the
> implementation and discuss here.
I'll begin doing that this evening, thanks for the advice!
^ permalink raw reply [nested|flat] 19+ messages in thread
* Google Summer of code 2013
@ 2013-04-15 15:16 Akansha Singh <akansha.singh@oracle.com>
2013-04-15 15:24 ` Re: Google Summer of code 2013 Atri Sharma <atri.jiit@gmail.com>
2013-04-16 16:52 ` Re: Google Summer of code 2013 Josh Berkus <josh@agliodbs.com>
0 siblings, 2 replies; 19+ messages in thread
From: Akansha Singh @ 2013-04-15 15:16 UTC (permalink / raw)
To: atri.jiit@gmail.com; +Cc: pgsql-students
> HI all
>
> I am Akansha Singh. I am a Java developer with experience of designing
> databases.i have been an intern in Oracle , i had worked on Oracle database
> I have also did project using JDBC before .I will be highly obliged if some one can
> give ur suggestions for the project idea.
>
> I would be interested to work on PL/Java and JDBC.
>>
>> Please let me know of any project that currently need attention.I would
>> be honored to contribute to the community.
>
> regards
> Akansha Singh
>
>
I think a new JDBC driver is being worked on.You could have a look there.
Do you have any interest in data analytics? I proposed a couple of
ideas in that field.If you are interested, we could talk over them.
Regards,
Atri
If you can brief me about that , i will happy to contribute my skills towards the project.
--
Akansha
--
Sent via pgsql-students mailing list (pgsql-students@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-students
^ permalink raw reply [nested|flat] 19+ messages in thread
* Re: Google Summer of code 2013
2013-04-15 15:16 Google Summer of code 2013 Akansha Singh <akansha.singh@oracle.com>
@ 2013-04-15 15:24 ` Atri Sharma <atri.jiit@gmail.com>
1 sibling, 0 replies; 19+ messages in thread
From: Atri Sharma @ 2013-04-15 15:24 UTC (permalink / raw)
To: Akansha Singh <akansha.singh@oracle.com>; +Cc: pgsql-students
On Mon, Apr 15, 2013 at 8:46 PM, Akansha Singh <akansha.singh@oracle.com> wrote:
>> HI all
>
> If you can brief me about that , i will happy to contribute my skills towards the project.
>
Sure.
Essentially, what I suggested was adding some functionalities to
MADLib.You can have a look at
http://wiki.postgresql.org/wiki/GSoC_2013 under 'Tools' (Extending
MADlib functions to fill in (extrapolate) missing values in data set).
We can discuss it after you get a basic idea.
Regards,
Atri
--
Regards,
Atri
l'apprenant
--
Sent via pgsql-students mailing list (pgsql-students@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-students
^ permalink raw reply [nested|flat] 19+ messages in thread
* Re: Google Summer of code 2013
2013-04-15 15:16 Google Summer of code 2013 Akansha Singh <akansha.singh@oracle.com>
@ 2013-04-16 16:52 ` Josh Berkus <josh@agliodbs.com>
1 sibling, 0 replies; 19+ messages in thread
From: Josh Berkus @ 2013-04-16 16:52 UTC (permalink / raw)
To: pgsql-students
>> I am Akansha Singh. I am a Java developer with experience of designing
>> databases.i have been an intern in Oracle , i had worked on Oracle database
>> I have also did project using JDBC before .I will be highly obliged if some one can
>> give ur suggestions for the project idea.
>>
>> I would be interested to work on PL/Java and JDBC.
Just to make absolutely sure: your internship with Oracle is over,
correct? If you are still an Oracle intern, the terms of that
internship prohibit you participating in GSOC.
Even if your internship is over, you'll need to email me and Thom
*privately* about what specific things you worked on at Oracle as an
intern. You cannot work on anything on Postgres which is closely
related to your internship work at Oracle.
--
Josh Berkus
PostgreSQL Experts Inc.
http://pgexperts.com
--
Sent via pgsql-students mailing list (pgsql-students@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-students
^ permalink raw reply [nested|flat] 19+ messages in thread
* Re: Google Summer of code 2013
@ 2013-04-15 15:51 Akansha Singh <akansha.singh@oracle.com>
2013-04-15 15:52 ` Re: Google Summer of code 2013 Atri Sharma <atri.jiit@gmail.com>
2013-04-15 15:55 ` Re: Google Summer of code 2013 David Fetter <david@fetter.org>
0 siblings, 2 replies; 19+ messages in thread
From: Akansha Singh @ 2013-04-15 15:51 UTC (permalink / raw)
To: atri.jiit@gmail.com; +Cc: viod.len@gmail.com; karel.rozhon@gmail.com; pgsql-students; sfrost@snowman.net
Hi,
Please if someone can extend me the link to the MADLib. I would like to get my hands on it as early as possible.
Thanks
On Mon, Apr 15, 2013 at 9:12 PM, viod <viod.len@gmail.com> wrote:
> Hello all!
>
>
>>
>> Do you have any interest in data analytics? I proposed a couple of
>> ideas in that field.If you are interested, we could talk over them.
>>
>> Regards,
>>
>> Atri
>
>
> I am pretty much interested in the ideas you posted on the mailing list
> (particularly in implementing the K-medoids algorithm). I've asked MADlib if
> they could mentor me, but unfortunately their org has not been accepted in
> GSoC, and they haven't answered since then.
No issues, I can try to help you out.
> Do you think I could still do it with PostgreSQL? I would really like to do
> this project, as an initiation to classification algorithms.
>
> Still, I don't really understand how this would be used by PostgreSQL?
MADLib is the de facto library for in database analytics in PostgreSQL.
Download,install MADLib, run a few programs, and think more about the
implementation and discuss here.
Regards,
Atri
--
Regards,
Atri
l'apprenant
--
Sent via pgsql-students mailing list (pgsql-students@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-students
--
Sent via pgsql-students mailing list (pgsql-students@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-students
^ permalink raw reply [nested|flat] 19+ messages in thread
* Re: Google Summer of code 2013
2013-04-15 15:51 Re: Google Summer of code 2013 Akansha Singh <akansha.singh@oracle.com>
@ 2013-04-15 15:52 ` Atri Sharma <atri.jiit@gmail.com>
1 sibling, 0 replies; 19+ messages in thread
From: Atri Sharma @ 2013-04-15 15:52 UTC (permalink / raw)
To: Akansha Singh <akansha.singh@oracle.com>; +Cc: Viod Len <viod.len@gmail.com>; pgsql-students; Stephen Frost <sfrost@snowman.net>
On Mon, Apr 15, 2013 at 9:21 PM, Akansha Singh <akansha.singh@oracle.com> wrote:
> Hi,
> Please if someone can extend me the link to the MADLib. I would like to get my hands on it as early as possible.
>
http://madlib.net/
--
Sent via pgsql-students mailing list (pgsql-students@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-students
^ permalink raw reply [nested|flat] 19+ messages in thread
* Re: Google Summer of code 2013
2013-04-15 15:51 Re: Google Summer of code 2013 Akansha Singh <akansha.singh@oracle.com>
@ 2013-04-15 15:55 ` David Fetter <david@fetter.org>
1 sibling, 0 replies; 19+ messages in thread
From: David Fetter @ 2013-04-15 15:55 UTC (permalink / raw)
To: Akansha Singh <akansha.singh@oracle.com>; +Cc: atri.jiit@gmail.com; viod.len@gmail.com; karel.rozhon@gmail.com; pgsql-students; sfrost@snowman.net
Are you sure that it's OK for you to work at Oracle and on this
project at the same time?
For me, plugging the word madlib into a random selection of search
engines got this in the top 3 <http://madlib.net/; each time. What
was it when you searched?
Cheers,
David.
On Mon, Apr 15, 2013 at 08:51:35AM -0700, Akansha Singh wrote:
> Hi,
> Please if someone can extend me the link to the MADLib. I would like to get my hands on it as early as possible.
>
> Thanks
>
> On Mon, Apr 15, 2013 at 9:12 PM, viod <viod.len@gmail.com> wrote:
> > Hello all!
> >
> >
> >>
> >> Do you have any interest in data analytics? I proposed a couple of
> >> ideas in that field.If you are interested, we could talk over them.
> >>
> >> Regards,
> >>
> >> Atri
> >
> >
> > I am pretty much interested in the ideas you posted on the mailing list
> > (particularly in implementing the K-medoids algorithm). I've asked MADlib if
> > they could mentor me, but unfortunately their org has not been accepted in
> > GSoC, and they haven't answered since then.
>
> No issues, I can try to help you out.
>
> > Do you think I could still do it with PostgreSQL? I would really like to do
> > this project, as an initiation to classification algorithms.
> >
> > Still, I don't really understand how this would be used by PostgreSQL?
>
> MADLib is the de facto library for in database analytics in PostgreSQL.
>
> Download,install MADLib, run a few programs, and think more about the
> implementation and discuss here.
>
> Regards,
>
> Atri
>
>
>
> --
> Regards,
>
> Atri
> l'apprenant
>
>
> --
> Sent via pgsql-students mailing list (pgsql-students@postgresql.org)
> To make changes to your subscription:
> http://www.postgresql.org/mailpref/pgsql-students
>
>
> --
> Sent via pgsql-students mailing list (pgsql-students@postgresql.org)
> To make changes to your subscription:
> http://www.postgresql.org/mailpref/pgsql-students
--
David Fetter <david@fetter.org> http://fetter.org/
Phone: +1 415 235 3778 AIM: dfetter666 Yahoo!: dfetter
Skype: davidfetter XMPP: david.fetter@gmail.com
iCal: webcal://www.tripit.com/feed/ical/people/david74/tripit.ics
Remember to vote!
Consider donating to Postgres: http://www.postgresql.org/about/donate
--
Sent via pgsql-students mailing list (pgsql-students@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-students
^ permalink raw reply [nested|flat] 19+ messages in thread
end of thread, other threads:[~2013-04-16 16:52 UTC | newest]
Thread overview: 19+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2013-04-12 07:02 Google Summer of Code 2013 Karel K. Rozhoň <karel.rozhon@gmail.com>
2013-04-13 16:39 Google Summer of code 2013 Karel K. Rozhoň <karel.rozhon@gmail.com>
2013-04-14 22:16 ` Re: Google Summer of code 2013 Stephen Frost <sfrost@snowman.net>
2013-04-15 01:37 ` Re: Google Summer of code 2013 Tomas Vondra <tv@fuzzy.cz>
2013-04-15 01:54 ` Re: Google Summer of code 2013 Stephen Frost <sfrost@snowman.net>
2013-04-15 15:51 ` Re: Google Summer of code 2013 Karel K. Rozhoň <karel.rozhon@gmail.com>
2013-04-15 16:27 ` Re: Google Summer of code 2013 Stephen Frost <sfrost@snowman.net>
2013-04-15 14:56 Google Summer of code 2013 Akansha Singh <akansha.singh@oracle.com>
2013-04-15 15:08 Google Summer of code 2013 Akansha Singh <akansha.singh@oracle.com>
2013-04-15 15:12 ` Re: Google Summer of code 2013 Atri Sharma <atri.jiit@gmail.com>
2013-04-15 15:42 ` Re: Google Summer of code 2013 viod <viod.len@gmail.com>
2013-04-15 15:46 ` Re: Google Summer of code 2013 Atri Sharma <atri.jiit@gmail.com>
2013-04-15 16:45 ` Re: Google Summer of code 2013 viod <viod.len@gmail.com>
2013-04-15 15:16 Google Summer of code 2013 Akansha Singh <akansha.singh@oracle.com>
2013-04-15 15:24 ` Re: Google Summer of code 2013 Atri Sharma <atri.jiit@gmail.com>
2013-04-16 16:52 ` Re: Google Summer of code 2013 Josh Berkus <josh@agliodbs.com>
2013-04-15 15:51 Re: Google Summer of code 2013 Akansha Singh <akansha.singh@oracle.com>
2013-04-15 15:52 ` Re: Google Summer of code 2013 Atri Sharma <atri.jiit@gmail.com>
2013-04-15 15:55 ` Re: Google Summer of code 2013 David Fetter <david@fetter.org>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox