"union all" query consumes all memory

From: Pavel Stehule <pavel(dot)stehule(at)gmail(dot)com>
To: PostgreSQL Hackers <pgsql-hackers(at)postgresql(dot)org>
Subject: "union all" query consumes all memory
Date: 2013-11-14 21:43:54
Message-ID: CAFj8pRDsvwsg4DZRAvE=5jouBoF11q5vU1OW9dSFxh1AVgpq6Q@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Hello,

one my customer reported a "out of memory" issue. After investigation he
found a main problem in large query that uses a lot of union all queries.
He wrote a self test:

do $$

declare i integer; str text='';

begin

for i in 1..1000 loop

str := str || 'union all select i,i,i from generate_series(1,50000) g(i) ';

end loop;

execute 'select 1,2,3 ' || str;

end;
$$

is it expected behave?

Tested on PostgreSQL 9.1, 9.2, 9.3

It looks so all generated data are saved in memory only.

Regards

Pavel Stehule

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Tom Lane 2013-11-14 22:40:43 Re: "union all" query consumes all memory
Previous Message Christopher Browne 2013-11-14 21:35:57 Re: Extra functionality to createuser