Java ExecutorService java heap space ptoblems
Posted
by
Sergey Aganezov jr
on Stack Overflow
See other posts from Stack Overflow
or by Sergey Aganezov jr
Published on 2012-04-08T05:16:07Z
Indexed on
2012/04/08
5:28 UTC
Read the original article
Hit count: 495
I have a little bit of a problem in a multitasking java department. I have a class, called
public class ThreadWorker implements Runnable {
//some code in here
public void run(){
// invokes some recursion method in the ThreadWorker itself,
// which will stop eventually
{
}
all in all, pretty simple "worker" that can work on it's on.
To work with threads I'm using
public static int THREAD_NUMBER = 4;
public static ExecutorServide es = Executors.newFixedThreadPool(THREAD_NUMBER);
adding instances of ThreadWroker
class happens here:
public void recursiveMethod(Arraylist<Integers> elements, MyClass data){
if (elements.size() == 0 && data.qualifies()){
ThreadWorker tw = new ThreadWorker(data);
es.execute(tw);
return;
}
for (int i=0; i< elements.size(); i++){
// some code to prevent my problem
MyClass data1 = new MyClass(data);
MyClass data2 = new MyClass(data);
ArrayList<Integer> newElements = (ArrayList<Integer>)elements.clone();
data1.update(elements.get(i));
data2.update(-1 * elements.get(i));
newElements.remove(i);
recursiveMethod(newElements, data1);
recursiveMethod(newElements, data2);
{
}
and the problem is that the depth of the recursion tree is quite big, so as it's width, so a lot of ThreadWorkers
are added to the ExecutorService
, so after some time on the big input a get
Exception in thread "pool-1-thread-2" java.lang.OutOfMemoryError: Java heap space
which is caused, as I think because of a ginormous number of ThreadWorkers
i'm adding to ExecutorSirvice
to be executed, so it runs out of memory. Every ThreadWorker
takes about 40 Mb of RAM for all it needs.
Is there a method to get how many threads (instances of classes implementing runnable interface) have been added to ExecutorService
? So I can add it in the shown above code (int the " // some code to prevent my problem"), as
while ("number of threads in the ExecutorService" > 10){
Thread.sleep(10000);
}
so I won't go to deep or to broad with my recursion and prevent those exception-throwing situations.
Sincerely, Sergey Aganezov jr.
© Stack Overflow or respective owner