Mesos slave not 'Running' multiple executors simultaneously

Posted by user3084164 on Stack Overflow See other posts from Stack Overflow or by user3084164
Published on 2014-08-21T21:12:50Z Indexed on 2014/08/23 4:20 UTC
Read the original article Hit count: 130

Filed under:

distributed-computing

|

executor

|

mesos

I am using Mesos to distribute a bunch of tasks to different machines (mesos-slaves). Here is what happens: 1. My scheduler gets resource offers and accepts it. 2. Mesos stages multiple executors on the same mesos-slaves (each slave has 4 cpus) 3. Only ONE executor enters the 'Running' state on each of the slaves while the others are shown in 'Staging' state. 4. Only after the current executor finishes execution the other executor starts running.

Given that I have 4 CPUs on each machine, shouldn't each slave be running 4 executors simultaneously? Each executor requires 1 CPU.

© Stack Overflow or respective owner

Related posts about distributed-computing

Distributed Computing Framework (.NET) - Specifically for CPU Instensive operations

as seen on Stack Overflow - Search for 'Stack Overflow'
I am currently researching the options that are available (both Open Source and Commercial) for developing a distributed application. "A distributed system consists of multiple autonomous computers that communicate through a computer network." Wikipedia The application is focused on distributing… >>> More
Where do I start with distributed computing?

as seen on Stack Overflow - Search for 'Stack Overflow'
I'm interested in learning techniques for distributed computing. As a Java developer, I'm probably willing to start with Hadoop. Could you please recommend some books/tutorials/articles to begin with? >>> More
running a python script where dependencies are not avail: distributed computing

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, I have access to a grid (running condor) that would (potentially) allow to very substantially reduce how long by nltk based nlp tasks take. unfortunately, i dont have root access on the cluster so cannot install new packages, only run whatever is available on the linux boxes. python is of course… >>> More
Java - System design with distributed Queues and Locks

as seen on Programmers - Search for 'Programmers'
Looking for inputs to evaluate a design for a system (java) which would have a distributed queue serving several (but not too many) nodes. These nodes would process objects present in the distributed queue and on occasion require a distributed lock across the cluster on an arbitrary (distributed)… >>> More
Can an issue tracking system be distributed?

as seen on Programmers - Search for 'Programmers'
I was thinking about issue tracking software like Redmine, Trac or even the one that is in Fossil and something hit me: Is there a reason why Redmine and Trac are not possible to be distributed? Or maybe it's possible and I just don't know how it's possible? If it's not possible, why? By distributed… >>> More

Related posts about executor

Java Executor: Small tasks or big ones?

as seen on Stack Overflow - Search for 'Stack Overflow'
Consider one big task which could be broken into hundreds of small, independently-runnable tasks. To be more specific, each small task is to send a light network request and decide upon the answer received from the server. These small tasks are not expected to take longer than a second, and involve… >>> More
Groovy & Grails Concurrency ( quartz, executor )

as seen on Stack Overflow - Search for 'Stack Overflow'
What I'm trying to do is to run multiple threads at some starting time. Those threads must stay alive for 90minutes after start. During the 90minutes they execute something after a random sleep time (ex: 5minutes to 15minutes). Here is a pseudo code on how I would implement it. The problem is that… >>> More
Using Java Executor on AppEngine causes AccessControlException

as seen on Stack Overflow - Search for 'Stack Overflow'
How do you get java.util.concurrent.Executor or CompletionService to work on Google AppEngine? The classes are all officially white-listed, but I get a runtime security error when trying to submit asynchronous tasks. Code: // uses the async API but this factory makes it so that tasks really … >>> More
Configuration problem: Cannot locate BeanDefinitionParser for element [executor]

as seen on Stack Overflow - Search for 'Stack Overflow'
I m new to spring and m just trying on my hands using spring MVC 2.0 and spring webflow 1.0. but i m getting following error might be when dispatcher deligate request to flow... Configuration problem: Cannot locate BeanDefinitionParser for element [executor] i have spring 2.0 jar file and webflow… >>> More
difference between thread.start() and executor.submit(thread)

as seen on Stack Overflow - Search for 'Stack Overflow'
hi, i am facing a problem regarding the thread. I am having a class which implements runnable, and i can use thread.start() method on that class. My question is i have one more class java.util.concurrent.ExecutorService in which i can call executor.submit(thread).. can anyone please tell me what… >>> More