vendredi 20 février 2015

Execute "jobs" on multiple PCs with server/client in java



I heared of Java ExecutionService today, but I do not know, if it fits my needs ;) I have a class, which has all the information for a "job".


Jobs are added on the go, so there might be a time, where there are 50 jobs, sometimes there won't be jobs there. I want to be ready for 1000 jobs, but a PC won't be able to handle more then 50, I guess even lower...


So if I get 1000 Jobs/interval and 1 PC can handle 50, I want 20 executors on different machines.


So an easy to use framework, where "a free executor" is taken by the server would be nice...


From the idea like youtube, but with no "specialisation" (so only one video format):


100 servers behind a load balancer taking the uploads and 20 to form a "pool" with videos needing to be converted. And 500-2000 "clients" which do the actual conversion... (Do not take the numbers seriously)


I hope I won't need more then 1 server, but for learning purpose I want it to be scaleable...


I tried to find an answer, I thought Hazelcast Queues would fit, but in fact I have no idea....


Please help :)


Florian Reisinger




Aucun commentaire:

Enregistrer un commentaire