«

I have an interest in distributed computing and so-called grid
computing. Has anyone here done, or know of, any grid processing with Ruby?

Alexander.

"Alexander Staubo" <> wrote:
>I have an interest in distributed computing and so-called grid computing.
>Has anyone here done, or know of, any grid processing with Ruby?

There is rq (ruby queue) by Ara. T. Howard:

http://raa.ruby-lang.org/project/rq/

rq is a tool used to build instant linux clusters
ruby queue (rq) is a tool used to create instant linux clusters by managing
sqlite databases as nfs mounted priority work queues. multiple instances of
rq running from multiples hosts can work from these queues to distribute
processing load to n nodes - bringing many dozens of otherwise powerful cpus
to their knees with a single blow. clearly this software should be kept out
of the hands of free radicals, seti enthusiasts, and j. safran.

the central concept of rq is that n nodes work in isolation to pull jobs
from an central nfs mounted priority work queue in a synchronized fashion.
the nodes have absolutely no knowledge of each other and all communication
if done via the queue meaning that, so long as the queue is available via
nfs and a single node is running jobs from it, the system will continue to
process jobs. there is no centralized process whatsoever - all nodes work to
take jobs from the queue and run them as fast as possible. this creates a
system which load balances automatically and is robust in face of node
failures.

Interesting. Unfortunately, the dependency on a central NFS mount rules
out rq for my purposes.

Alexander.

Dave Burt wrote:
> "Alexander Staubo" <> wrote:
>
>>I have an interest in distributed computing and so-called grid computing.
>>Has anyone here done, or know of, any grid processing with Ruby?
>
>
> There is rq (ruby queue) by Ara. T. Howard:
>
> http://raa.ruby-lang.org/project/rq/
>
> rq is a tool used to build instant linux clusters
> ruby queue (rq) is a tool used to create instant linux clusters by managing
> sqlite databases as nfs mounted priority work queues. multiple instances of
> rq running from multiples hosts can work from these queues to distribute
> processing load to n nodes - bringing many dozens of otherwise powerful cpus
> to their knees with a single blow. clearly this software should be kept out
> of the hands of free radicals, seti enthusiasts, and j. safran.
>
> the central concept of rq is that n nodes work in isolation to pull jobs
> from an central nfs mounted priority work queue in a synchronized fashion.
> the nodes have absolutely no knowledge of each other and all communication
> if done via the queue meaning that, so long as the queue is available via
> nfs and a single node is running jobs from it, the system will continue to
> process jobs. there is no centralized process whatsoever - all nodes work to
> take jobs from the queue and run them as fast as possible. this creates a
> system which load balances automatically and is robust in face of node
> failures.
>
>
>
>
>

On Tue, 8 Feb 2005 09:18:55 +0900
Alexander Staubo <> wrote:

> I have an interest in distributed computing and so-called grid
> computing. Has anyone here done, or know of, any grid processing with Ruby?
>
> Alexander.
>

Maybe it's not what you meant, but there is a MPI-API in Ruby.
You can find it under http://www-unix.mcs.anl.gov/mpi/mpi_ruby/.

regards
ralf

In article <>,
Alexander Staubo <> wrote:
>Interesting. Unfortunately, the dependency on a central NFS mount rules
>out rq for my purposes.
>


There's also TaskMaster (I think it's still on the RAA), but I haven't
updated it in ages. I was going to try to take it in a more P2P
direction.

TaskMaster distributes task objects via drb. As long as you define a
'run' method on your class it can be distributed.

I would tend to think that TaskMaster doesn't work with 1.8.x, but you
could probably get it running without too many changes... Also, there was
a Dr. Dobb's article on it 2 or 3 years ago. If you're interested I can
try to dig up the links.



Phil

* Ralf Müller <> [2005-02-08 17:08:56 +0900]:

> Maybe it's not what you meant, but there is a MPI-API in Ruby.
> You can find it under http://www-unix.mcs.anl.gov/mpi/mpi_ruby/.

Hmm, there is MPIRuby that was presented at the very first
Ruby conference by Emil Ong.
I found it in the RAA:
http://raa.ruby-lang.org/search.rhtml?search=mpiruby

Is this what you are looking for?
--
Jim Freeze
Code Red. Code Ruby

On Tue, 8 Feb 2005 23:26:41 +0900
wrote:

> * Ralf Müller <> [2005-02-08 17:08:56 +0900]:
>
> > Maybe it's not what you meant, but there is a MPI-API in Ruby.
> > You can find it under http://www-unix.mcs.anl.gov/mpi/mpi_ruby/.
>
> Hmm, there is MPIRuby that was presented at the very first
> Ruby conference by Emil Ong.
> I found it in the RAA:
> http://raa.ruby-lang.org/search.rhtml?search=mpiruby
>
> Is this what you are looking for?
> --
> Jim Freeze
> Code Red. Code Ruby
>
I read about Emil's mpiruby in a book from 2002, found the given url still active and nothing under rubyforge. i posted the url for Alex.
Didn't search raa

but the homepage (http://mpiruby.sourceforge.net) of the raa-project seems to be almost a copy of http://www-unix.mcs.anl.gov/mpi/mpi_ruby.

> but the homepage (http://mpiruby.sourceforge.net) of the raa-project seems to be almost a copy of http://www-unix.mcs.anl.gov/mpi/mpi_ruby.

an updated copy it appears.

Cameron

Ralf Müller wrote:
> Maybe it's not what you meant, but there is a MPI-API in Ruby.
> You can find it under http://www-unix.mcs.anl.gov/mpi/mpi_ruby/.

I'm not familiar enough with MPI to say whether it suits my purpose;
however, I do know it's only useful insofar as there are free
P2P/socket-based implementations available. I'll take a look.

Alexander.

-----BEGIN PGP SIGNED MESSAGE-----

In article <>,
Alexander Staubo <> wrote:
>I have an interest in distributed computing and so-called grid
>computing. Has anyone here done, or know of, any grid processing with Ruby?
>

_ If by "grid" you mean Globus, then I don't think there are any
Ruby interfaces. However, since Globus toolkit 4 is pretty much
just web services with some state, grid computing is getting
much closer to Ruby every day.

_ Most GT4 stuff is being implemented in Java.

_ Booker C. Bense


-----BEGIN PGP SIGNATURE-----
Version: 2.6.2

iQCVAwUBQgk9amTWTAjn5N/lAQEtwQP/W52aKGL/I5u5SEG/pv8Lp2XOYt2vAura
ryXg+FbFGwd7aqxDRyhWYEn/7jfTfDLPok6RykA6dsePVp7OZifvp/IT5IQKZbMu
lx+ZAgEsuw7V4QUvDldC8V2+sM5+VnMPHzLaptD16SwRPNSqoP BwSgt2SJzjuw/o
1drRnNQZjG4=
=12Tv
-----END PGP SIGNATURE-----