Velocity Reviews - Computer Hardware Reviews

Velocity Reviews > Newsgroups > Programming > Python > python simply not scaleable enough for google?

Reply
Thread Tools

python simply not scaleable enough for google?

 
 
Robin Becker
Guest
Posts: n/a
 
      11-23-2009
sturlamolden wrote:
> On 20 Nov, 11:12, Robin Becker <ro...@reportlab.com> wrote:
>
>> Presumably that means they could potentially run in parallel on the 100000 cpu
>> machines of the future.
>>
>> I'm not so clear on whether the threadless tasklets will run on separate cpus.

>
> You can make a user-space scheduler and run a 100000 tasklets on a
> threadpool. But there is a GIL in stackless as well.
>
> Nobody wants 100000 OS threads, not with Python, not with Go, not with
> C.
>
> Also note that Windows has native support for "taskelets", regardless
> of language. They are called "fibers" (as opposed to "threads") and
> are created using the CreateFiber system call. I would not be
> surprised if Unix'es has this as well. We do not need Stackless for
> light-weight threads. We can just take Python's threading modules' C
> code and replace CreateThread with CreateFiber.
>

........

not really sure about all the parallelism that will actually be achievable, but
apparently the goroutines are multiplexed onto native threads by the run time.
Apparently each real thread is run until it blocks and then another goroutine is
allowed to make use of the thread. Apparently the gccgo runtime has 1 goroutine
per thread and is different to the fast compilers.
--
Robin Becker
 
Reply With Quote
 
 
 
 
Robin Becker
Guest
Posts: n/a
 
      11-23-2009
sturlamolden wrote:
> On 20 Nov, 11:12, Robin Becker <ro...@reportlab.com> wrote:
>
>> Presumably that means they could potentially run in parallel on the 100000 cpu
>> machines of the future.
>>
>> I'm not so clear on whether the threadless tasklets will run on separate cpus.

>
> You can make a user-space scheduler and run a 100000 tasklets on a
> threadpool. But there is a GIL in stackless as well.
>
> Nobody wants 100000 OS threads, not with Python, not with Go, not with
> C.
>
> Also note that Windows has native support for "taskelets", regardless
> of language. They are called "fibers" (as opposed to "threads") and
> are created using the CreateFiber system call. I would not be
> surprised if Unix'es has this as well. We do not need Stackless for
> light-weight threads. We can just take Python's threading modules' C
> code and replace CreateThread with CreateFiber.
>

........

not really sure about all the parallelism that will actually be achievable, but
apparently the goroutines are multiplexed onto native threads by the run time.
Apparently each real thread is run until it blocks and then another goroutine is
allowed to make use of the thread. Apparently the gccgo runtime has 1 goroutine
per thread and is different to the fast compilers.
--
Robin Becker

 
Reply With Quote
 
 
 
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Re: python simply not scaleable enough for google? Terry Reedy Python 85 11-21-2009 02:05 AM
"pointing" to functions to execute for scaleable code metaperl Java 4 03-03-2007 06:30 PM
Scaleable naviagtion pane jsqrd ASP .Net 2 03-02-2007 04:48 PM
Scaleable Swing components Jens Piegsa Java 0 12-16-2006 09:22 AM
SVG scaleable? Sascha Kerschhofer XML 6 07-16-2003 01:37 PM



Advertisments
 



1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57