Velocity Reviews > Using eval with substitutions

# Using eval with substitutions

abhishek@ocf.berkeley.edu
Guest
Posts: n/a

 08-31-2006
>>> a,b=3,4
>>> x="a+b"
>>> eval(x)

7
>>> y="x+a"

Now I want to evaluate y by substituting for the evaluated value of x.
eval(y) will try to add "a+b" to 3 and return an error. I could do
this,
>>> eval(y.replace("x",str(eval(x))))

10

but this becomes unwieldy if I have
>>> w="y*b"

and so on, because the replacements have to be done in exactly the
right order. Is there a better way?

Thanks,
Abhishek

Fredrik Lundh
Guest
Posts: n/a

 08-31-2006
http://www.velocityreviews.com/forums/(E-Mail Removed) wrote:

>>>> a,b=3,4
>>>> x="a+b"
>>>> eval(x)

> 7
>>>> y="x+a"

>
> Now I want to evaluate y by substituting for the evaluated value of x.
> eval(y) will try to add "a+b" to 3 and return an error. I could do
> this,
>>>> eval(y.replace("x",str(eval(x))))

> 10
>
> but this becomes unwieldy if I have
>>>> w="y*b"

> and so on, because the replacements have to be done in exactly the
> right order. Is there a better way?

x = "a+b"

do

x = "a+b"
x = eval(x)

or

x = eval("a+b")

(I'm afraid I don't really understand the point of your examples; what
is it you're really trying to do here ?)

</F>

abhishek@ocf.berkeley.edu
Guest
Posts: n/a

 08-31-2006
Fredrik Lundh wrote:
> (I'm afraid I don't really understand the point of your examples; what
> is it you're really trying to do here ?)

A function is passed a bunch of string expressions like,
x = "a+b"
y= "x*a"
z= "x+y"

where a and b are assumed to have been assigned values in the local
namespace. Now I have to evaluate another string such as,
"z+y+x"

So as you say, I could do:
x=eval(x), y=eval(y), z=eval(z) and finally eval("z+y+x") but the
problem is that the initial strings are in no particular order, so I
don't know the sequence in which to perform the first 3 evaluations. I
was wondering if there was a simple way to 'pattern-match' so that the
required substitutions like z->x+y->x+x*a->(a+b)+(a+b)*a could be done
automatically.

I apologise if this is still not quite clear.

Abhishek

Peter Otten
Guest
Posts: n/a

 08-31-2006
(E-Mail Removed) wrote:

> Fredrik Lundh wrote:
>> (I'm afraid I don't really understand the point of your examples; what
>> is it you're really trying to do here ?)

>
> A function is passed a bunch of string expressions like,
> x = "a+b"
> y= "x*a"
> z= "x+y"
>
> where a and b are assumed to have been assigned values in the local
> namespace. Now I have to evaluate another string such as,
> "z+y+x"
>
> So as you say, I could do:
> x=eval(x), y=eval(y), z=eval(z) and finally eval("z+y+x") but the
> problem is that the initial strings are in no particular order, so I
> don't know the sequence in which to perform the first 3 evaluations. I
> was wondering if there was a simple way to 'pattern-match' so that the
> required substitutions like z->x+y->x+x*a->(a+b)+(a+b)*a could be done
> automatically.

class EvalDict(object):
def __init__(self, namespace):
self.namespace = namespace
def __getitem__(self, key):
value = self.namespace[key]
if isinstance(value, str):
self.namespace[key] = value = eval(value, {}, self)
return value

def smart_eval(expr, namespace):
return eval(expr, {}, EvalDict(namespace))

def f():
a = 2
b = 3
x = "a+b"
y = "x*a"
z = "x+y"

return smart_eval("x + y + z", locals())

if __name__ == "__main__":
print f()

Beware of infinite recursion:

# RuntimeError: maximum recursion depth exceeded
smart_eval("a + b", dict(a="b", b="a"))

Peter

Duncan Booth
Guest
Posts: n/a

 08-31-2006
(E-Mail Removed) wrote:

> So as you say, I could do:
> x=eval(x), y=eval(y), z=eval(z) and finally eval("z+y+x") but the
> problem is that the initial strings are in no particular order, so I
> don't know the sequence in which to perform the first 3 evaluations. I
> was wondering if there was a simple way to 'pattern-match' so that the
> required substitutions like z->x+y->x+x*a->(a+b)+(a+b)*a could be done
> automatically.
>

Sounds a bit of an odd thing to do, but:

>>> def evaluate(var, names):

expr = names[var]
names['__builtins__'] = {}
if isinstance(expr, basestring):
del names[var]
code = compile(expr, "<%s>"%var, "eval")
for v in code.co_names:
evaluate(v, names)
names[var] = eval(code, names, names)
del names['__builtins__']
return names[var]

>>> names = { 'a': 3, 'b': 2, 'x': 'a+b', 'y': 'x*a', 'z': 'x+y' }
>>> evaluate('z', names)

20
>>> names

{'a': 3, 'b': 2, 'y': 15, 'x': 5, 'z': 20}
>>>

Anthra Norell
Guest
Posts: n/a

 08-31-2006
Abhishek,

I hesitate to propose this idea, because there's got to be a better (more conventional) way of doing this. Anyway consider
this:

>>> x = "a+b"; y = "x*a; z = "x+y" # Your definitions
>>> import SE
>>> def f (x, y, z):

substitutions = 'z=(%s) | y=(%s) | x=(%s)' % (z, y, x)
print 'substitutions:', substitutions
Formula_Expander = SE.SE (substitutions)
formula = 'x + y + z'
expanded_formula = Formula_Expander (formula)
print 'expanded_formula:', expanded_formula
a = 3; b = 4
print 'eval (expanded_formula):', eval (expanded_formula)
w = eval (Formula_Expander ('y * b'))
print 'w', w

>>> f (x, y, z)

substitutions: z=(x+y) | y=(x*a) | x=(a+b)
expanded_formula: (a+b) + ((a+b)*a) + ((a+b)+((a+b)*a))
eval (expanded_formula): 56
w 84

Well--- it's kind of neat the way it expands the formula. But why not just write functions? As you say, the expansion has to be done
in exactly the right order to complete.
If you want to run this example you'll find SE here: http://cheeseshop.python.org/pypi/SE/2.2%20beta

Regards

Frederic

----- Original Message -----
From: <(E-Mail Removed)>
Newsgroups: comp.lang.python
To: <(E-Mail Removed)>
Sent: Thursday, August 31, 2006 1:15 PM
Subject: Using eval with substitutions

> >>> a,b=3,4
> >>> x="a+b"
> >>> eval(x)

> 7
> >>> y="x+a"

>
> Now I want to evaluate y by substituting for the evaluated value of x.
> eval(y) will try to add "a+b" to 3 and return an error. I could do
> this,
> >>> eval(y.replace("x",str(eval(x))))

> 10
>
> but this becomes unwieldy if I have
> >>> w="y*b"

> and so on, because the replacements have to be done in exactly the
> right order. Is there a better way?
>
> Thanks,
> Abhishek
>
> --
> http://mail.python.org/mailman/listinfo/python-list

abhishek@ocf.berkeley.edu
Guest
Posts: n/a

 09-02-2006
Thanks very much for all your suggestions - Peter, Duncan and Frederic.
It was a great help.

Incidentally the question arose while I was trying to solve the 2-nots
problem,
http://www.inwap.com/pdp10/hbaker/ha...an.html#item19

Part of my program takes a set of boolean expressions in 3 variables
and keeps concatenating them with 'and' and 'or' until all unique
functions have been found. Sometimes it is good to use substitutions
(though not required) to make the patterns apparent. Anyway, the
listing is here,

http://www.ocf.berkeley.edu/~abhishek/twonot3.py

Abhishek

Carl Banks
Guest
Posts: n/a

 09-02-2006
(E-Mail Removed) wrote:
> >>> a,b=3,4
> >>> x="a+b"
> >>> eval(x)

> 7
> >>> y="x+a"

>
> Now I want to evaluate y by substituting for the evaluated value of x.
> eval(y) will try to add "a+b" to 3 and return an error. I could do
> this,
> >>> eval(y.replace("x",str(eval(x))))

> 10
>
> but this becomes unwieldy if I have
> >>> w="y*b"

> and so on, because the replacements have to be done in exactly the
> right order. Is there a better way?

Careful. Here be dragons.

There are two legitimate uses for eval and exec: A. deliberately giving
the user the power to run arbitrary Python code, and B. evaluating
expressions constructed within the program using only trusted and
carefully verified input. Make sure your use case is one of these.

Anyways, although what you want to do is even more error prone and
dangerous than simple uses of eval, it can be done. The thing to do is
to get your list of active symbol definitions into some kind of dict;
for example:

x = "a+b"
y = "x+b"
exprs = { "x": x, "y": y }

Then, if you want to evaluate y, you recursively expand any variables
you find within it. For example:

def expand_sym(sym):
expr = exprs[sym]
for subsym in exprs:
if subsym in expr:
subexpr = expand_sym(subsym)
expr = expr.replace(subsym,"(%s)" % subexpr)
return expr

Then you can eval the expanded expression:

eval(expand_sym("y"))

However, this is just a big potentially dangerous hack. It's probably
ok for a little calculator you intend only for personal use, but
anything more I highly recommend your script parses the expression and
does symbolic expansion itself, without relying on eval. That,
however, is quite hard.

Carl Banks

Anthra Norell
Guest
Posts: n/a

 09-02-2006

----- Original Message -----
From: "Carl Banks" <(E-Mail Removed)>
Newsgroups: comp.lang.python
To: <(E-Mail Removed)>
Sent: Saturday, September 02, 2006 6:33 AM
Subject: Re: Using eval with substitutions

> (E-Mail Removed) wrote:
> > >>> a,b=3,4
> > >>> x="a+b"

....
> Careful. Here be dragons.

....
> However, this is just a big potentially dangerous hack. It's probably

....

> Carl Banks

-----------------------

Dragons indeed!
To wit, I did get carried away a little with my suggestions and derived a class Formlua_Expander from SE. A few hours later it
worked just beautifully:

>>> FE = FORMEX.Formula_Expander ()
>>> FE.define ('l=102.8')
>>> FE.define ('d=8.5')
>>> FE.define ('pi=3.14159')
>>> FE.define ('r=d/2')
>>> FE.define ('section=r*r*pi')
>>> FE.define ('pipe_volume=l*section')
>>> FE ('pipe_volume')

5833.3828517499996
>>> FE.expand ('pipe_volume')

'((102.*(((8.5)/2)*((8.5)/2)*(3.14159)))'

Data Chain
----------------------------------------------------------------------------------
pipe_volume
0 --------------------------------------------------------------------------------
(l*section)
1 --------------------------------------------------------------------------------
(l*(r*r*pi))
2 --------------------------------------------------------------------------------
(l*((d/2)*(d/2)*pi))
3 --------------------------------------------------------------------------------
((102.*(((8.5)/2)*((8.5)/2)*(3.14159)))
----------------------------------------------------------------------------------

Wonderful! Some more:

>>> FE.define ('m_per_foot=0.3048')
>>> FE.define ('pipe_volume_metric=pipe_volume*m_per_foot')
>>> FE ('pipe_volume_metric')

Traceback (most recent call last):
File "<pyshell#199>", line 1, in -toplevel-
FE ('pipe_volume_metric')
File "c:\i\sony\fre\src\python\FORMEX.py", line 175, in __call__
try: return eval (expression)
File "<string>", line 1
(((102.*(((8.5)/2)*((8.5)/2)*(3.14159)))*m_pe((8.5)/2)_foot(102.e)
^
Oops!

>>> FE.show (1)

....
(1st pass) ...
1: |pipe_volume_metric|->|(pipe_volume*m_per_foot)|
(2nd pass) ...
1: |pipe_volume|->|(l*section)|
(3rd pass) ...
1: |section|->|(r*r*pi)|
(4th pass) ...
1: |r|->|(d/2)|
(5th pass) ...
1: |d|->|(8.5)|
2: |l|->|(102.|
3: |m_per_foot|->|(0.304|
4: |pi|->|(3.14159)|

Data Chain
----------------------------------------------------------------------------------
pipe_volume_metric
0 --------------------------------------------------------------------------------
(pipe_volume*m_per_foot)
1 --------------------------------------------------------------------------------
((l*section)*m_per_foot)
2 --------------------------------------------------------------------------------
((l*(r*r*pi))*m_per_foot)
3 --------------------------------------------------------------------------------
((l*((d/2)*(d/2)*pi))*m_pe(d/2)_foot)
4 --------------------------------------------------------------------------------
(((102.*(((8.5)/2)*((8.5)/2)*(3.14159)))*m_pe((8.5)/2)_foot(102.e)
----------------------------------------------------------------------------------

An unwanted substitution occurs in pass 4 when the 'r' in 'm_per_foot' is replaced
by the substitution meant for 'r' (radius).

Conclusion: Forget it! - Forget this approach anyway. There are probably formula parsers out there that are more intelligent than
this hack.

Frederic

(Learning by making mistakes is faster than by avoiding mistakes and if it's fun on top of it all the better.)