Velocity Reviews - Computer Hardware Reviews

Velocity Reviews > Newsgroups > Programming > Perl > Perl Misc > Leak in Win32::ChangeNotify?

Reply
Thread Tools

Leak in Win32::ChangeNotify?

 
 
Thomas Kratz
Guest
Posts: n/a
 
      12-28-2004
The code below is a simple example of using Win32::ChangeNotify. AFAIK
this is how it should be used according to the docs.
If you run this you will see a steady increase in the used nonpage pool
memory of the perl process in the Win32 performance monitor (Category
'Process', counter 'Pool Nonpaged Bytes'). Changing the file will result
in the notification message printed to screen as well as in more memory
leaking. After the second change it will go berserk and if you don't
terminate the process quickly it will eat up all the systems nonpaged pool
memory and thus cause serious trouble elsewhere in the system.

Moving the object creation into the while loop and deleting the line with
'$notify->reset()' works around the problem.

Can somebody confirm this? If yes I will file a bug report on rt.cpan.org.

Tested with perl 5.8.4 (custom build) and libwin 0.19.1
(Win32::ChangeNotify 1.02) under WinXP and Win2003 Server.

Thomas

=== code start ===
use strict;
use warnings;

$| = 1;

use File::Spec::Functions qw/catfile/;
use Win32::ChangeNotify;

my $dir = 'd:/tmp/perl/chng';
my $notify_fn = catfile($dir, 'bla.txt');

my $last = 0;
my $notify = Win32::ChangeNotify->new($dir, 0, 'LAST_WRITE');
die 'cannot create notify object'
unless ref($notify) eq 'Win32::ChangeNotify';

while ( 1 ) {

my $rc = $notify->wait(100);
$notify->reset();

last if $rc == -1;

my @stat = stat($notify_fn);

if ( $rc == 1 and $stat[9] > $last ) {

print "$notify_fn has changed\n";

$last = $stat[9];
}
}
=== code end ===

--
$/=$,,$_=<DATA>,s,(.*),$1,see;__END__
s,^(.*\043),,mg,@_=map{[split'']}split;{#>J~.>_an~>>e~......>r~
$_=$_[$%][$"];y,<~>^,-++-,?{$/=--$|?'"':#..u.t.^.o.P.r.>ha~.e..
'%',s,(.),\$$/$1=1,,$;=$_}:/\w/?{y,_, ,,#..>s^~ht<._..._..c....
print}:y,.,,||last,,,,,,$_=$;;eval,redo}#.....>.e. r^.>l^..>k^.-
 
Reply With Quote
 
 
 
 
Matt Garrish
Guest
Posts: n/a
 
      12-29-2004

"Thomas Kratz" <(E-Mail Removed)> wrote in message
news:41d170e7$0$776$(E-Mail Removed)-rheiner.de...
> The code below is a simple example of using Win32::ChangeNotify. AFAIK
> this is how it should be used according to the docs.
> If you run this you will see a steady increase in the used nonpage pool
> memory of the perl process in the Win32 performance monitor (Category
> 'Process', counter 'Pool Nonpaged Bytes'). Changing the file will result
> in the notification message printed to screen as well as in more memory
> leaking. After the second change it will go berserk and if you don't
> terminate the process quickly it will eat up all the systems nonpaged pool
> memory and thus cause serious trouble elsewhere in the system.
>
> Moving the object creation into the while loop and deleting the line with
> '$notify->reset()' works around the problem.
>
> Can somebody confirm this? If yes I will file a bug report on rt.cpan.org.
>


Strange. The first time I ran the script the nonpaged memory slowly grew
(nothing like what you describe, though). I let it run up from ~10100K to
~11500K before killing script (at which point it dropped right back to where
it started), but on subsequent restarts could not get the script to leak
again (it stayed steady at ~10100 no matter what I did to the file).

This was on XP Pro using v5.8.2.

Matt


 
Reply With Quote
 
 
 
 
Thomas Kratz
Guest
Posts: n/a
 
      12-29-2004
Matt Garrish wrote:
>
> Strange. The first time I ran the script the nonpaged memory slowly grew
> (nothing like what you describe, though). I let it run up from ~10100K to
> ~11500K before killing script (at which point it dropped right back to where
> it started), but on subsequent restarts could not get the script to leak
> again (it stayed steady at ~10100 no matter what I did to the file).
>
> This was on XP Pro using v5.8.2.


Do you really mean 10100KB. The value should be about 1-2K. 10MB of
nonpaged memory is way too much.

I get the same results as yesterday on various machines. The strange thing
is, that after the second modification of the file it will take some time
before the nonepaged pool usage freaks out.
I think I will have a look into the xs code of Win32::ChangeNotify and
Win32::IPC on the weekend. Perhaps I'll get an idea, what could go wrong here.

Always creating a new object works fine as a workaround, so there is no
urgent need for a fix.

Thomas

--
$/=$,,$_=<DATA>,s,(.*),$1,see;__END__
s,^(.*\043),,mg,@_=map{[split'']}split;{#>J~.>_an~>>e~......>r~
$_=$_[$%][$"];y,<~>^,-++-,?{$/=--$|?'"':#..u.t.^.o.P.r.>ha~.e..
'%',s,(.),\$$/$1=1,,$;=$_}:/\w/?{y,_, ,,#..>s^~ht<._..._..c....
print}:y,.,,||last,,,,,,$_=$;;eval,redo}#.....>.e. r^.>l^..>k^.-
 
Reply With Quote
 
Thomas Kratz
Guest
Posts: n/a
 
      12-29-2004
Thomas Kratz wrote:

> === code start ===
> use strict;
> use warnings;
>
> $| = 1;
>
> use File::Spec::Functions qw/catfile/;
> use Win32::ChangeNotify;
>
> my $dir = 'd:/tmp/perl/chng';
> my $notify_fn = catfile($dir, 'bla.txt');
>
> my $last = 0;
> my $notify = Win32::ChangeNotify->new($dir, 0, 'LAST_WRITE');
> die 'cannot create notify object'
> unless ref($notify) eq 'Win32::ChangeNotify';
>
> while ( 1 ) {
>
> my $rc = $notify->wait(100);
> $notify->reset();
>
> last if $rc == -1;
>
> my @stat = stat($notify_fn);
>
> if ( $rc == 1 and $stat[9] > $last ) {
>
> print "$notify_fn has changed\n";
>
> $last = $stat[9];
> }
> }
> === code end ===


The problem was calling reset on the object even if there was no signalled
change event. Moving the "$notify->reset();" to the end of the "if ( $rc
== 1..." block, ended the leaking.

After looking at the XS code, it was clear that I used the module the
wrong way. Each call to reset() causes a Win32 API call to
FindNextChangeNotification and that only makes sense if the last Find was
successful.

So: no bug, wrong usage!

Thomas

--
$/=$,,$_=<DATA>,s,(.*),$1,see;__END__
s,^(.*\043),,mg,@_=map{[split'']}split;{#>J~.>_an~>>e~......>r~
$_=$_[$%][$"];y,<~>^,-++-,?{$/=--$|?'"':#..u.t.^.o.P.r.>ha~.e..
'%',s,(.),\$$/$1=1,,$;=$_}:/\w/?{y,_, ,,#..>s^~ht<._..._..c....
print}:y,.,,||last,,,,,,$_=$;;eval,redo}#.....>.e. r^.>l^..>k^.-
 
Reply With Quote
 
Matt Garrish
Guest
Posts: n/a
 
      12-29-2004

"Thomas Kratz" <(E-Mail Removed)> wrote in message
news:41d283b9$0$782$(E-Mail Removed)-rheiner.de...
> Matt Garrish wrote:
>>
>> Strange. The first time I ran the script the nonpaged memory slowly grew
>> (nothing like what you describe, though). I let it run up from ~10100K to
>> ~11500K before killing script (at which point it dropped right back to
>> where it started), but on subsequent restarts could not get the script to
>> leak again (it stayed steady at ~10100 no matter what I did to the file).
>>
>> This was on XP Pro using v5.8.2.

>
> Do you really mean 10100KB. The value should be about 1-2K. 10MB of
> nonpaged memory is way too much.
>


Yup, but I believe we were looking at different things. I was watching the
nonpaged kernel memory in the task manager under the Performance tab. It
generally sits around 10100 - 10300 when the machine is idle.

Matt


 
Reply With Quote
 
 
 
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Leak or no leak ?? Richard Heathfield C Programming 4 07-10-2006 11:37 AM
Firefox memory leak ttfg Firefox 4 03-18-2005 06:32 PM
Firefox Memory Leak? Scott Moseman Firefox 2 02-09-2005 03:52 PM
Wireless Zero Configuration Memory Leak?? =?Utf-8?B?Umlja3NjaHVsdHox?= Wireless Networking 3 01-19-2005 11:26 PM
datagrid memory leak? =?Utf-8?B?Y3liZXJzdHJpa2U=?= ASP .Net 0 01-03-2005 10:17 PM



Advertisments