Velocity Reviews - Computer Hardware Reviews

Velocity Reviews > Newsgroups > Programming > Ruby > Using an HTTP proxy to record web traffic

Reply
Thread Tools

Using an HTTP proxy to record web traffic

 
 
Dan Kohn
Guest
Posts: n/a
 
      12-02-2005
As part of debugging WWW::Mechanize, I realized that the best way to
compare what my browser is doing to what mechanize is doing would be to
compare their HTTP transactions incoming and outgoing. What I want is
an HTTP proxy that can record the transactions and also supports SSL.

The Ruby project doesn't have any code
http://rubyforge.org/projects/rpp/

This free program doesn't support SSL, and costs $600.
http://www.proxy-sniffer.com/download.html

This doesn't support SSL but is supposed to soon.
http://kevinlangdon.com/serviceCapture/

Any other suggestions?

 
Reply With Quote
 
 
 
 
why the lucky stiff
Guest
Posts: n/a
 
      12-02-2005
Dan Kohn wrote:

>As part of debugging WWW::Mechanize, I realized that the best way to
>compare what my browser is doing to what mechanize is doing would be to
>compare their HTTP transactions incoming and outgoing. What I want is
>an HTTP proxy that can record the transactions and also supports SSL.
>
>

MouseHole is a scriptable proxy. <http://mousehole.rubyforge.org/>

A script to record traffic would a cinch. Basically,

1. Download MouseHole from the above link. Instructions for running it
are there as well.
2. Add a script named `proxyrecord.user.rb' to your
~/.mouseHole/userScripts/ directory.
Contains:

MouseHole.script do
name "Proxy Record"
namespace "http://yourdomain.com/"
description "Records all traffic, very snoopy."
include_match %r!http://.*!
version "1.0"

rewrite do |req, res|
# store contents of `req' and `res' in the database or a
# log file or something
end
end
3. In your browser, setup MouseHole as your proxy (http://127.0.0.1:37004/)
4. Visit http://127.0.0.1:37004/ and activate the Proxy Record script by
checking its box.

As for SSL, I don't think proxies can actually intercept unencrypted
SSL. It uses the CONNECT method.

_why



 
Reply With Quote
 
 
 
 
Dan Kohn
Guest
Posts: n/a
 
      12-03-2005
Very helpful, why, thanks. I presume I would need to use something
like WATIR to see the unencrypted contents of an SSL connection by
getting it directly from IE.

 
Reply With Quote
 
 
 
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
IllegalArgumentException with Socket API and Proxy with Proxy.Type.HTTP Greg Java 4 08-16-2012 08:26 PM
HTTP traffic over a custom proxy server? Knorpi Java 5 06-28-2011 07:22 AM
Aw: Re: Aw: Re: HTTP traffic over a custom proxy server? Knorpi Java 1 06-26-2011 06:05 PM
Aw: Re: HTTP traffic over a custom proxy server? Knorpi Java 3 06-26-2011 06:04 PM
New Web Proxy List - View Restricted Content with web proxy melati1979@gmail.com Cisco 1 02-25-2009 08:51 PM



Advertisments