Velocity Reviews - Computer Hardware Reviews

Velocity Reviews > Newsgroups > Programming > ASP .Net > Best practice for translating web page character data so that page will be scrapable/e-mailable

Thread Tools

Best practice for translating web page character data so that page will be scrapable/e-mailable

Posts: n/a
I have web pages that I periodically want to a) programmatically "scrape",
and b) programmatically send in e-mail. These web pages are built via
content management systems and occassionally have Word "curly quotation
marks" and other weird entities embedded in them.

If you fail to translate characters properly, you have the familiar problem
of some characters turning into question marks when sent in e-mail and/or
scraped. You will see this problem all of the time on web-based newsletters
and the like.

When I was working in classic ASP, I wrote "translate" functions that would
render weird characters into their safe equivalents using a simple string
"replace". This was a limited solution because it was premised on my ability
to identify all of the problematic characters myself and translate them.

I am wondering if there is an all-in-one solution to this problem inside or
outside of the .NET framework. I have read a bit about the character
encoding classes and I'm hoping that one of them represent a complete
solution to my problem.

Can anyone offer any guidance?


Reply With Quote

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are Off

Similar Threads
Thread Thread Starter Forum Replies Last Post
problem in running a basic code in python 3.3.0 that includes HTML file Satabdi Mukherjee Python 1 04-04-2013 07:48 PM
Translating unicode data CaptainMcCrank Python 3 03-25-2009 02:14 AM
hidden data - best practice, best way, suggestions oldyork90 Javascript 1 09-10-2008 07:46 PM
Looking for best practice advice on data access for SMALL web sites - not enterprise Alan Silver ASP .Net 13 06-29-2006 08:14 AM
Remember when your piano teacher taught you, "Practice, practice,practice ...?" Wayne Wastier Windows 64bit 3 06-10-2005 08:29 PM