Velocity Reviews - Computer Hardware Reviews

Velocity Reviews > Newsgroups > Computer Certification > MCSD > Q: Which one is better for parsing 30MB files ? ATL/COM or VB/COM

Reply
Thread Tools

Q: Which one is better for parsing 30MB files ? ATL/COM or VB/COM

 
 
Ramie
Guest
Posts: n/a
 
      10-30-2003
Hello,

I am working on a B2B web serivce application. I am
Systems Architect for this application. I am in the
process of desigining my components. I would like to know
which one is better over the other for parsing 30MB
files. We would like to use one of the following two
choices: ATL/COM or VB/COM. Can you please share your
thoughts on this ?

Regards,
Ramie
 
Reply With Quote
 
 
 
 
Jay Walters
Guest
Posts: n/a
 
      10-30-2003
Until another response is posted, I would go with VB only
because of future maintainability.

Obviously I don't know your requirements.

Is this file created from the webservice?, and after it's
creation you need to call a component to do something
with it?

Or is the file a feed from a partner that's updated at
different times (outside of the web service)? If so you
might consider using an NT service and filewatcher.


>-----Original Message-----
>Hello,
>
>I am working on a B2B web serivce application. I am
>Systems Architect for this application. I am in the
>process of desigining my components. I would like to

know
>which one is better over the other for parsing 30MB
>files. We would like to use one of the following two
>choices: ATL/COM or VB/COM. Can you please share your
>thoughts on this ?
>
>Regards,
>Ramie
>.
>

 
Reply With Quote
 
 
 
 
Ramie
Guest
Posts: n/a
 
      10-30-2003
Sorry. I did not specify my requirements cleary. Web
Service gets the input file (as big as 30MB) via HTTP
post. The user posts file to an ASP page. Then, the ASP
page will call MTS component, which will parse the file to
extract three piece of info: User Id, Password, and some
text data (called as BLOB). Now, the question is on
choosing the language to develop the MTS component (called
as App Controller), in VB/COM or ATL/COM ?

>-----Original Message-----
>Until another response is posted, I would go with VB only
>because of future maintainability.
>
>Obviously I don't know your requirements.
>
>Is this file created from the webservice?, and after it's
>creation you need to call a component to do something
>with it?
>
>Or is the file a feed from a partner that's updated at
>different times (outside of the web service)? If so you
>might consider using an NT service and filewatcher.
>
>
>>-----Original Message-----
>>Hello,
>>
>>I am working on a B2B web serivce application. I am
>>Systems Architect for this application. I am in the
>>process of desigining my components. I would like to

>know
>>which one is better over the other for parsing 30MB
>>files. We would like to use one of the following two
>>choices: ATL/COM or VB/COM. Can you please share your
>>thoughts on this ?
>>
>>Regards,
>>Ramie
>>.
>>

>.
>

 
Reply With Quote
 
Guest
Posts: n/a
 
      10-30-2003

XML may not be the best method of moving 30mb of data across the internet,
especially is most of it is a BLOB.

Let me bounce this idea off you:

1. Store your BLOB in a text or binary file, store any header or
structured info in a smaller .xml or comma delimited file.

2. ZIP the files on the client and then FTP to the server.

3. Bulk load the data into SQL Server using DTS or BCP.

WKidd


"Ramie" <> wrote in message
news:013601c39f01$74ca8940$...
> Hello,
>
> I am working on a B2B web serivce application. I am
> Systems Architect for this application. I am in the
> process of desigining my components. I would like to know
> which one is better over the other for parsing 30MB
> files. We would like to use one of the following two
> choices: ATL/COM or VB/COM. Can you please share your
> thoughts on this ?
>
> Regards,
> Ramie



 
Reply With Quote
 
Kline Sphere
Guest
Posts: n/a
 
      10-30-2003
Depends on the format of the files and what information you are
parsing for.
On Thu, 30 Oct 2003 08:18:29 -0800, "Ramie"
<> wrote:

>Hello,
>
>I am working on a B2B web serivce application. I am
>Systems Architect for this application. I am in the
>process of desigining my components. I would like to know
>which one is better over the other for parsing 30MB
>files. We would like to use one of the following two
>choices: ATL/COM or VB/COM. Can you please share your
>thoughts on this ?
>
>Regards,
>Ramie


 
Reply With Quote
 
Kline Sphere
Guest
Posts: n/a
 
      10-30-2003
>Web
>Service gets the input file (as big as 30MB) via HTTP
>post. The user posts file to an ASP page. Then, the ASP
>page will call MTS component, which will parse the file to
>extract three piece of info: User Id, Password, and some
>text data (called as BLOB). Now, the question is on
>choosing the language to develop the MTS component (called
>as App Controller), in VB/COM or ATL/COM ?


Review your architectural design. I mean, 30 megs via a web service
using asp, then processing through an mts component.....
 
Reply With Quote
 
Kline Sphere
Guest
Posts: n/a
 
      10-30-2003
>2. ZIP the files on the client and then FTP to the server.

Better still use a compressing stream, i.e.
GZIPInputStream/GZIPOutputStream or the like of
 
Reply With Quote
 
Jay Walters
Guest
Posts: n/a
 
      10-30-2003
Yeah - I've used Gzip and it's good. I serialized a large
dataset using the binaryFormatter to a memorystream, get
and Gzipped it, and converted it to a byte() to send it
accross the wire and it worked great!


>-----Original Message-----
>>2. ZIP the files on the client and then FTP to the

server.
>
>Better still use a compressing stream, i.e.
>GZIPInputStream/GZIPOutputStream or the like of
>.
>

 
Reply With Quote
 
Kline Sphere
Guest
Posts: n/a
 
      10-30-2003
Cool!
On Thu, 30 Oct 2003 11:19:47 -0800, "Jay Walters"
<> wrote:

>Yeah - I've used Gzip and it's good. I serialized a large
>dataset using the binaryFormatter to a memorystream, get
>and Gzipped it, and converted it to a byte() to send it
>accross the wire and it worked great!
>
>
>>-----Original Message-----
>>>2. ZIP the files on the client and then FTP to the

>server.
>>
>>Better still use a compressing stream, i.e.
>>GZIPInputStream/GZIPOutputStream or the like of
>>.
>>


 
Reply With Quote
 
Ramie
Guest
Posts: n/a
 
      10-30-2003
Architecture for the Web Service is fixed, or shoud say,
dictated by the user. We must use HTTP as the
transportation protocol, and data is in ASCII (X12)
format, which is encrypted before posted to the web
service. Data is posted to an ASP page in multi-part
binary post. Therefore, I do not have architecture design
choice between HTTP and FTP.

>-----Original Message-----
>>Web
>>Service gets the input file (as big as 30MB) via HTTP
>>post. The user posts file to an ASP page. Then, the ASP
>>page will call MTS component, which will parse the file

to
>>extract three piece of info: User Id, Password, and some
>>text data (called as BLOB). Now, the question is on
>>choosing the language to develop the MTS component

(called
>>as App Controller), in VB/COM or ATL/COM ?

>
>Review your architectural design. I mean, 30 megs via a

web service
>using asp, then processing through an mts component.....
>.
>

 
Reply With Quote
 
 
 
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Sandisk ESP or 30mb/sec - Which one is faster? William Jones Digital Photography 2 03-21-2009 01:27 AM
Microcontrollers: which one ? which language ? which compiler ? The Jesus of Suburbia NZ Computing 2 02-11-2006 06:53 PM
Build a Better Blair (like Build a Better Bush, only better) Kenny Computer Support 0 05-06-2005 04:50 AM
Where do I get to my 30Mb webspace? Simon Cooper Computer Support 7 11-20-2003 08:13 PM
Reposting--which one is better? nomi MCSD 1 07-17-2003 12:27 PM



Advertisments
 



1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57