Velocity Reviews - Computer Hardware Reviews

Velocity Reviews > Newsgroups > Programming > ASP .Net > Huge Volume Of data

Reply
Thread Tools

Huge Volume Of data

 
 
Sunil
Guest
Posts: n/a
 
      02-09-2008
This may sound like a very common question but

I am developing an application which is just used for reporting purpose...
The application has two things - grid and an option to export the data to
excel.

Now the main issue is the volume of data that we are dealing with is more
than a million records and the application server is on a load balancing one.

The grid should be able to do things like filtering, column hiding, column
reordering and fast navigation i.e page navigation and the data on the grid
needs to be exported to a excel.

The records on the grid will not be modified in any way.

Since there are more than a million record (and more than 50 columns)there
is this issue with exporting to excel as well. since a sheet in excel can
only accomodate 65536 rows we will be transferring the data to the next
sheets and so on. This I guess is only possible with Interop programming....

This looks like an application which demands for Windows application but the
client wants it in web only without compromisin performance....

If anybody has already designed this kind of application can you please help
me with the design...
 
Reply With Quote
 
 
 
 
Ray Costanzo
Guest
Posts: n/a
 
      02-09-2008
Have you considered looking into SQL Reporting Services? Much of the
functionality you're after comes out of the box, I believe.

Would your client really want to get a million records? If so, chances are
they don't want to just bring it into Excel. You'd think think that if they
need to get all of this data from your system, they have intentions of
something with it, such as importing it into a data analysis system on their
end or something. I'd get more details as to what they intend to do. If
they really do want to just use Excel, tell them to upgrade to Office 2007
where they can have 1,048,576 rows. (That doesn't sound like fun.)

"Sunil" <(E-Mail Removed)> wrote in message
news:(E-Mail Removed)...
> This may sound like a very common question but
>
> I am developing an application which is just used for reporting purpose...
> The application has two things - grid and an option to export the data to
> excel.
>
> Now the main issue is the volume of data that we are dealing with is more
> than a million records and the application server is on a load balancing
> one.
>
> The grid should be able to do things like filtering, column hiding, column
> reordering and fast navigation i.e page navigation and the data on the
> grid
> needs to be exported to a excel.
>
> The records on the grid will not be modified in any way.
>
> Since there are more than a million record (and more than 50 columns)there
> is this issue with exporting to excel as well. since a sheet in excel can
> only accomodate 65536 rows we will be transferring the data to the next
> sheets and so on. This I guess is only possible with Interop
> programming....
>
> This looks like an application which demands for Windows application but
> the
> client wants it in web only without compromisin performance....
>
> If anybody has already designed this kind of application can you please
> help
> me with the design...



 
Reply With Quote
 
 
 
 
Sunil
Guest
Posts: n/a
 
      02-10-2008
Thanx Ray,

But the user will not be importing it into any other system. They will only
use the data in excel for reporting purpose. And Office 2007 is also not
available at their end...

Exporting to the excel can be solved using Interop, I guess... My biggest
concern is the performance...

"Ray Costanzo" wrote:

> Have you considered looking into SQL Reporting Services? Much of the
> functionality you're after comes out of the box, I believe.
>
> Would your client really want to get a million records? If so, chances are
> they don't want to just bring it into Excel. You'd think think that if they
> need to get all of this data from your system, they have intentions of
> something with it, such as importing it into a data analysis system on their
> end or something. I'd get more details as to what they intend to do. If
> they really do want to just use Excel, tell them to upgrade to Office 2007
> where they can have 1,048,576 rows. (That doesn't sound like fun.)
>
> "Sunil" <(E-Mail Removed)> wrote in message
> news:(E-Mail Removed)...
> > This may sound like a very common question but
> >
> > I am developing an application which is just used for reporting purpose...
> > The application has two things - grid and an option to export the data to
> > excel.
> >
> > Now the main issue is the volume of data that we are dealing with is more
> > than a million records and the application server is on a load balancing
> > one.
> >
> > The grid should be able to do things like filtering, column hiding, column
> > reordering and fast navigation i.e page navigation and the data on the
> > grid
> > needs to be exported to a excel.
> >
> > The records on the grid will not be modified in any way.
> >
> > Since there are more than a million record (and more than 50 columns)there
> > is this issue with exporting to excel as well. since a sheet in excel can
> > only accomodate 65536 rows we will be transferring the data to the next
> > sheets and so on. This I guess is only possible with Interop
> > programming....
> >
> > This looks like an application which demands for Windows application but
> > the
> > client wants it in web only without compromisin performance....
> >
> > If anybody has already designed this kind of application can you please
> > help
> > me with the design...

>
>
>

 
Reply With Quote
 
 
 
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Memory error due to the huge/huge input file size tejsupra@gmail.com Python 3 11-20-2008 07:21 PM
DVD Verdict reviews: MADLAX: REALITY (VOLUME 7), STARSHIP OPERATORS: MEMORIES (VOLUME 2), and more! DVD Verdict DVD Video 0 04-20-2006 08:36 AM
DVD Verdict reviews: SPEED RACER: VOLUME 4, MERMAID FOREST: UNQUENCHABLE THIRST (VOLUME 3), and more! DVD Verdict DVD Video 0 04-13-2006 08:22 AM
DVD Verdict reviews: SAMURAI CHAMPLOO: VOLUME 3, NEW FIST OF THE NORTH STAR: WHEN A MAN CARRIES SORROW (VOLUME 3), and more! DVD Verdict DVD Video 2 08-04-2005 07:32 AM
DVD Verdict reviews: SAMURAI CHAMPLOO (VOLUME 2), CHRONO CRUSADE: THE DEVIL TO PAY (VOLUME 4), and more! DVD Verdict DVD Video 0 05-26-2005 08:12 AM



Advertisments