Velocity Reviews - Computer Hardware Reviews

Velocity Reviews > Newsgroups > Programming > Java > search source code project

Reply
Thread Tools

search source code project

 
 
cmk128@hotmail.com
Guest
Posts: n/a
 
      02-15-2007
Hi
Here is my project:

1) Apache + tomcat + mysql (have to use JSP, no php)
2) 3 servers : Linux FC6 , 2GB ram , 2.8Ghz
3) Goal : to build a website to let people search the source code from
over 1 million files.

It is unable to use mysql to build the index from the source code
because people can search "int x=0" rather than english word, so all
the indexing server doesn't word. I guess every time the user submit a
search, i use grep command to search all the 1 million files. But it
is too slow, how can i improve it?

thanks
from Peter ()

 
Reply With Quote
 
 
 
 
cmk128@hotmail.com
Guest
Posts: n/a
 
      02-15-2007
Forgot to say, in my xeon 3Ghz server, i need 10 seconds to grep 20000
files. If i need to grep 1 million files, then i need at least 500
seconds, it is too slow.
thanks
from Peter

 
Reply With Quote
 
 
 
 
dnass
Guest
Posts: n/a
 
      02-15-2007
On 15 fév, 10:41, cmk...@hotmail.com wrote:
> Forgot to say, in my xeon 3Ghz server, i need 10 seconds to grep 20000
> files. If i need to grep 1 million files, then i need at least 500
> seconds, it is too slow.
> thanks
> from Peter


Hi,

Have you tried Lucene http://lucene.apache.org/java/docs/

you are welcome
Dnas

 
Reply With Quote
 
Chris Uppal
Guest
Posts: n/a
 
      02-15-2007
wrote:

> 3) Goal : to build a website to let people search the source code from
> over 1 million files.


Have you looked at OpenGrok ?

(It uses Lucene as its text search engine internally, but adds stuff for
specialising to searching and displaying code.)

-- chris



 
Reply With Quote
 
 
 
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
| SEO , Search Engine Optimizer, SEARCH OPtiMIzAtIoN with SeaRch OPtiMizer optimizer.seo@gmail.com Digital Photography 0 04-22-2007 04:20 AM
Adding a web application project to source control (Visual Source Safe) ~~~ .NET Ed ~~~ ASP .Net 1 02-26-2005 02:20 PM
search within a search within a search - looking for better way...my script times out Abby Lee ASP General 5 08-02-2004 04:01 PM
How can an asp.net project by pulling in a code-behind class from another project? moondaddy ASP .Net 4 07-27-2004 08:01 AM
Looking for a C project to read the source code Sathyaish C Programming 1 06-11-2004 05:20 AM



Advertisments
 



1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57