«

have you seen ebay ? they have a search option at the top . you can
search almost anything in that search box. may be you could search
DVD,Books,CD etc almost anything. or they have a single database table
where all items are pushed ?


Its a very powerful search .

QUESTION is how do they search ?


i am assuming they have a separate datbase table for DVD, they have
Database table for CDS, they have database table for Books, they have
database table for mobile phone etc etc.they have all individual tables
for each catregory . that means they have hundreds of tables in thier
database for each item category.


Now , how do they going to search when you search for an item ?
as a user can type anything he wish to search . how they are going to
search ?

can you tell what is the architecture for which a good search could be
performed ?


P.S : how do i track my posts ? today when i came back i did not find
my old posts . it has been lost !!! does usenet dont have any facility
so that i could save my posts ?

On 25 Sep 2005 09:08:04 -0700, "gk" <> wrote or quoted
:

>i am assuming they have a separate datbase table for DVD, they have
>Database table for CDS, they have database table for Books, they have
>database table for mobile phone etc etc.they have all individual tables
>for each catregory . that means they have hundreds of tables in thier
>database for each item category.

They most likely do it with a giant combined index. there are several
ways they could implement it: It is not that outlandish. Have ever
seen "Books In Print"? You can pick it up in two hands. There are
dictionaries fatter.

1. they split the giant master index up alphabetically into 10 pieces
and put each piece on a different server. The request is farmed out
for each word in the search and then combined.

2. they split the index up by type . e.g.. books, DVD, electronics and
run each on a different server.

If you are amazed how ebay/Amazon works, think about google which
indexes the entire web.
--
Canadian Mind Products, Roedy Green.
http://mindprod.com Again taking new Java programming contracts.

gk wrote:
> i am assuming they have a separate datbase table for DVD, they have
> Database table for CDS, they have database table for Books, they have
> database table for mobile phone etc etc.they have all individual tables
> for each catregory . that means they have hundreds of tables in thier
> database for each item category.

Probably not, since you don't actually have to specify a single
normalized type for anything you want to sell. Their categories are
attributes of a listing, not the underlying type of the item. If they
use a relational database, they most likely have all items going into a
table for items for sale, a separate table for the categories, and a
join table between these.

Roedy Green wrote:
> On 25 Sep 2005 09:08:04 -0700, "gk" <> wrote or quoted
> :
>
> >i am assuming they have a separate datbase table for DVD, they have
> >Database table for CDS, they have database table for Books, they have
> >database table for mobile phone etc etc.they have all individual tables
> >for each catregory . that means they have hundreds of tables in thier
> >database for each item category.
>
> They most likely do it with a giant combined index. there are several
> ways they could implement it: It is not that outlandish. Have ever
> seen "Books In Print"? You can pick it up in two hands. There are
> dictionaries fatter.
>
> 1. they split the giant master index up alphabetically into 10 pieces
> and put each piece on a different server. The request is farmed out
> for each word in the search and then combined.
>
> 2. they split the index up by type . e.g.. books, DVD, electronics and
> run each on a different server.
>
> If you are amazed how ebay/Amazon works, think about google which
> indexes the entire web.
> --
> Canadian Mind Products, Roedy Green.
> http://mindprod.com Again taking new Java programming contracts.



hi sir, i could not get you. whats that giant master index and blah
blah . everthinhg is going out of my head. its very difficult. i am
interested to know this. will you please tell a link or web page where
i could get the things as like you are mentioning . its very interesting

Alan Krueger wrote:
> gk wrote:
> > i am assuming they have a separate datbase table for DVD, they have
> > Database table for CDS, they have database table for Books, they have
> > database table for mobile phone etc etc.they have all individual tables
> > for each catregory . that means they have hundreds of tables in thier
> > database for each item category.
>
> Probably not, since you don't actually have to specify a single
> normalized type for anything you want to sell. Their categories are
> attributes of a listing, not the underlying type of the item. If they
> use a relational database, they most likely have all items going into a
> table for items for sale, a separate table for the categories, and a
> join table between these.


will you please tell me your plan ? you mean , they have a table


ebay_item_to_sale
-------------------
cds-James bond
cds-michael jackson
java book--bruce eckal



category_table
---------------
col: CD , DVD,Books,jewellary .


something like this ?

pleaase clarify more .


one thing we must remember that an user is a whimsical one. anything
he can input ! and he must get a search result.


ohh, dont tell me about Google indexing. they are smart and big guys .
i want to make a small web application .

On 25 Sep 2005 23:15:11 -0700, "gk" <> wrote or quoted
:

>hi sir, i could not get you. whats that giant master index and blah
>blah . everthinhg is going out of my head. its very difficult. i am
>interested to know this. will you please tell a link or web page where
>i could get the things as like you are mentioning . its very interesting

There is one search engine who publishes its code called Lucene. Have
a look at a search engine called Dogpile. It has no databases of its
own. It works by spawning requests to other databases. See
http://mindprod.com/jgloss/searchengines.html
--
Canadian Mind Products, Roedy Green.
http://mindprod.com Again taking new Java programming contracts.

sir, i dont understand why you are pointing to me to the web search ! i
dont want to go for web search.

i want in web site there will be a search box so, that user can type
his/her interested products and get the result from my DB .

this is quiet similar like ebay . ebay does not search from all over
the web . it searches from its DB. some data entry operator puts those
data in thire DB .

so, question is ,
how do they organise their DB so that an whimsical user could access
anything whatever he likes from the DB.

question is :

what should be the table design ?

and

what should be the SQL query to fetch the data . of course, "LIKE"
keyword in SQL query wont be of much help in this case.is not it ?


i just need the flow how this thing is done. now adays many of the
websites are doing this same thing.




Roedy Green wrote:
> On 25 Sep 2005 23:15:11 -0700, "gk" <> wrote or quoted
> :
>
> >hi sir, i could not get you. whats that giant master index and blah
> >blah . everthinhg is going out of my head. its very difficult. i am
> >interested to know this. will you please tell a link or web page where
> >i could get the things as like you are mentioning . its very interesting
>
> There is one search engine who publishes its code called Lucene. Have
> a look at a search engine called Dogpile. It has no databases of its
> own. It works by spawning requests to other databases. See
> http://mindprod.com/jgloss/searchengines.html
> --
> Canadian Mind Products, Roedy Green.
> http://mindprod.com Again taking new Java programming contracts.

How do i save my posts ? its getting lost . how do i track my posts ?
there is no options like "My Topics" ?















gk wrote:
> sir, i dont understand why you are pointing to me to the web search ! i
> dont want to go for web search.
>
> i want in web site there will be a search box so, that user can type
> his/her interested products and get the result from my DB .
>
> this is quiet similar like ebay . ebay does not search from all over
> the web . it searches from its DB. some data entry operator puts those
> data in thire DB .
>
> so, question is ,
> how do they organise their DB so that an whimsical user could access
> anything whatever he likes from the DB.
>
> question is :
>
> what should be the table design ?
>
> and
>
> what should be the SQL query to fetch the data . of course, "LIKE"
> keyword in SQL query wont be of much help in this case.is not it ?
>
>
> i just need the flow how this thing is done. now adays many of the
> websites are doing this same thing.
>
>
>
>
> Roedy Green wrote:
> > On 25 Sep 2005 23:15:11 -0700, "gk" <> wrote or quoted
> > :
> >
> > >hi sir, i could not get you. whats that giant master index and blah
> > >blah . everthinhg is going out of my head. its very difficult. i am
> > >interested to know this. will you please tell a link or web page where
> > >i could get the things as like you are mentioning . its very interesting
> >
> > There is one search engine who publishes its code called Lucene. Have
> > a look at a search engine called Dogpile. It has no databases of its
> > own. It works by spawning requests to other databases. See
> > http://mindprod.com/jgloss/searchengines.html
> > --
> > Canadian Mind Products, Roedy Green.
> > http://mindprod.com Again taking new Java programming contracts.

gk wrote:
> How do i save my posts ? its getting lost . how do i track my posts ?
> there is no options like "My Topics" ?

Please trim redundant text from your replies and consult
the user documentation of your web interface[1] re the other stuff.

[1] <http://groups.google.com/intl/en/googlegroups/about.html>

A tip though, is that most posts are visible in one of many
archives of the group[2], which you should be reading generally,
rather than asking specific questions and expecting detailed
personalised help, as you seem to be doing.

[2] <http://groups.google.com/group/comp.lang.java.programmer>

Also note that there is nothing in your latest post that
is 'on-topic' for comp.lang.java.programmer.

On 26 Sep 2005 00:15:11 -0700, "gk" <> wrote or quoted
:

>sir, i dont understand why you are pointing to me to the web search ! i
>dont want to go for web search.
>
>i want in web site there will be a search box so, that user can type
>his/her interested products and get the result from my DB .

The difference between what you are doing and what web search engines
do, or Amazon does for books, or ebay does for dancing pandas is the
content of your index and the scale. You were asking general
questions about searching.

For your particular project, you need to do some basic study of
databases, servlets etc. See http://mindprod.com/jgloss/sql.html
http://mindprod.com/jgloss/jbdc.html
http://mindprod.com/jgloss/servlet.html
http://mindprod.com/jgloss/cgi.html

For a small site, just create a relational database of your products
and compose SQL queries from the contents of the forms. You don't
need to even think about how it all works. That is the SQL engine's
problem. Only if you are trying to pull off something on a massive
scale do you have to start thinking about multiple servers and custom
indexing techniques.
--
Canadian Mind Products, Roedy Green.
http://mindprod.com Again taking new Java programming contracts.