how can google do all those quick searches?

Collapse
X
Collapse
 
  • Page of 1
  • Time
  • Show
Clear All
new posts
Previous template Next
  • mrthumbs
    salad tossing sig guy
    • Apr 2002
    • 11702
    #1

    how can google do all those quick searches?

    dont give me the cache explanation because cache needs to be indexed to..

    How does google search billions of pages within a fraction of a second.. not only that is amazing.. she does it for 10 thousands simultaneously.

    Is there a secret or is it just machine power?
    Tags: None
    • psyko514
      See sig. Join Epic Cash.
      • Oct 2002
      • 22366
      #2
      It's all about the Pigeon Rank technology.

      http://www.google.com/technology/pigeonrank.html

      Bad Girl Bucks       - 50% Revshare through CCBill.
      Promote BrandyDDD, Pixie's Pillows, Action Allie and more!

      Phoenix Forum Pics | Webmaster Access Montreal pics
      email: psyko514(a)gmail.com | icq: 214-702-014

        Comment

        • StuartD
          Sofa King Band
          • Jul 2002
          • 29903
          #3
          rooms and rooms full of servers... I figure they gotta have a ton of machines all working together to perform all those searches and indexing and everything else.
          This is me on facebook
          This is me on twitter

            Comment

            • psyko514
              See sig. Join Epic Cash.
              • Oct 2002
              • 22366
              #4
              <h3>The technology behind Google's great results</h3>
              As a Google user, you're familiar with the speed and accuracy of a Google search. How exactly does Google manage to find the right results for every query as quickly as it does? The heart of Google's search technology is PigeonRank?, a system for ranking web pages developed by Google founders Larry Page and Sergey Brin at Stanford University.


              Building upon the breakthrough work of B. F. Skinner, Page and Brin reasoned that low cost pigeon clusters (PCs) could be used to compute the relative value of web pages faster than human editors or machine-based algorithms. And while Google has dozens of engineers working to improve every aspect of our service on a daily basis, PigeonRank continues to provide the basis for all of our web search tools.

              Bad Girl Bucks               - 50% Revshare through CCBill.
              Promote BrandyDDD, Pixie's Pillows, Action Allie and more!

              Phoenix Forum Pics | Webmaster Access Montreal pics
              email: psyko514(a)gmail.com | icq: 214-702-014

                Comment

                • Mr. Marks
                  Confirmed User
                  • Jun 2001
                  • 7517
                  #5
                  probably spider machine power.

                    Comment

                    • Rorschach
                      So Fucking Banned
                      • Aug 2002
                      • 5579
                      #6
                      http://www7.scu.edu.au/programme/ful...21/com1921.htm

                        Comment

                        • woj
                          <&(©¿©)&>
                          • Jul 2002
                          • 47880
                          #7
                          Originally posted by Rorschach
                          http://www7.scu.edu.au/programme/ful...21/com1921.htm
                          I was about to post that... it's a good read
                          Custom Software Development, email: woj#at#wojfun#.#com to discuss details or skype: wojl2000 or gchat: wojfun or telegram: wojl2000
                          Affiliate program tools: Hosted Galleries Manager Banner Manager Video Manager
                          Wordpress Affiliate Plugin Pic/Movie of the Day Fansign Generator Zip Manager

                            Comment

                            • Jamief
                              Registered User
                              • Mar 2004
                              • 3
                              #8
                              When a search query is submitted to Google, it is routed to a data coop where monitors flash result pages at blazing speeds. When a relevant result is observed by one of the pigeons in the cluster, it strikes a rubber-coated steel bar with its beak, which assigns the page a PigeonRank value of one. For each peck, the PigeonRank increases. Those pages receiving the most pecks, are returned at the top of the user's results page with the other results displayed in pecking order.
                              Is that just a stupid joke or something

                                Comment

                                • Rorschach
                                  So Fucking Banned
                                  • Aug 2002
                                  • 5579
                                  #9
                                  Originally posted by Jamief


                                  Is that just a stupid joke or something


                                  You saved up your first post to say something retarded?

                                    Comment

                                    • johnbosh
                                      Confirmed User
                                      • Aug 2002
                                      • 8965
                                      #10
                                      the pigeon idea really works

                                        Comment

                                        • Ash@phpFX
                                          Confirmed User
                                          • Nov 2003
                                          • 4292
                                          #11
                                          interesting read there

                                            Comment

                                            • the Shemp
                                              congrats to the winners
                                              • Nov 2001
                                              • 10891
                                              #12
                                              i always though they just had a ton of horsepower
                                              i use Vacares...so should you
                                              Submit your picture galleries to my site...Outlaw TGP

                                                Comment

                                                • beemk
                                                  CLICK HERE
                                                  • Jan 2002
                                                  • 20829
                                                  #13
                                                  Originally posted by Jamief


                                                  Is that just a stupid joke or something
                                                  nope its real..... just like bangbus
                                                  I host with Vacares

                                                    Comment

                                                    • DarkJedi
                                                      No Refunds Issued.
                                                      • Feb 2001
                                                      • 28301
                                                      #14
                                                      They got tens of thousands of servers.

                                                        Comment

                                                        • vapewiz
                                                          Confirmed User
                                                          • Nov 2002
                                                          • 1530
                                                          #15
                                                          Originally posted by beemk
                                                          nope its real..... just like bangbus

                                                            Comment

                                                            • Garou
                                                              Confirmed User
                                                              • Mar 2003
                                                              • 850
                                                              #16
                                                              wow! google was created by Russian programmist )

                                                                Comment

                                                                • valley hina
                                                                  Confirmed User
                                                                  • May 2003
                                                                  • 1170
                                                                  #17
                                                                  Originally posted by Garou
                                                                  wow! google was created by Russian programmist )
                                                                  for real i didnt know that!!

                                                                  Crazy you learn shit everyday

                                                                    Comment

                                                                    • SomeCreep
                                                                      :glugglug
                                                                      • Mar 2003
                                                                      • 26118
                                                                      #18
                                                                      Originally posted by mrthumbs
                                                                      dont give me the cache explanation because cache needs to be indexed to..

                                                                      How does google search billions of pages within a fraction of a second.. not only that is amazing.. she does it for 10 thousands simultaneously.

                                                                      Is there a secret or is it just machine power?
                                                                      Yes, the algorithms are a secret. They use "advanced" computer science concepts and programming. Other than that, it gets very technical.

                                                                      Webair Hosting

                                                                      I use and recommend Webair for hosting.

                                                                        Comment

                                                                        • Serge Litehead
                                                                          Confirmed User
                                                                          • Dec 2002
                                                                          • 5190
                                                                          #19
                                                                          Originally posted by DarkJedi
                                                                          They got tens of thousands of servers.
                                                                          literally



                                                                          -----------------
                                                                          http://google.com/bsd

                                                                            Comment

                                                                            • foolio
                                                                              ICQ: 178725656
                                                                              • Nov 2002
                                                                              • 12366
                                                                              #20
                                                                              google is one of thise things that as long as it works I dont care how it works

                                                                                Comment

                                                                                • chrisp420
                                                                                  Confirmed User
                                                                                  • Aug 2002
                                                                                  • 572
                                                                                  #21
                                                                                  Originally posted by psyko514
                                                                                  <h3>The technology behind Google's great results</h3>
                                                                                  As a Google user, you're familiar with the speed and accuracy of a Google search. How exactly does Google manage to find the right results for every query as quickly as it does? The heart of Google's search technology is PigeonRank?, a system for ranking web pages developed by Google founders Larry Page and Sergey Brin at Stanford University.


                                                                                  Building upon the breakthrough work of B. F. Skinner, Page and Brin reasoned that low cost pigeon clusters (PCs) could be used to compute the relative value of web pages faster than human editors or machine-based algorithms. And while Google has dozens of engineers working to improve every aspect of our service on a daily basis, PigeonRank continues to provide the basis for all of our web search tools.
                                                                                  massive clusters will yeild anybody great results. their datacenter machine layouts are amazing.
                                                                                  icq: 327189899

                                                                                    Comment

                                                                                    • nastyking
                                                                                      • Nov 2002
                                                                                      • 2174
                                                                                      #22
                                                                                      Writing Powerful Programs in C and C++

                                                                                      Using Technologies to avoid slow Hard disk Operations (Big Files)

                                                                                      Using Stuff like Lexicon, Word IDs, etc ..

                                                                                      Every word found in the document is turned into an integer number (wordID)

                                                                                      When somebody searches for "gay seals" it's turned for example into 123 and 653. Then Google looks for all documents matching this two Word IDs. This way they get around SLOW string comparisons ....

                                                                                      To rank the site Google uses a Hitlist.

                                                                                      For every document found it calculates the IR. If "seals" is for example in Hn tags it's a greater Hit as if it would be in normal P tag ...

                                                                                      Then it uses factors like PR, IBLs, anchor text, proximity of keywords and a lots of stuff we do not know to give it the final touch

                                                                                      This powerful piece of software is than run on 1000 of cheap servers ...



                                                                                      Full Paper
                                                                                      Last edited by nastyking; 03-26-2004, 02:54 AM.

                                                                                        Comment

                                                                                        • montel
                                                                                          Confirmed User
                                                                                          • Jul 2001
                                                                                          • 2606
                                                                                          #23
                                                                                          The staff at google are extremely smart. They have more Phd's per square foot there than any institution I can think of.
                                                                                          Barefootsies

                                                                                            Comment

                                                                                            • sexsup
                                                                                              Confirmed User
                                                                                              • Feb 2004
                                                                                              • 3004
                                                                                              #24
                                                                                              Originally posted by Garou
                                                                                              wow! google was created by Russian programmist )
                                                                                              I always knew it

                                                                                                Comment

                                                                                                • Mike-BP
                                                                                                  Confirmed User
                                                                                                  • Mar 2003
                                                                                                  • 1270
                                                                                                  #25
                                                                                                  it's magic
                                                                                                  Thanks to: ISPrime.com - best hosting company without downtime

                                                                                                    Comment

                                                                                                    • NetRodent
                                                                                                      Confirmed User
                                                                                                      • Jan 2002
                                                                                                      • 3985
                                                                                                      #26
                                                                                                      Originally posted by SomeCreep

                                                                                                      Yes, the algorithms are a secret. They use "advanced" computer science concepts and programming. Other than that, it gets very technical.
                                                                                                      The ranking algorithims are secret, how they serve up results quickly has been published. There have been several articles published about how their clusters are organized, their use of ram disks, etc. I'm too lazy to dig them all up, here's one I happened to have handy:

                                                                                                      http://www.cs.rochester.edu/sosp2003...5-ghemawat.pdf

                                                                                                      If you want to find the others, try searching on Google.
                                                                                                      "Every normal man must be tempted, at times, to spit on his hands, hoist the black flag, and begin slitting throats."
                                                                                                      --H.L. Mencken

                                                                                                        Comment

                                                                                                        • mardigras
                                                                                                          Bon temps!
                                                                                                          • Feb 2003
                                                                                                          • 14194
                                                                                                          #27
                                                                                                          One of the prime time news magazines showed the Google servers awhile back. They were huge, went down a corridor and were behind chain-link fence.
                                                                                                          .

                                                                                                            Comment

                                                                                                            • mrthumbs
                                                                                                              salad tossing sig guy
                                                                                                              • Apr 2002
                                                                                                              • 11702
                                                                                                              #28
                                                                                                              thank you all for the explanation. it makes sense now

                                                                                                                Comment

                                                                                                                • Intrigue
                                                                                                                  Confirmed User
                                                                                                                  • Feb 2004
                                                                                                                  • 662
                                                                                                                  #29
                                                                                                                  There servers also use a properiatary filesystem known as GFS which is capable of searching and indexing multiple terabytes of data very effeciently, also developed by the magnificient bastards at google!

                                                                                                                    Comment

                                                                                                                    • uvort
                                                                                                                      Confirmed User
                                                                                                                      • Mar 2003
                                                                                                                      • 3580
                                                                                                                      #30
                                                                                                                      none the less, its pretty fuckin crazy how then can do that..
                                                                                                                      See Sig.
                                                                                                                      199907143

                                                                                                                        Comment

                                                                                                                        Previous template Next
                                                                                                                        Working...