WhiteHouse.gov robots file

Collapse
X
Collapse
 
  • Page of 1
  • Time
  • Show
Clear All
new posts
Previous template Next
  • FATPad
    Confirmed User
    • Oct 2001
    • 6693
    #1

    WhiteHouse.gov robots file

    http://www.whitehouse.gov/robots.txt

    Of course, I know it's there just so eventually when we take over the world, Google and Alta Vista will have no proof that that's what we planned, but I just found it interesting.
    <a href="http://www.adultcontent.co.uk">Adult Content UK - Great British Content</a>
    Tags: None
    • Theo
      HAL 9000
      • May 2001
      • 34515
      #2
      Disallow: /president/gallery/nudepics/gangbangs
      Disallow: /president/gallery/nudepics/fisting
      Disallow: /president/gallery/nudepics/anal


      interesting

        Comment

        • WiredGuy
          Pounding Googlebot
          • Aug 2002
          • 34517
          #3
          Originally posted by Soul_Rebel
          Disallow: /president/gallery/nudepics/gangbangs
          Disallow: /president/gallery/nudepics/fisting
          Disallow: /president/gallery/nudepics/anal


          interesting
          I play with Google.

            Comment

            • KRL
              Entrepreneur
              • Oct 2002
              • 31429
              #4
              Great homeland security they got there.

              What a joke.

              If you would like to develop your domains, you can lease inexpensive foreign labor
              from the leaders in the field at iWebmasters.com TO LOWER YOUR COSTS AND INCREASE YOUR PRODUCTION!
              *** *** *** *** *** *** *** *** *** *** *** ***
              Domains Adult News KRL's Newsletter Biz Tips Just Listed Domains

                Comment

                • Dawgy
                  Confirmed User
                  • Jul 2001
                  • 5856
                  #5
                  ? i dont get it. haha

                  isnt robots.txt supposed to disallow files that actually exist? thus the reason for disallowing them to be spidered?

                  i dont know my SE stuff... so... yeah im stupid :P
                  the revolution is coming.

                    Comment

                    • Theo
                      HAL 9000
                      • May 2001
                      • 34515
                      #6
                      fuckers,they removed them!

                        Comment

                        • NetRodent
                          Confirmed User
                          • Jan 2002
                          • 3985
                          #7
                          You can find all sorts of interesting things snooping around in robots.txt files. You just have to watch out for spider traps.
                          "Every normal man must be tempted, at times, to spit on his hands, hoist the black flag, and begin slitting throats."
                          --H.L. Mencken

                            Comment

                            • SexxxyChat-T
                              Confirmed User
                              • Jun 2003
                              • 697
                              #8
                              What bothers me about all this is that they are disallowing it now, because they were caught CHANGING official White House docs and articles after they had been published.

                              It happened when Bush declared combat operations in Iraq over. The headline read "Bush declares combat over in Iraq" and then they went back after the press was bad and changed it to read "Bush declares major combat over in Iraq". People caught it because of the cached page in Google and gave the administration shit for it.

                              I can't be sure, but I think I read about some of the articles having their text rewritten and such.

                              Want to talk about "revisionist history"....

                              But more then that... why would the President want to "hide" official White House releases from the web searching public?
                              Need more cowbell?
                              Then offer SexxxyChat live webcam feeds to your customers!
                              Make up to 35% of all sales, $30 on first purchase, or $10 per signup

                                Comment

                                Previous template Next
                                Working...