Question on .htaccess

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • monaro
    Confirmed User
    • Aug 2003
    • 968

    #1

    Question on .htaccess

    How does one stop content from being pulled from galleries?
    Meaning the picture url is still able to be viewed.
    fukser . com my concerns are that .htaccess can stop the hotlink
    though how would you stop this happening to each any every wms
    that has content out in the free area?

    Cpanel has an option, about; Allow direct requests (ie. entering the url to an image in your browser)

    Is this the only way?

    Thanks in advance

    Mark
  • xanx
    Confirmed User
    • Apr 2002
    • 3711

    #2
    This is a long fought battle. I fight with this type of thing daily. My suggestions is add something like what I have listed below but also setup a bot trap. I snag about 30 bots a day w/ the bot trap.

    RewriteEngine On
    RewriteCond %{HTTP_USER_AGENT} ^BlackWidow [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Bot\ mailto:[email protected] [OR]
    RewriteCond %{HTTP_USER_AGENT} ^ChinaClaw [OR]
    RewriteCond %{HTTP_USER_AGENT} ^DISCo [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Download\ Demon [OR]
    RewriteCond %{HTTP_USER_AGENT} ^eCatch [OR]
    RewriteCond %{HTTP_USER_AGENT} ^EirGrabber [OR]
    RewriteCond %{HTTP_USER_AGENT} ^EmailSiphon [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Express\ WebPictures [OR]
    RewriteCond %{HTTP_USER_AGENT} ^ExtractorPro [OR]
    RewriteCond %{HTTP_USER_AGENT} ^EyeNetIE [OR]
    RewriteCond %{HTTP_USER_AGENT} ^FlashGet [OR]
    RewriteCond %{HTTP_USER_AGENT} ^GetRight [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Go!Zilla [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Go-Ahead-Got-It [OR]
    RewriteCond %{HTTP_USER_AGENT} ^GrabNet [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Grafula [OR]
    RewriteCond %{HTTP_USER_AGENT} ^HMView [OR]
    RewriteCond %{HTTP_USER_AGENT} ^HTTrack [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Image\ Stripper [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Image\ Sucker [OR]
    RewriteCond %{HTTP_USER_AGENT} Indy.Library [NC,OR]
    RewriteCond %{HTTP_USER_AGENT} ^InterGET [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Internet\ Ninja [OR]
    RewriteCond %{HTTP_USER_AGENT} ^JetCar [OR]
    RewriteCond %{HTTP_USER_AGENT} ^JOC\ Web\ Spider [OR]
    RewriteCond %{HTTP_USER_AGENT} ^larbin [OR]
    RewriteCond %{HTTP_USER_AGENT} ^LeechFTP [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Mass\ Downloader [OR]
    RewriteCond %{HTTP_USER_AGENT} ^MIDown\ tool [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Mister\ PiX [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Navroad [OR]
    RewriteCond %{HTTP_USER_AGENT} ^NearSite [OR]
    RewriteCond %{HTTP_USER_AGENT} ^NetAnts [OR]
    RewriteCond %{HTTP_USER_AGENT} ^NetSpider [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Net\ Vampire [OR]
    RewriteCond %{HTTP_USER_AGENT} ^NetZIP [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Octopus [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Offline\ Explorer [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Offline\ Navigator [OR]
    RewriteCond %{HTTP_USER_AGENT} ^PageGrabber [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Papa\ Foto [OR]
    RewriteCond %{HTTP_USER_AGENT} ^pcBrowser [OR]
    RewriteCond %{HTTP_USER_AGENT} ^RealDownload [OR]
    RewriteCond %{HTTP_USER_AGENT} ^ReGet [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Siphon [OR]
    RewriteCond %{HTTP_USER_AGENT} ^SiteSnagger [OR]
    RewriteCond %{HTTP_USER_AGENT} ^SmartDownload [OR]
    RewriteCond %{HTTP_USER_AGENT} ^SuperBot [OR]
    RewriteCond %{HTTP_USER_AGENT} ^SuperHTTP [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Surfbot [OR]
    RewriteCond %{HTTP_USER_AGENT} ^tAkeOut [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Teleport\ Pro [OR]
    RewriteCond %{HTTP_USER_AGENT} ^VoidEYE [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Wget [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Web\ Image\ Collector [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Web\ Sucker [OR]
    RewriteCond %{HTTP_USER_AGENT} ^WebAuto [OR]
    RewriteCond %{HTTP_USER_AGENT} ^WebCopier [OR]
    RewriteCond %{HTTP_USER_AGENT} ^WebFetch [OR]
    RewriteCond %{HTTP_USER_AGENT} ^WebReaper [OR]
    RewriteCond %{HTTP_USER_AGENT} ^WebSauger [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Website\ eXtractor [OR]
    RewriteCond %{HTTP_USER_AGENT} ^WebStripper [OR]
    RewriteCond %{HTTP_USER_AGENT} ^WebWhacker [OR]
    RewriteCond %{HTTP_USER_AGENT} ^WebZIP [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Wget [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Widow [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Xaldon\ WebSpider [OR]
    RewriteCond %{HTTP_USER_AGENT} ^Zeus
    RewriteRule ^.* - [F,L]

    Comment

    • monaro
      Confirmed User
      • Aug 2003
      • 968

      #3
      Thank you for being an advanced webmaster and being online today.
      I starting to also set up the correct robot.txt to disallow. Something I overlooked on a new domain.

      Comment

      • xanx
        Confirmed User
        • Apr 2002
        • 3711

        #4
        make a hidden link on your site with a 1px by 1px graphic, then link it to a file inside a DIR where your robots.txt has it listed not to crawl. Spiders that don't listen to the robots.txt will attempt to scan it anyway looking for images, then in PHP write something that grabs the IP and bans it once it hits that file.

        Sounds kinda complex but it's really not.

        Comment

        • s9ann0
          Confirmed User
          • Sep 2001
          • 4873

          #5
          these sites are pic thievers:

          Code:
          RewriteEngine on
          RewriteCond %{HTTP_REFERER}	!=""
          RewriteCond %{HTTP_REFERER}	^http://.*coolios.net			[NC,OR]
          RewriteCond %{HTTP_REFERER}	^http://.*beautiesofporn.com		[NC,OR]
          RewriteCond %{HTTP_REFERER}	^http://.*stoppablegolem.com		[NC,OR]
          RewriteCond %{HTTP_REFERER}	^http://.*babehunt.org			[NC,OR]
          RewriteCond %{HTTP_REFERER}	^http://.*kaskus.com			[NC,OR]
          RewriteCond %{HTTP_REFERER}	^http://69.57.152.117			[NC,OR]
          RewriteCond %{HTTP_REFERER}	^http://.*myhotboard.com		[NC,OR]
          RewriteCond %{HTTP_REFERER}	^http://.*proboard			[NC,OR]
          RewriteCond %{HTTP_REFERER}	^http://.*peachy18.com			[NC,OR]
          RewriteCond %{HTTP_REFERER}	^http://.*picleecher.com		[NC,OR]
          RewriteCond %{HTTP_REFERER}	^http://.*xxx\-dump.com			[NC,OR]
          RewriteCond %{HTTP_REFERER}	^http://.*webrats.com			[NC,OR]
          RewriteCond %{HTTP_REFERER}	^http://.*usefulidiot.com		[NC,OR]
          RewriteCond %{HTTP_REFERER}	^http://.*dragonbal\-city.com		[NC,OR]
          RewriteCond %{HTTP_REFERER}	^http://.*notsuitableforwork.com	[NC,OR]
          RewriteCond %{HTTP_REFERER}	^http://.*fleshdex.com			[NC,OR]
          RewriteCond %{HTTP_REFERER}	^.*/forum*				[NC,OR]
          RewriteCond %{HTTP_REFERER}	^.*fusker*				[NC,OR]
          RewriteCond %{HTTP_REFERER}	^.*fukser*				[NC]
          RewriteRule ^(.*)$	[F]
          or this code blocks anything but requests from domain.com for anthing except html files, I have changed this regexp because I found that some do like:
          http:// [anything] domain.com [anything]
          and some of the fusker sites referers have the domain in the query string and it matches like:
          http://wanker.com/fusker/?http://yourdomain.com/


          Code:
          RewriteEngine On
          RewriteCond %{HTTP_REFERER}	!=""
          RewriteCond %{HTTP_REFERER}	!^http://[a-z,A-Z,0-9,\-]+.domain.com [NC]
          RewriteCond %{REQUEST_URI}	!\.*htm$				[NC]
          RewriteCond %{REQUEST_URI}	!\.*html$				[NC]
          RewriteCond %{REQUEST_URI}	!\.*/$
          RewriteRule ^(.*)$	[F]

          Comment

          • TheMob
            Confirmed User
            • Jan 2003
            • 8584

            #6
            do a google, there are some great sites for htaccess examples

            Comment

            Working...