The reason why Search is down is because of the Board Leech sites.

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • Lensman
    GFY Chaperone
    • Jan 2001
    • 9846

    #1

    The reason why Search is down is because of the Board Leech sites.

    As Ray over at Jupiter said in his thread (http://www.gofuckyourself.com/showthread.php?t=470021), GFY is under a constant barrage of spiders and other data theives. It has gotten so bad, that we have a full time person to deal with the load issues. It is so bad, that that is the reason that search keeps going down, and that is why it is off right now.

    GFY serves the adult community and is the most active industry forum, we would never want to charge for posting, searching, etc. All we ask is that people give as well as receive, that they contribute posts, do business, and have fun. Make no mistake. GFY does not authorize the theft of the content that resides on GFY servers. The board leech sites are unauthorized content theives, it's the same if I were to spider a dating site, and steal all of the info that was posted there. They do not ask permission, and we request that they do not do it.

    Why are board leeches bad?
    1. They slow the board down, every day.
    2. They have crashed the board several times with their bots.
    3. They keep people from contributing to the forum they read, if you can read it without visiting, you are less likely to post.
    4. It's ILLEGAL content theft.

    I am asking nicely for all board leeches to stop republishing GFY. If you won't do it nicely, we can do it not so nice. We have taken legal action on board leeches in the past, and we will in the future. We start with a DCMA notice, it's usually enough to lose your hosting. Then we will escalate it from there.

    Some people ask: Why do smaller boards allow it? Because they are SMALLER, and they hope to mooch the traffic.

    I hope this ANSWERS Notjoe's question of why don't we want him to take GFY's content and repost it elsewhere.

    On another note, we are working on a more powerful search solution, and should have it back up next week.
  • Ice
    Confirmed User
    • Nov 2002
    • 26053

    #2
    Thanks for the update Lens............. enjoy your weekend
    icq 1904905

    Comment

    • cyber_ninja
      Twerk That Ass
      • Jul 2001
      • 2197

      #3

      Comment

      • JD
        Too lazy to set a custom title
        • Sep 2003
        • 22651

        #4
        kickass man! The search function is greatly missed....

        Comment

        • AlienQ - BANNED FOR LIFE
          best designer on GFY
          • Mar 2003
          • 30307

          #5
          And then there was light.

          Most of ya folks should have known this anyways, but its always good to have someone explaine it to stupid people so they understand the deal.

          Lens translation = "Content thieves Stop fucking with GFY or I will get real"

          Comment

          • budz
            Disruptive Innovator
            • Sep 2003
            • 4230

            #6
            can't wait

            thx for the post
            C:\Code\
            C:\Code\Run\

            Comment

            • Manowar
              jellyfish  
              • Dec 2003
              • 71528

              #7

              Comment

              • azguy
                Confirmed User
                • Nov 2004
                • 5167

                #8
                I'm not affiliated with any of those "leeching services", but technically speaking that's not content theft, at least not directly from you. The content still belongs to the posters as per your terms and conditions. Besides, search engines are a core element of the net and GFY is just like any other site out there that gets cached by Google/Yahoo.

                http://search.yahoo.com/search?p=sit...238&fl=0&x=wrt
                Last edited by azguy; 05-20-2005, 02:27 PM.

                Comment

                • Crypt
                  Confirmed User
                  • Apr 2004
                  • 2225

                  #9
                  Thanks Notjoe for crashing the board.
                  Now we know its your fault why we cant search atm.

                  Tard

                  Comment

                  • Manowar
                    jellyfish  
                    • Dec 2003
                    • 71528

                    #10
                    Originally posted by Crypt
                    Thanks Notjoe for crashing the board.
                    Now we know its your fault why we cant search atm.

                    Tard
                    and he was the one to complain

                    Comment

                    • AlienQ - BANNED FOR LIFE
                      best designer on GFY
                      • Mar 2003
                      • 30307

                      #11
                      Originally posted by azguy
                      I'm not affiliated with any of those "leeching services", but technically speaking that's not content theft. The content still belongs to the posters as per your terms and conditions. Besides, search engines are a core element of the net and GFY is just like any other site out there that gets cached by Google/Yahoo.

                      http://search.yahoo.com/search?p=sit...238&fl=0&x=wrt
                      Idiot.
                      The posters have chosen where there content is published no where else has the rights to redistribute it or duplicate it.

                      Comment

                      • D-Money
                        Too lazy to set a custom title
                        • Feb 2002
                        • 9716

                        #12
                        Best of luck Lens, I'm always impressed with how your team handles these things.
                        Still Ballin'

                        Comment

                        • goBigtime
                          Confirmed User
                          • Nov 2002
                          • 7761

                          #13
                          Not for nothin, but I think NotJoe's solution came after GFYs search was down for several months. NotJoe probably wouldn't have even thought to have created his site if it weren't for GFY search being down so much.

                          Comment

                          • azguy
                            Confirmed User
                            • Nov 2004
                            • 5167

                            #14
                            Originally posted by AlienQ
                            Idiot.
                            The posters have chosen where there content is published no where else has the rights to redistribute it or duplicate it.
                            Can't you have a serious conversation? Why the hell do you need to call someone an idiot? Grow up.

                            Google and Yahoo cache the entire net, what makes you think one forum is different than the rest? Those "leeching services" simply link back to GFY, it's not like they post the entire content.

                            Comment

                            • machinegunkelly
                              Confirmed User
                              • Jun 2003
                              • 3304

                              #15
                              Lens can you email me @ [email protected]
                              I've tried to reach you and I guess somethings a miss :P
                              dead.

                              Comment

                              • Crypt
                                Confirmed User
                                • Apr 2004
                                • 2225

                                #16
                                Originally posted by Manowar
                                and he was the one to complain
                                Yeah because his bot rely on search probably

                                Comment

                                • WiredGuy
                                  Pounding Googlebot
                                  • Aug 2002
                                  • 34512

                                  #17
                                  What about sites like saerchtheboards?
                                  The search of GFY works from there, but are they considered to be a board leech?
                                  WG
                                  I play with Google.

                                  Comment

                                  • uno
                                    RIP Dodger. BEST.CAT.EVER
                                    • Dec 2002
                                    • 18450

                                    #18
                                    Can't you just make a spider trap to kill the bad bots?
                                    -uno
                                    icq: 111-914
                                    CrazyBabe.com - porn art
                                    MojoHost - For all your hosting needs, present and future. Tell them I sent ya!

                                    Comment

                                    • azguy
                                      Confirmed User
                                      • Nov 2004
                                      • 5167

                                      #19
                                      Originally posted by AlienQ
                                      Idiot.
                                      The posters have chosen where there content is published no where else has the rights to redistribute it or duplicate it.
                                      You do realize that there are search engines out there, right? Why do you use Google if they search someone else's content? Those "leechers" did not even duplicate the content, they merely linked to the specific thread (unless there are other sites which I'm not currently aware of who do just that).

                                      Comment

                                      • Paraskass
                                        Confirmed User
                                        • May 2002
                                        • 5829

                                        #20
                                        Lensman, great news.

                                        thanks.

                                        Comment

                                        • Manowar
                                          jellyfish  
                                          • Dec 2003
                                          • 71528

                                          #21
                                          Originally posted by WiredGuy
                                          What about sites like saerchtheboards?
                                          The search of GFY works from there, but are they considered to be a board leech?
                                          WG
                                          i think thats the one in question

                                          Comment

                                          • CDSmith
                                            Too lazy to set a custom title
                                            • May 2001
                                            • 51460

                                            #22
                                            That's good enough for me. Done and done.

                                            Now back to work.
                                            Promote Wildmatch, ImLive, Sexier.com, and more!!

                                            ALWAYS THE HIGHEST PAYOUTS: Big Bux/ImLive SIGNUP ON NOW!!!

                                            Put some PUSSYCA$H in your pocket.
                                            ICQ me at: 31024634

                                            Comment

                                            • goBigtime
                                              Confirmed User
                                              • Nov 2002
                                              • 7761

                                              #23
                                              Originally posted by WiredGuy
                                              What about sites like saerchtheboards?
                                              The search of GFY works from there, but are they considered to be a board leech?
                                              WG

                                              hahahahahahahahahahahahahahaha = Notjoe, WG.

                                              Comment

                                              • azguy
                                                Confirmed User
                                                • Nov 2004
                                                • 5167

                                                #24
                                                Originally posted by Manowar
                                                i think thats the one in question
                                                Yes, we were talking about that one. All they're doing is link to the thread and show a short excerpt. I heard Google is doing the same thing, not sure A 60 billion dollar leecher.

                                                Comment

                                                • AlienQ - BANNED FOR LIFE
                                                  best designer on GFY
                                                  • Mar 2003
                                                  • 30307

                                                  #25
                                                  Originally posted by azguy
                                                  You do realize that there are search engines out there, right? Why do you use Google if they search someone else's content? Those "leechers" did not even duplicate the content, they merely linked to the specific thread (unless there are other sites which I'm not currently aware of who do just that).

                                                  Ya can ask Lens that however here is my basic take....

                                                  THE SEARCH ENGINES ARE NOT GOOD FOR THIS BOARD ANYWAYS.
                                                  Turn em away he does not need them and he does not need Mainstream surfers comming here.

                                                  Sure some get through but I can tell ya why there are boosts in Newbies here from time to time and they are nothing more than surfers.
                                                  Ya want more surfers here?

                                                  Mainstream SE BOTS = BAD

                                                  Comment

                                                  • digifan
                                                    The Profiler
                                                    • Oct 2002
                                                    • 14618

                                                    #26
                                                    It's so sad when they try to ruin gfy.. hope it's the resolution solution!
                                                    [email protected]
                                                    Webair Rocks

                                                    Comment

                                                    • tranza
                                                      ICQ: 197-556-237
                                                      • Jun 2003
                                                      • 57559

                                                      #27
                                                      Thanks for clearing that up for everybody Lens!
                                                      I'm just a newbie.

                                                      Comment

                                                      • azguy
                                                        Confirmed User
                                                        • Nov 2004
                                                        • 5167

                                                        #28
                                                        Originally posted by AlienQ
                                                        Ya can ask Lens that however here is my basic take....

                                                        THE SEARCH ENGINES ARE NOT GOOD FOR THIS BOARD ANYWAYS.
                                                        Turn em away he does not need them and he does not need Mainstream surfers comming here.

                                                        Sure some get through but I can tell ya why there are boosts in Newbies here from time to time and they are nothing more than surfers.
                                                        Ya want more surfers here?

                                                        Mainstream SE BOTS = BAD
                                                        I understand that. All I'm saying is that technically it's not entirely illegal to do what those "leechers" do and it's common practice in this beast called the world wide web.

                                                        Comment

                                                        • Juicy D. Links
                                                          So Fucking Banned
                                                          • Apr 2001
                                                          • 122992

                                                          #29
                                                          Originally posted by Lensman
                                                          4. It's ILLEGAL content theft.
                                                          I am content?


                                                          Comment

                                                          • wdsguy
                                                            Ryde or Die
                                                            • Dec 2002
                                                            • 19568

                                                            #30
                                                            Originally posted by azguy
                                                            Can't you have a serious conversation? Why the hell do you need to call someone an idiot? Grow up.

                                                            Google and Yahoo cache the entire net, what makes you think one forum is different than the rest? Those "leeching services" simply link back to GFY, it's not like they post the entire content.
                                                            Don't be so hard on him, he didn't take his meds today.

                                                            Comment

                                                            • loverboy
                                                              When it rains, it pours
                                                              • May 2003
                                                              • 20609

                                                              #31
                                                              slendid work Lens

                                                              Comment

                                                              • Juicy D. Links
                                                                So Fucking Banned
                                                                • Apr 2001
                                                                • 122992

                                                                #32
                                                                Originally posted by wdsguy
                                                                Don't be so hard on him, he didn't take his meds today.
                                                                i took 2 xanax and 2 paxils today

                                                                Comment

                                                                • AlienQ - BANNED FOR LIFE
                                                                  best designer on GFY
                                                                  • Mar 2003
                                                                  • 30307

                                                                  #33
                                                                  Originally posted by azguy
                                                                  I understand that. All I'm saying is that technically it's not entirely illegal to do what those "leechers" do and it's common practice in this beast called the world wide web.

                                                                  I apologise for the idiot part earlier.
                                                                  anyways...
                                                                  Sure it's illegal if ya think about it.
                                                                  Just beacuse its common practice does not mean its fair or legal.

                                                                  Comment

                                                                  • Lensman
                                                                    GFY Chaperone
                                                                    • Jan 2001
                                                                    • 9846

                                                                    #34
                                                                    Board republishers and search engines are two different things.

                                                                    And taking content without respecting the wishes of the site spidered is content theft.

                                                                    Comment

                                                                    • Lensman
                                                                      GFY Chaperone
                                                                      • Jan 2001
                                                                      • 9846

                                                                      #35
                                                                      Originally posted by Juicy D. Links
                                                                      I am content?


                                                                      Funny to think about, eh?

                                                                      Comment

                                                                      • ronaldo
                                                                        Confirmed User
                                                                        • Jan 2002
                                                                        • 5475

                                                                        #36
                                                                        I'm GUESSING what pissed a lot of people off, was just not knowing if and/or when it would be back.

                                                                        One minute it was there, but the next minute it was gone without explanation. (Note-I certainly may have missed the explanation if there was one).

                                                                        Your explanation along with Ray's will certainly go a long way to appease most.

                                                                        Comment

                                                                        • pornguy
                                                                          Too lazy to set a custom title
                                                                          • Mar 2003
                                                                          • 62912

                                                                          #37
                                                                          Thanks for the update, and let us know how we can help in any other way.
                                                                          PornGuy skype me pornguy_epic

                                                                          AmateurDough The Hottes Shemales online!
                                                                          TChicks.com | Angeles Cid | Mariana Cordoba | MAILERS WELCOME!

                                                                          Comment

                                                                          • azguy
                                                                            Confirmed User
                                                                            • Nov 2004
                                                                            • 5167

                                                                            #38
                                                                            Originally posted by AlienQ
                                                                            I apologise for the idiot part earlier.
                                                                            anyways...
                                                                            Sure it's illegal if ya think about it.
                                                                            Just beacuse its common practice does not mean its fair or legal.
                                                                            It's not as black and white as some may think. Since in this case Lensman doesn't own the content (I didn't see anything saying otherwise in the terms & conditions) and therefore it still belongs to the author, he might have problems suing the leechers on his users' behalf. It's a VERY complex situation when message boards are involved.

                                                                            Comment

                                                                            • AlienQ - BANNED FOR LIFE
                                                                              best designer on GFY
                                                                              • Mar 2003
                                                                              • 30307

                                                                              #39
                                                                              Lens may not technically own it but its his right to protect it.

                                                                              Comment

                                                                              • pr0
                                                                                rockin tha trailerpark
                                                                                • May 2001
                                                                                • 23088

                                                                                #40


                                                                                And to all you potential thieves out there....if you republish PG in ANY FORM, we expect written consent of F30 INC., Party Goat LTD. & the National Football League.

                                                                                Bitches
                                                                                __________
                                                                                Loadedca$h - get sum! - Revengebucks - mmm rebills! - webair (gotz sErVrz)

                                                                                Comment

                                                                                • azguy
                                                                                  Confirmed User
                                                                                  • Nov 2004
                                                                                  • 5167

                                                                                  #41
                                                                                  Originally posted by Lensman
                                                                                  Board republishers and search engines are two different things.

                                                                                  And taking content without respecting the wishes of the site spidered is content theft.
                                                                                  STBoards is a search engine in every respect. There may be other leechers who operate sites that republish entire GFY threads, but I'm assuming we're still discussing SrchTheBoards.

                                                                                  It may be 'content theft' (which in the case of STBoards it is clearly not), but you need to realize that you're not the owner of the users' posts on GFY, not until you clearly specify this in the terms & conditions of the forum. From my experience, the absence of a specific statement means that the copyright belongs to the author of the post.

                                                                                  Comment

                                                                                  • V_RocKs
                                                                                    Damn Right I Kiss Ass!
                                                                                    • Nov 2003
                                                                                    • 32449

                                                                                    #42
                                                                                    Originally posted by Lensman
                                                                                    Board republishers and search engines are two different things.

                                                                                    And taking content without respecting the wishes of the site spidered is content theft.
                                                                                    Exactly... Google looks for a robots text file and only goes where you want it to... Board leeching spyders do not follow a robots file and usually do thier handy work by abusing the search function.

                                                                                    Comment

                                                                                    • azguy
                                                                                      Confirmed User
                                                                                      • Nov 2004
                                                                                      • 5167

                                                                                      #43
                                                                                      Originally posted by AlienQ
                                                                                      Lens may not technically own it but its his right to protect it.
                                                                                      Nope. He can sue Google for republishing the site's logo in their cache DB, but not the content of the actual posts, not in this case. Google may comply if such DMCA notice is sent to them, but they'd win should they choose to fight it.

                                                                                      Comment

                                                                                      • Sosa
                                                                                        In Tushy Land
                                                                                        • Oct 2002
                                                                                        • 40149

                                                                                        #44
                                                                                        thanks for the update

                                                                                        Comment

                                                                                        • AlienQ - BANNED FOR LIFE
                                                                                          best designer on GFY
                                                                                          • Mar 2003
                                                                                          • 30307

                                                                                          #45
                                                                                          Why would lens want to own copyright of peoples posts?
                                                                                          To much Liability.

                                                                                          He is housing the statements and once its in his house he has the choice of who or what can access the information.

                                                                                          It's pretty cut and dry.

                                                                                          Comment

                                                                                          • Big Ray
                                                                                            Confirmed User
                                                                                            • Dec 2003
                                                                                            • 464

                                                                                            #46
                                                                                            Originally posted by WiredGuy
                                                                                            What about sites like saerchtheboards?
                                                                                            The search of GFY works from there, but are they considered to be a board leech?
                                                                                            WG
                                                                                            Hey WG.

                                                                                            You make a good point, however, their is a big difference in the google and yahoo spider than the ones that try and pull 200 threads a second all day every day. What we have to contend with are aggressive screen scrapers that feel the need to index every post the second it's made. They are highly aggressive and are not throttled. They behavior more like a DoS attack than a bot.

                                                                                            People ask why we don't ban them. The answer is we try, however, the majority of them use anonymous proxies and I don't mean a few.. I am talking hundreds. When we block those, they get a new batch. It's a constant battle which we fight every day.

                                                                                            The search feature is widely used to attempt to create search notification systems. Some companies do this, and hit the site once a day to see what people are saying about them or "keyword". Others are constantly hitting search for keywords like "need content" or "need hosting". Ever wonder how the same folks always post first to a request for product or service thread? now ya know. lol

                                                                                            Ray

                                                                                            Five of the Top 10 Largest Programs Host with Jupiter. Find out why at http://www.jupiterhosting.com

                                                                                            Comment

                                                                                            • azguy
                                                                                              Confirmed User
                                                                                              • Nov 2004
                                                                                              • 5167

                                                                                              #47
                                                                                              Originally posted by V_RocKs
                                                                                              Exactly... Google looks for a robots text file and only goes where you want it to... Board leeching spyders do not follow a robots file and usually do thier handy work by abusing the search function.
                                                                                              Not true. The new generation of spiders is going to ignore those. www.dipsie.com is spidering the 'Deep Web' and are not following the robots.txt anymore. They log on to sites such as GFY with a login/pass and cache everything. That I know for a fact, I've met with them a while ago.

                                                                                              Comment

                                                                                              • Babaganoosh
                                                                                                ♥♥♥ Likes Hugs ♥♥♥
                                                                                                • Nov 2001
                                                                                                • 15841

                                                                                                #48
                                                                                                Lensman, what the search really needs is an image verification. That would stop this shit immediately. It wouldn't be tough for one of your geeks to whip up.
                                                                                                I like pie.

                                                                                                Comment

                                                                                                • WiredGuy
                                                                                                  Pounding Googlebot
                                                                                                  • Aug 2002
                                                                                                  • 34512

                                                                                                  #49
                                                                                                  Originally posted by Big Ray
                                                                                                  Hey WG.

                                                                                                  You make a good point, however, their is a big difference in the google and yahoo spider than the ones that try and pull 200 threads a second all day every day. What we have to contend with are aggressive screen scrapers that feel the need to index every post the second it's made. They are highly aggressive and are not throttled. They behavior more like a DoS attack than a bot.

                                                                                                  People ask why we don't ban them. The answer is we try, however, the majority of them use anonymous proxies and I don't mean a few.. I am talking hundreds. When we block those, they get a new batch. It's a constant battle which we fight every day.

                                                                                                  The search feature is widely used to attempt to create search notification systems. Some companies do this, and hit the site once a day to see what people are saying about them or "keyword". Others are constantly hitting search for keywords like "need content" or "need hosting". Ever wonder how the same folks always post first to a request for product or service thread? now ya know. lol

                                                                                                  Ray

                                                                                                  Wow, i had no idea they were pulling in data so frequently. I thought these feeds were just fetching your data daily or so. If they really are using hundreds of changeable proxies like this, I'd get ICS' attorneys involved at that point, a C&D should probably suffice. They obviously are not respecting your servers limits and circumventing your techniques to prevent their abuse. I really had no idea they were pulling data that frequently, that seems like an overkill where once per day suffices just as well.

                                                                                                  WG
                                                                                                  I play with Google.

                                                                                                  Comment

                                                                                                  • AlienQ - BANNED FOR LIFE
                                                                                                    best designer on GFY
                                                                                                    • Mar 2003
                                                                                                    • 30307

                                                                                                    #50
                                                                                                    Is it OK to walk into a Library and say hey..

                                                                                                    "Ya mind if I use your paper and your ink and start copying all the books in this place?
                                                                                                    OK great, go ahead and start with shelf "A-B" move all the people away from that area and get all the books for that section. I dont care if people want to read this shit I am copying it and archiving it"

                                                                                                    Your going to get one pissed off librarian and the cops will be on your ass for copying books that do not belong to you.

                                                                                                    Comment

                                                                                                    Working...