Post New Thread Reply

Register GFY Rules Calendar Mark Forums Read
Go Back   GoFuckYourself.com - Adult Webmaster Forum > Simply Business > Webmaster Q & Fuckin' A
 
Thread Tools Display Modes
Old 06-26-2012, 05:53 AM   #1
JamesRocket
Registered User
 
Industry Role:
Join Date: Apr 2012
Posts: 2
Crawling Legality Issues

Hello all,

I was wondering how crawling is looked upon. Me and my business partner want to crawl some tube sites (so we can create our own database structure instead of using an existing one).

The only information we are after are the embed codes and meta information such as tags and duration etc.

Is this okay or frowned upon? ;)

Thanks in advance,

James
JamesRocket is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 06-26-2012, 06:05 AM   #2
AllAboutCams
Registered User
 
AllAboutCams's Avatar
 
Industry Role:
Join Date: Jul 2011
Location: AllAboutCams.com/traffic
Posts: 8,526
just do it
why would you ask ?
__________________
DMC at Allaboutcams dot com
Buy Traffic/Sell Traffic/Trade Traffic Plugrush.com
20% rev-share / $1 per free signup / $50 Broadcaster referral Chaturbate.com
Managed hosting with superior support AmeriNOC.com
AllAboutCams is online now   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 06-26-2012, 06:18 AM   #3
JamesRocket
Registered User
 
Industry Role:
Join Date: Apr 2012
Posts: 2
Quote:
Originally Posted by xxxupdate View Post
just do it
why would you ask ?
Because webmasters could easily block us. Maybe it's nice to ask first or whatever. So that's why I'm asking if it's an issue.
JamesRocket is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 06-26-2012, 06:59 AM   #4
Markul
Registered User
 
Markul's Avatar
 
Industry Role:
Join Date: Dec 2007
Location: The land that liberated porn
Posts: 5,867
Welcome to GFY and good luck
Markul is online now   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 06-26-2012, 02:37 PM   #5
RachelBlackG
Registered User
 
RachelBlackG's Avatar
 
Industry Role:
Join Date: Feb 2011
Location: Europe
Posts: 388
It should be ok. But do not copy titles and tags 1:1 to your website. Make it a little different. Duplicity is bad.
__________________
New to adult? Use Adult SEO, PlugRush ads or Mobile redirects to increase your revenue!
ICQ 347307229. registrace980/a/seznam/dot/cz
RachelBlackG is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 06-30-2012, 04:25 PM   #6
xenigo
Registered User
 
Industry Role:
Join Date: Jan 2001
Location: San Francisco, CA
Posts: 8,075
James... the term is "scraping".

Crawling is simply going from link to link finding web pages. Scraping is collecting information with the intent to republish.

Quora: What is the difference between crawling and scraping?
__________________
ICQ: ate too free juan ate oh fore
xenigo is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Post New Thread Reply
Go Back   GoFuckYourself.com - Adult Webmaster Forum > Simply Business > Webmaster Q & Fuckin' A

Bookmarks
Thread Tools
Display Modes




©2000-, AVN Media Network Inc



Powered by vBulletin
Copyright © 2000- Jelsoft Enterprises Limited.