| 
		
			
			
				
			
			
				 
			
			
				
			
		 | 
		
			
			
				 
			
				
			
		 | 
	||||
| 
				Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums.  You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today! If you have any problems with the registration process or your account login, please contact us.  | 
		
		 
		![]()  | 
	
		
			
  | 	
	
	
		
		|||||||
| Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed. | 
| 
		 | 
	Thread Tools | 
| 
			
			 | 
		#1 | 
| 
			
			
			
			 I help you SUCCEED 
			
		
			
				
			
			
			Industry Role:  
				Join Date: Nov 2003 
				Location: The Pearl of the Orient Seas 
				
				
					Posts: 32,195
				 
				
				
				
				 | 
	
	
	
	
		
			
			 
				
				Can anyone recommend a good DATA SCRAPER?
			 
			I am trying to scrape data from many different sites that feature different formats (some are in WP, most aren't) into one unified database. Is there a 'trainable' spider tool that can allow me to scrape many different sites easily? 
		
	
		
		
		
		
			
		
		
		
		
	
	 | 
| 
		 | 
	
	
	
		
                 
		
		
		
		
		
		
		
			
			
		
	 | 
| 
			
			 | 
		#2 | 
| 
			
			
			
			 Icq: 14420613 
			
		
			
				
			
			
			Industry Role:  
				Join Date: Mar 2001 
				Location: chicago 
				
				
					Posts: 15,432
				 
				
				
				
				 | 
	
	
	
	
		
		
		
		 no such thing exists everyone that does what your trying to do has custom work done. 
		
	
		
		
		
		
			
				__________________ 
		
		
		
		
	
	Need WebHosting ? Email me for some great deals [email protected]  | 
| 
		 | 
	
	
	
		
                 
		
		
		
		
		
		
		
			
			
		
	 | 
| 
			
			 | 
		#3 | |
| 
			
			
			
			 <&(©¿©)&> 
			
		
			
				
			
			
			Industry Role:  
				Join Date: Jul 2002 
				Location: Chicago 
				
				
					Posts: 47,882
				 
				
				
				
				 | 
	
	
	
	
		
		
		
		 Quote: 
	
 If you want some custom solution, icq: 33375924 or woj a_t wojfun dot com to discuss details... 
				__________________ 
		
		
		
		
	
	Custom Software Development, email: woj#at#wojfun#.#com to discuss details or skype: wojl2000 or gchat: wojfun or telegram: wojl2000 Affiliate program tools: Hosted Galleries Manager Banner Manager Video Manager ![]() Wordpress Affiliate Plugin Pic/Movie of the Day Fansign Generator Zip Manager  | 
|
| 
		 | 
	
	
	
		
                 
		
		
		
		
		
		
		
			
			
		
	 | 
| 
			
			 | 
		#4 | 
| 
			
			
			
			 I help you SUCCEED 
			
		
			
				
			
			
			Industry Role:  
				Join Date: Nov 2003 
				Location: The Pearl of the Orient Seas 
				
				
					Posts: 32,195
				 
				
				
				
				 | 
	
	
	
	
		
		
		
		 Thanks, Dan. I'll think about getting the custom scraper done. 
		
	
		
		
		
		
			
		
		
		
		
	
	 | 
| 
		 | 
	
	
	
		
                 
		
		
		
		
		
		
		
			
			
		
	 | 
| 
			
			 | 
		#5 | 
| 
			
			
			
			 HostMaria 
			
		
			
				
			
			
			Industry Role:  
				Join Date: Aug 2012 
				Location: UK 
				
				
					Posts: 440
				 
				
				
				
				 | 
	
	
	
	
		
		
		
		 .. well, WP stands for wordpress >> it isn't a text format at all :? 
		
	
		
		
		
		
			please define exactly what kind of information/data you are after... prices, reviews, locations or other? 
				__________________ 
		
		
		
		
	
	☕ 🖥️ 🌱 Founder: HostMaria.com and DomainSummit.com | Owner: DNForum.com and AcornDomains.co.uk  | 
| 
		 | 
	
	
	
		
                 
		
		
		
		
		
		
		
			
			
		
	 | 
| 
			
			 | 
		#6 | 
| 
			
			
			
			 Confirmed User 
			
		
			
			
			Join Date: Nov 2004 
				Location: scv 
				
				
					Posts: 2,299
				 
				
				
				
				 | 
	
	|
| 
		 | 
	
	
	
		
                 
		
		
		
		
		
		
		
			
			
		
	 | 
| 
			
			 | 
		#7 | 
| 
			
			
			
			 So Fucking Stiff! 
			
		
			
				
			
			
			Industry Role:  
				Join Date: Oct 2005 
				
				
				
					Posts: 493
				 
				
				
				
				 | 
	
	
	
	
		
		
		
		
		
	
		
		
		
		
			 
				__________________ 
		
		
		
		
	
	ICQ 208807506  | 
| 
		 | 
	
	
	
		
                 
		
		
		
		
		
		
		
			
			
		
	 | 
| 
			
			 | 
		#8 | 
| 
			
			
			
			 Confirmed User 
			
		
			
				
			
			
			Industry Role:  
				Join Date: Jan 2012 
				Location: NC 
				
				
					Posts: 7,683
				 
				
				
				
				 | 
	
	
	
	
		
		
		
		 you can start with php  
		
	
		
		
		
		
			there are scrapers for dummies but their cost are high like 1K-2K you just point and scrape .... but if u are looking for something special then custom made is your answer. i created couple of scrapers in the past. with php and http://simplehtmldom.sourceforge.net/ hope this helps. 
				__________________ 
		
		
		
		
	
	SSD Cloud Server, VPS Server, Simple Cloud Hosting | DigitalOcean 
			 | 
| 
		 | 
	
	
	
		
                 
		
		
		
		
		
		
		
			
			
		
	 |