Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums.

You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today!

If you have any problems with the registration process or your account login, please contact us.

Post New Thread Reply

Register GFY Rules Calendar
Go Back   GoFuckYourself.com - Adult Webmaster Forum > >
Coder wanted Coder wanted
Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed.

 
Thread Tools
Old 01-29-2020, 02:44 AM   #1
mce
Confirmed User
 
mce's Avatar
 
Industry Role:
Join Date: Jun 2012
Location: All Over
Posts: 3,917
Coder wanted
I need a simple script that scrapes Google for search results and verifies those pages (ie., checks each result if it fits my parameters)

The ones that pass are put in a .txt file I can download

My budget is < $200
__________________

Pay Virtual Assistants Based on RESULTS instead of TIME
STOP getting FUCKED IN THE ASS by your VA
mce is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 01-29-2020, 04:17 AM   #2
just a punk
So fuckin' bored
 
just a punk's Avatar
 
Industry Role:
Join Date: Jun 2003
Posts: 32,386
There are many free Google scraper scripts in the Net. The problem is that you (the script) will be sent to recaptcha after a few dozen requests...

You will end up emailing the coder who made that script with messages like: "Ahh! There is a bug! Your script stopped working within a hour! Fix it! Do something! The sky is falling!"

Anyways, good luck with that )
__________________
Obey the Cowgod
just a punk is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 01-29-2020, 04:35 AM   #3
k0nr4d
Confirmed User
 
k0nr4d's Avatar
 
Industry Role:
Join Date: Aug 2006
Location: Poland
Posts: 9,229
Quote:
Originally Posted by CyberSEO View Post
There are many free Google scraper scripts in the Net. The problem is that you (the script) will be sent to recaptcha after a few dozen requests...

You will end up emailing the coder who made that script with messages like: "Ahh! There is a bug! Your script stopped working within a hour! Fix it! Do something! The sky is falling!"

Anyways, good luck with that )
https://developers.google.com/custom-search/v1/overview
k0nr4d is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 01-29-2020, 04:57 AM   #4
Paul&John
Confirmed User
 
Paul&John's Avatar
 
Industry Role:
Join Date: Aug 2005
Location: YUROP
Posts: 8,614
Quote:
Originally Posted by k0nr4d View Post
Quote:
Custom Search JSON API provides 100 search queries per day for free. If you need more, you may sign up for billing in the API Console. Additional requests cost $5 per 1000 queries, up to 10k queries per day.
Not sure if the budget will be enough for this as well
__________________
Use coupon 'pauljohn' for a $1 discount at already super cheap NameSilo!
Anal Webcams | Kinky Trans Cams Live | Hotwife XXX Tube | Get your Proxies here
Paul&John is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 01-29-2020, 05:40 AM   #5
just a punk
So fuckin' bored
 
just a punk's Avatar
 
Industry Role:
Join Date: Jun 2003
Posts: 32,386
Quote:
Originally Posted by k0nr4d View Post
He said his budget is less than $200.
__________________
Obey the Cowgod
just a punk is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 01-29-2020, 06:12 AM   #6
Klen
 
Klen's Avatar
 
Industry Role:
Join Date: Aug 2006
Location: Little Vienna
Posts: 32,235
Quote:
Originally Posted by CyberSEO View Post
There are many free Google scraper scripts in the Net. The problem is that you (the script) will be sent to recaptcha after a few dozen requests...

You will end up emailing the coder who made that script with messages like: "Ahh! There is a bug! Your script stopped working within a hour! Fix it! Do something! The sky is falling!"

Anyways, good luck with that )
Yep, those fucks wants to limit almost everything of what they offer.
Klen is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 01-29-2020, 06:20 AM   #7
k0nr4d
Confirmed User
 
k0nr4d's Avatar
 
Industry Role:
Join Date: Aug 2006
Location: Poland
Posts: 9,229
Quote:
Originally Posted by CyberSEO View Post
He said his budget is less than $200.
Yeah, was just pointing out that there is another way to do it then scraping.
k0nr4d is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 01-29-2020, 07:59 AM   #8
ghjghj
So Fucking Banned
 
Join Date: Jun 2005
Posts: 3,770
Quote:
Originally Posted by mce View Post
a simple script
Quote:
Originally Posted by mce View Post
that scrapes Google
ghjghj is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 01-29-2020, 08:19 AM   #9
~Evilin~
🔥Adult Design Team
 
~Evilin~'s Avatar
 
Industry Role:
Join Date: Nov 2005
Posts: 2,083
Quote:
Originally Posted by CyberSEO View Post
You will end up emailing the coder who made that script with messages like: "Ahh! There is a bug! Your script stopped working within a hour! Fix it! Do something! The sky is falling!"

__________________

🔥AI Porn Graphic Design | Our mail: [email protected] | Telegram: @DenzikZT
~Evilin~ is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 01-29-2020, 09:24 AM   #10
EddyTheDog
Just Doing My Own Thing
 
EddyTheDog's Avatar
 
Industry Role:
Join Date: Jan 2011
Location: London, Spain, New Zealand, GFY - Not Croydon...
Posts: 25,248
Quote:
Originally Posted by k0nr4d View Post
Yeah, was just pointing out that there is another way to do it then scraping.
I think you could scrape the results from a CSE - I have never hit a recapture on those and I have been playing with a lot recently - Also, you get $300 credit when you open an account with Google - That would buy you a few searches with the JSON api - 60,000 in fact...

That would give you a lot of power over the results as well - You can perform all sorts of magic with it.....

Edit: Drop me a PM with more detail about what you want and if I think I can do it I will make you an offer - I could chuck in $50 worth of JSON api credit so you would get 10K searches - They would be highly customized searches so would work out better value than scraping standard Google results and without the recapture issue...

I could feed them into a DB and give you a way of pulling them in any format you wanted......
EddyTheDog is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 01-29-2020, 12:33 PM   #11
Klen
 
Klen's Avatar
 
Industry Role:
Join Date: Aug 2006
Location: Little Vienna
Posts: 32,235
Quote:
Originally Posted by EddyTheDog View Post
I think you could scrape the results from a CSE - I have never hit a recapture on those and I have been playing with a lot recently - Also, you get $300 credit when you open an account with Google - That would buy you a few searches with the JSON api - 60,000 in fact...

That would give you a lot of power over the results as well - You can perform all sorts of magic with it.....

Edit: Drop me a PM with more detail about what you want and if I think I can do it I will make you an offer - I could chuck in $50 worth of JSON api credit so you would get 10K searches - They would be highly customized searches so would work out better value than scraping standard Google results and without the recapture issue...

I could feed them into a DB and give you a way of pulling them in any format you wanted......
Technically, with proxy/browser mix it might be possible to override limit issue.
Klen is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 01-29-2020, 04:35 PM   #12
EddyTheDog
Just Doing My Own Thing
 
EddyTheDog's Avatar
 
Industry Role:
Join Date: Jan 2011
Location: London, Spain, New Zealand, GFY - Not Croydon...
Posts: 25,248
Quote:
Originally Posted by Klen View Post
Technically, with proxy/browser mix it might be possible to override limit issue.
Yeah - If he wants all in for <$200 though he would be pushing his luck...

I'm not sure what he needs - It might even be better to go for a 15 trial on SEMRush and grab as much data that he can - It depends on the info he is trying to pull.....

Edit: If he is looking for data about site positions in SERPS then he would have to use a scrape - The API results are different to normal search results - SEMRush would be good for that as well - I have a link for the 15 day trial somewhere, you don't normally get it...
EddyTheDog is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 01-29-2020, 04:53 PM   #13
CaptainHowdy
Too lazy to set a custom title
 
Industry Role:
Join Date: Dec 2004
Location: Happy in the dark.
Posts: 93,682
__________________
Vacares - Web Hosting, Domains, O365, Security & More - Paxum and BTC Accepted

Windows VPS now available
Great for TSS, Nifty Stats, remote work, virtual assistants, etc.
CaptainHowdy is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 01-29-2020, 05:30 PM   #14
ANAL PASTE
Confirmed User
 
Industry Role:
Join Date: Mar 2006
Location: Puget Sound, WA
Posts: 9,070
Lots of free scripts out there. If you know a bit of php use one of those.
__________________
SEE YOU IN VALHALLA, BRO
ANAL PASTE is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Post New Thread Reply
Go Back   GoFuckYourself.com - Adult Webmaster Forum > >
Coder wanted Coder wanted
« Previous Thread | Next Thread »

Bookmarks

Tags
pass, parameters, fits, .txt, budget, $200, download, file, scrapes, google, script, simple, search, results, checks, coder, pages, verifies, result



Advertising inquiries - marketing at gfy dot com

Contact Admin - Advertise - GFY Rules - Top

©2000-, AI Media Network Inc



Powered by vBulletin
Copyright © 2000- Jelsoft Enterprises Limited.