Website scraping for CODE on page - GoFuckYourself.com

96ukssob · 10-30-2013, 04:26 PM

I'm trying to find where some of these old tracking codes are on a site so they can be removed. Essentially, it's tracking code in a javascript snippet placed on various pages.

Problem is there is over 800 pages. Most of the pages are just templates with content published, however some of them had hard coded text place in.

So I was wondering where can I find a magic tool that I can plug in the URL or site map, it craws every page and looks for pages were certain text appears in the source code.

tokmansta · 10-30-2013, 05:45 PM

If it is on your own server and it is running linux, you can do it with the find command

find . | xargs grep 'code-you-want-to-find' -sl

freecartoonporn · 10-30-2013, 07:25 PM

i guess the pages are static. and if those are on your server then you can use above linux command.

or just download all on windows and use notepad++

in notepad++
you can find specific text in files in specific directories and subdirectoris too.
and at the same time you can replace it too.

10-30-2013, 04:26 PM	#1
96ukssob So Fucking Banananananas Industry Role: Join Date: Mar 2003 Location: If I was in your ass you'd know it Posts: 12,991	Website scraping for CODE on page I'm trying to find where some of these old tracking codes are on a site so they can be removed. Essentially, it's tracking code in a javascript snippet placed on various pages. Problem is there is over 800 pages. Most of the pages are just templates with content published, however some of them had hard coded text place in. So I was wondering where can I find a magic tool that I can plug in the URL or site map, it craws every page and looks for pages were certain text appears in the source code. __________________ Email: Clicky on Me

10-30-2013, 07:25 PM	#3
freecartoonporn Confirmed User Industry Role: Join Date: Jan 2012 Location: NC Posts: 7,683	i guess the pages are static. and if those are on your server then you can use above linux command. or just download all on windows and use notepad++ in notepad++ you can find specific text in files in specific directories and subdirectoris too. and at the same time you can replace it too. __________________ SSD Cloud Server, VPS Server, Simple Cloud Hosting \| DigitalOcean

10-30-2013, 05:45 PM	#2
tokmansta Confirmed User Industry Role: Join Date: Jan 2013 Posts: 566	If it is on your own server and it is running linux, you can do it with the find command find . \| xargs grep 'code-you-want-to-find' -sl