I need one..I have asked but cant find one that I can use...I want to copy the domain, directories, sub directories, etc...Is there such a tool out there?
-
-
Here I've been wasting my time autogenerating them. That's a damn good idea.
Pimp pimp... hooray! Pimp pimp... hooray! -
How are you auto gen'ing them? Im speaking about like tgp galleries:
mydomain.com/fucking/khkh1.html
thro
mydomain.com/fucking/khkh3986.html
See what Im trying to do? Every tool out there grabs the dir fucking and thats it, not its contents.Comment
-
I've just been generating the XML for CMS-driven sites. I'm not sure if you're just trying to mirror or do something a little smarter?
I can see some pretty cool uses for copying the entire sitemap structure and maybe grabbing partial pages instead of a full mirror. Not aware of any tool to do it unfortunately.Pimp pimp... hooray! Pimp pimp... hooray!Comment
-
google sitemap is good stuff, google loves you more then... depending on your site...
Comment
-
-
Im not looking to mirror, I'm just looking to list every page on the server.
Comment
-
Comment
-
Oooh I wouldn't go so far as to say that!
A lot of people hit with the "950" penalty had sitemaps, were not blackhat and are starting to wonder if having the sitemap was a bad idea ... I'm not convinced either way, but in my case and after LOTs of work, Google seems to completely ignore it and index this site the old-fashioned way.Comment
Comment