Search engine developers, preferred search strategy format?
 

using a common exclude of: a,b,c,d,e,f,g,h,i,j,k,l,m,n,o,p,q,r,s,t,u,v,w,x,y, z,!,*,(,),-,_,+,=,\\,{,},[,],:,;,\",',<,>,,,.,?,/,of,the,or,and

preferred search strategy template format being title, keyword meta, des. meta, or all text? Des meta seems the best to me, but being as all my metas are empty, it'd be a massive undertaking to go back and code them all.

:eek7

welcome back :)

you guys are fucking idiots, if you did not have anything to say, why not just stay the fuck out ?

Nevermind, you guys wouldnt get it....

No clue what you wrote Amp.
WG

Nice to see you back Amp :thumbsup

You are writing a spider for your own site or to spider other sites too ?

If its your own site, consider many aspects . Meta is a really good way to do it. You should consider everything in a different order : Meta Title Total sentences and after that keywords.

the Adult.com internal Dev Site.

was afraid someone was gonna say this.... guess I already knew the answer, just didn't wanna hear it. Meta will take me a freakin' year to dial in..... but I guess in the long run, it'll be worth the effort.

mahalo bro.

Hi Amp! Welcome back!

Although I don't know what kind of backend you're working with, you may be able to skip dealing with the meta tags if you're interested in indexing the full text of the pages. I worked with a company setting up Links SQL with the spider plugin http://www.gossamer-threads.com/scri...ql/plugins.htm

Once everything was set up, it worked flawlessly. The setup was a pain in the ass but it was well worth it and we never had to go in and add metas.

i hear ya,... I'm using 'all text' right now, but it's pulling all kinds of weird shit that I don't really want showing up in the results output.... and I can exclude files and folders, but hell, that'll take just as long as working over the metas.... so I may as well go back and start typing and do it right.

www.freebooble.com we could adapt and sell you the technology ... it even got wrong keywords and other things. :P

Try the site it's really nice written . I still gotta fix bug with duplicate submission but for the rest the spider is almost done

it's cool... i got it managed. Just gonna stick with the 'all text' format and block certain foundation directories. It's all good.