need a program to remove duplicate text
 

and no, its not for email lists.

have a bunch of abbreviations n' such that are probably duplicates

thx

find and replace in dreamweaver

sed 's/was/isnow/g' file1

Bk Replace Em

find and replace in homesite:D

it needs to be able to search for duplicates on it's own without me specifying text.

Maybe give this program a try if your on Windows ...


I just did a search and found it ... haven't used it myself.


http://www.crystalsoftware.com.au/te.../standard.html

installed and errored

i need something aswell as i dnt like having the same gallery descrption twice

bump, any1 help?

:thumbsup

From your descriptions, galleryseek and ozman84, it soumds like you want an application to automatically remove same words and/or phrases from two non-contiguous locations within a block of text.

Although any word processing app's spell check would remove (or flag for removal) two same contiguous words, the problem arises when you expect the app to recognize a threshold that signals a duplicate. For example,

test phrase one goes here.
...some more text goes here.
test phrase two goes here.

The 'test phrase' and 'goes here' are duplicates, but so is 'test' and 'phrase' and 'goes' and 'here'. Coding intelligence into an application to automatically recognize this threshold, plus which was intentional, would be a major undertaking. You're better off actually reading it yourself and making your own decision.

mate i cant be fucked reading 700+ gallerys thats y i wanted a program, im testing out the program that jim posted 4 me now:thumbsup

Sorry Oz, I was addressing the automation. Most apps, like ultra edit and abacre, will replace known values across multiple files.

Ultraedit

file > sort > advanced options > check the 'remove duplicates' box