need a program to remove duplicate text

Collapse
X
Collapse
 
  • Page of 1
  • Time
  • Show
Clear All
new posts
Previous template Next
  • galleryseek
    Confirmed User
    • Mar 2002
    • 8234
    #1

    need a program to remove duplicate text

    and no, its not for email lists.

    have a bunch of abbreviations n' such that are probably duplicates

    thx
    Tags: None
    • lagwagon
      Confirmed User
      • Jul 2001
      • 8464
      #2
      find and replace in dreamweaver

      FTVGirls - FTVMilfs - DanielleFTV

        Comment

        • fsfaz
          Confirmed User
          • Apr 2003
          • 747
          #3
          sed 's/was/isnow/g' file1

            Comment

            • Shooter
              Confirmed User
              • Apr 2001
              • 2842
              #4
              Bk Replace Em

                Comment

                • johnbosh
                  Confirmed User
                  • Aug 2002
                  • 8965
                  #5
                  find and replace in homesite:D

                    Comment

                    • galleryseek
                      Confirmed User
                      • Mar 2002
                      • 8234
                      #6
                      Originally posted by lagwagon
                      find and replace in dreamweaver
                      it needs to be able to search for duplicates on it's own without me specifying text.

                        Comment

                        • fsfaz
                          Confirmed User
                          • Apr 2003
                          • 747
                          #7
                          Maybe give this program a try if your on Windows ...


                          I just did a search and found it ... haven't used it myself.


                          http://www.crystalsoftware.com.au/te.../standard.html

                            Comment

                            • galleryseek
                              Confirmed User
                              • Mar 2002
                              • 8234
                              #8
                              Originally posted by fsfaz
                              Maybe give this program a try if your on Windows ...


                              I just did a search and found it ... haven't used it myself.


                              http://www.crystalsoftware.com.au/te.../standard.html
                              installed and errored

                                Comment

                                • OzMan84
                                  Confirmed User
                                  • Nov 2003
                                  • 4740
                                  #9
                                  i need something aswell as i dnt like having the same gallery descrption twice
                                  XferClick - 300,000 UV daily and growing quickly. Majority US, EU, CA and AU traffic. Contact me for more information
                                  ICQ: 304568058

                                    Comment

                                    • OzMan84
                                      Confirmed User
                                      • Nov 2003
                                      • 4740
                                      #10
                                      bump, any1 help?
                                      XferClick - 300,000 UV daily and growing quickly. Majority US, EU, CA and AU traffic. Contact me for more information
                                      ICQ: 304568058

                                        Comment

                                        • xxxoutsourcing
                                          Confirmed User
                                          • Oct 2003
                                          • 3888
                                          #11
                                          Originally posted by lagwagon
                                          find and replace in dreamweaver


                                          xxxoutsourcing.com
                                          ICQ:119936 | Aim:xxxoutsourcing | MSN:msn@ xxxoutsourcing.com | Yahoo:xxxoutsourcing
                                          Submitters, Designers, Programmers, Cartoonist, Creative Writers, Video & Photo Editors
                                          Convert your Paysite into a cartoon site convert2toons.com

                                            Comment

                                            • Coyote
                                              Drinker of Scotch
                                              • May 2003
                                              • 236
                                              #12
                                              From your descriptions, galleryseek and ozman84, it soumds like you want an application to automatically remove same words and/or phrases from two non-contiguous locations within a block of text.

                                              Although any word processing app's spell check would remove (or flag for removal) two same contiguous words, the problem arises when you expect the app to recognize a threshold that signals a duplicate. For example,

                                              test phrase one goes here.
                                              ...some more text goes here.
                                              test phrase two goes here.

                                              The 'test phrase' and 'goes here' are duplicates, but so is 'test' and 'phrase' and 'goes' and 'here'. Coding intelligence into an application to automatically recognize this threshold, plus which was intentional, would be a major undertaking. You're better off actually reading it yourself and making your own decision.
                                              Ethernet Servers

                                              Quote:
                                              CS: Linux can pretty much run on a potato. Which is a GOOD thing.

                                                Comment

                                                • jimthefiend
                                                  So Fucking Banned
                                                  • Oct 2003
                                                  • 18889
                                                  #13
                                                  http://www.abacre.com/afr/index.htm

                                                    Comment

                                                    • OzMan84
                                                      Confirmed User
                                                      • Nov 2003
                                                      • 4740
                                                      #14
                                                      mate i cant be fucked reading 700+ gallerys thats y i wanted a program, im testing out the program that jim posted 4 me now
                                                      XferClick - 300,000 UV daily and growing quickly. Majority US, EU, CA and AU traffic. Contact me for more information
                                                      ICQ: 304568058

                                                        Comment

                                                        • Coyote
                                                          Drinker of Scotch
                                                          • May 2003
                                                          • 236
                                                          #15
                                                          Originally posted by galleryseek


                                                          it needs to be able to search for duplicates on it's own without me specifying text.

                                                          Sorry Oz, I was addressing the automation. Most apps, like ultra edit and abacre, will replace known values across multiple files.
                                                          Ethernet Servers

                                                          Quote:
                                                          CS: Linux can pretty much run on a potato. Which is a GOOD thing.

                                                            Comment

                                                            • crash
                                                              Registered User
                                                              • Jul 2002
                                                              • 97
                                                              #16
                                                              Ultraedit

                                                              file > sort > advanced options > check the 'remove duplicates' box
                                                              My Adult Banners The Webs Leading Adult Banner Exchange Network

                                                                Comment

                                                                Previous template Next
                                                                Working...