AWE whitelabel & robots.txt

Collapse
X
Collapse
 
  • Page of 1
  • Time
  • Show
Clear All
new posts
Previous template Next
  • pemevus
    Confirmed User
    • Oct 2002
    • 32
    #1

    Business AWE whitelabel & robots.txt

    Hi guys,
    is anyone here who is still using whitelabel site by AWE?
    Now they are blocking googlebot in robots.txt:

    Code:
    User-agent: Googlebot
Disallow: /

User-agent: *
Allow: /
Crawl-delay: 1
    Support doesnt replay me form more than 1 year...
    Tags: awe, googlebot, robots.txt, user-agent, whitelabel
    • bns666
      Confirmed Fetishist
      • Mar 2005
      • 11554
      #2
      it's like that for a long time.
      ⭐ CAM SODA ⭐ STRIPCHAT ⭐
      ⭐ CHATURBATE ⭐ X LOVE CAM ⭐

        Comment

        • Denny
          Too lazy to set a custom title
          • Feb 2005
          • 17393
          #3
          Originally posted by bns666
          it's like that for a long time.

            Comment

            • sarettah
              see you later, I'm gone
              • Oct 2002
              • 14297
              #4
              Bump for biz
              All cookies cleared!

                Comment

                • TFCash
                  Confirmed User
                  • Apr 2001
                  • 1738
                  #5
                  Whitelabels are best used if you have your own source of traffic to send to them. If you want to get SE traffic to a site then your better off using a package that let's you build pages based on the Cam's and then direct traffic into the main sites. User blackmonsters here on gfy makes a WP plugin that pulls from a number of cam shops and let's you create pages for the girls that are online.

                  EconfirmPro

                  good luck
                  TeenFlood.com Online since 1998.

                  TFCash KissMeGirl
                  VirginRiches MondoBucks

                  tim at tfcash.com or submit a ticket at our HelpDesk

                    Comment

                    • Freedoom
                      Confirmed User
                      • Feb 2006
                      • 2811
                      #6
                      I related this issue to them a long time ago, and they replied to me:

                      They said they tried to give several options in the past to Webmasters so that we can customize our Whitelabels to have unique content on the site so that Google doesn't consider them as having thin content. Despite the efforts, Google started penalizing the Whitelabels, and they even started to penalize their brand sites.

                      So to avoid further penalties for the WhiteLabels and their sites alike, they canonicalized them to Livesex.com. They said that this way they are not indexed, but they also avoid being penalized.

                      Same goes not only for the WhiteLabels but to their sister sites, too (MyCams.com, LivePrivates, etc.).

                      Having more canonical links to Livesex.com might have been the side effect, but it was not the goal.

                      This was what they told me
                      List Of Sex Cams

                        Comment

                        • xxx6live
                          Confirmed User
                          • Dec 2012
                          • 279
                          #7
                          Yeah,

                          and exactly therefore (the canonical) you should block it via robots.txt so it at least ranks for its domain name.

                          If you block it in robots.txt Google does not does not see the canonical. So it will rank for the domain name (but nothing else).

                          There is a checkbox in the "SEO" section saying "Allow robots" - remove it and it is disallowed via robots.txt.
                          .

                            Comment

                            • incredibleworkethic
                              Confirmed User
                              • Sep 2009
                              • 2302
                              #8
                              Originally posted by xxx6live
                              Yeah,

                              and exactly therefore (the canonical) you should block it via robots.txt so it at least ranks for its domain name.

                              If you block it in robots.txt Google does not does not see the canonical. So it will rank for the domain name (but nothing else).

                              There is a checkbox in the "SEO" section saying "Allow robots" - remove it and it is disallowed via robots.txt.
                              .
                              I have clicked allow robots and it was working before. I have been in contact with support they say they are having an issue and are working on it.

                              Not sure why it's taking so long to remove a line of text but it is.

                                Comment

                                • RyuLion
                                  ClubDomCash.com
                                  • Mar 2003
                                  • 32369
                                  #9
                                  Originally posted by TFCash
                                  Whitelabels are best used if you have your own source of traffic to send to them. If you want to get SE traffic to a site then your better off using a package that let's you build pages based on the Cam's and then direct traffic into the main sites. User blackmonsters here on gfy makes a WP plugin that pulls from a number of cam shops and let's you create pages for the girls that are online.

                                  EconfirmPro

                                  good luck

                                  Adult Biz Consultant A tech head since 1995
                                  Affiliate Support: Chaturbate | CCBill Live

                                    Comment

                                    Previous template Next
                                    Working...