Technical Suggestion to GFY for board problems - GoFuckYourself.com - Adult Webmaster Forum

X

Varius

Confirmed User

Join Date: Jun 2004

Posts: 6890
Share

Post
#1

Technical Suggestion to GFY for board problems

10-24-2004, 08:34 PM

I'm not familar with the latest version of VB, but since it does use MySQL you might find less problems if you alter the tables (or atleast the huge ones affected by the 5 million+ posts) from INNODB to InnoDB.

InnoDB is better suited to handle millions of rows than INNODB is. From experience, usually after 1-2 million INNODB starts to choke and have corruption problems.

InnoDB seems to be fine for 10-15 million rows atleast.

Skype variuscr - Email varius AT gmail
Tags: None
Juicy D. Links

So Fucking Banned

Join Date: Apr 2001

Posts: 122992
Share

Post
#2

10-24-2004, 08:54 PM

Keith my dick gets hard when you talk about Mysql like that
Comment
Lensman

GFY Chaperone

Join Date: Jan 2001

Posts: 9846
Share

Post
#3

10-24-2004, 09:01 PM

I'll forward this to our tech guys.
Comment
Varius

Confirmed User

Join Date: Jun 2004

Posts: 6890
Share

Post
#4

10-24-2004, 09:01 PM

Originally posted by juicylinks
Keith my dick gets hard when you talk about Mysql like that

Hehe wait until you hear my experience with the Purple Elephant baby (PostgreSQL)

I once called the developer of it at his home and convinced him we had met at a show and he gave me this number if I ever had issues with PostgreSQL...I got him consulting and helping us with some performance issues for over a month for free

Skype variuscr - Email varius AT gmail
Comment
Varius

Confirmed User

Join Date: Jun 2004

Posts: 6890
Share

Post
#5

10-24-2004, 09:03 PM

Originally posted by Lensman
I'll forward this to our tech guys.

Cool, if that is indeed the problem (MYISAM table type for the size), this should fix it.

Skype variuscr - Email varius AT gmail
Comment
KRL

Entrepreneur

Join Date: Oct 2002

Posts: 31429
Share

Post
#6

10-24-2004, 09:06 PM

Originally posted by juicylinks
Keith my dick gets hard when you talk about Mysql like that

If you would like to develop your domains, you can lease inexpensive foreign labor
from the leaders in the field at iWebmasters.com TO LOWER YOUR COSTS AND INCREASE YOUR PRODUCTION!
*** *** *** *** *** *** *** *** *** *** *** ***
Domains Adult News KRL's Newsletter Biz Tips Just Listed Domains
Comment
Varius

Confirmed User

Join Date: Jun 2004

Posts: 6890
Share

Post
#7

10-24-2004, 09:25 PM

Originally posted by KRL

I have a plan to find out the truth! I will implant two hot costa rican girls in his hotel room and see what they report

Skype variuscr - Email varius AT gmail
Comment
Steen2

Confirmed User

Join Date: Feb 2004

Posts: 7662
Share

Post
#8

10-24-2004, 09:35 PM

Originally posted by juicylinks
Keith my dick gets hard when you talk about Mysql like that

Hilarious.

ICQ: 2262.73945
Comment
Rochard

Jägermeister Test Pilot

Join Date: Dec 2001

Posts: 75733
Share

Post
#9

10-24-2004, 10:07 PM

Or Lensman could feed the hampsters more often?

Herschel Savage
Brooklyn, NY
Comment
Varius

Confirmed User

Join Date: Jun 2004

Posts: 6890
Share

Post
#10

10-24-2004, 10:20 PM

Originally posted by RocHard
Or Lensman could feed the hampsters more often?

Maybe they were over-fed and are too tired to run in the wheels powering the board

Skype variuscr - Email varius AT gmail
Comment
xclusive

Too lazy to set a custom title

Join Date: Apr 2004

Posts: 35218
Share

Post
#11

10-24-2004, 10:23 PM

Good stuff Various you sure know your stuff and can't wait to see your costarican honies at Internext...Better not be any Tranny surprise because I will do stuff but not be able to brag about it...

I support MediumPimpin.com / Shemp's Outlawtgp.com /
Comment
Varius

Confirmed User

Join Date: Jun 2004

Posts: 6890
Share

Post
#12

10-24-2004, 10:26 PM

Originally posted by xclusive
Good stuff Various you sure know your stuff and can't wait to see your costarican honies at Internext...Better not be any Tranny surprise because I will do stuff but not be able to brag about it...

No no....we'll thoroughly screen all attendees first-hand beforehand

Err incase my gf reads this, I mean some guy at our office will test them beforehand

Skype variuscr - Email varius AT gmail
Comment
phpslave

Confirmed User

Join Date: Jan 2003

Posts: 548
Share

Post
#13

10-24-2004, 10:28 PM

Originally posted by Varius
I'm not familar with the latest version of VB, but since it does use MySQL you might find less problems if you alter the tables (or atleast the huge ones affected by the 5 million+ posts) from INNODB to InnoDB.

InnoDB is better suited to handle millions of rows than INNODB is. From experience, usually after 1-2 million INNODB starts to choke and have corruption problems.

InnoDB seems to be fine for 10-15 million rows atleast.

row locking instead of table locking could add some benifits, i agree. As long as the overhead of transactions and foreign keys doesn't out weigh those benifits. With InnoDB you do take a preformance hit, but that hit depending on how your tables are done could be well worth it.

As far as INNODB, and 100 million rows plus (sorry 1-2 million) i haven't had any problems with corruption problems in some time. Only when some jackoff has kill -9 my server or when i had hardware failing on the machine. I don't think we have had a table corruption this year at all, however we used to have them all the time about 2 years ago when what we really needed was more servers to help with the load. Simple lookups are usually best handled with INNODB, something with high inserts and lookups InnoDB could be a much better solution.

If nothing else it's something that could be tried and if it didn't work move it back over. (if down time is an option, there could be a way of doing it w/out any down time) It is worth looking into.

Sorry it's late and i'm kinda rambling.

just have a question, have you ever ran into replication problems with InnoDB that you didn't get with INNODB?

Last edited by phpslave; 10-24-2004, 10:32 PM.
Comment
Varius

Confirmed User

Join Date: Jun 2004

Posts: 6890
Share

Post
#14

10-24-2004, 10:33 PM

Originally posted by phpslave
row locking instead of table locking could add some benifits, i agree. As long as the overhead of transactions and foreign keys doesn't out weigh those benifits. With InnoDB you do take a preformance hit, but that hit depending on how your tables are done could be well worth it.

As far as INNODB, and 100 million rows plus (sorry 1-2 million) i haven't had any problems with corruption problems in some time. Only when some jackoff has kill -9 my server or when i had hardware failing on the machine. I don't think we have had a table corruption this year at all, however we used to have them all the time about 2 years ago when what we really needed was more servers to help with the load. Simple lookups are usually best handled with INNODB, something with high inserts and lookups InnoDB could be a much better solution.

If nothing else it's something that could be tried and if it didn't work move it back over. It is worth looking into.

Sorry it's late and i'm kinda rambling.

just have a question, have you ever ran into replication problems with InnoDB that you didn't get with INNODB?

Not as of yet, however I've had native mysql replication problems in the past using INNODB. I'm waiting to be able to use MySQL's new clustering software, that way I can have asynchronous replication.

In GFY's case, I assume they are doing massive inserts (every post), while tons of selects are being done on the same table, which is why I recommend trying InnoDB out.

Another option might be to run nightly optimizes on their tables if they don't already do so; I know when we had corruption problems, after having it run daily we had no more problems.

Skype variuscr - Email varius AT gmail
Comment
phpslave

Confirmed User

Join Date: Jan 2003

Posts: 548
Share

Post
#15

10-24-2004, 10:41 PM

Originally posted by Varius
Not as of yet, however I've had native mysql replication problems in the past using INNODB. I'm waiting to be able to use MySQL's new clustering software, that way I can have asynchronous replication.

In GFY's case, I assume they are doing massive inserts (every post), while tons of selects are being done on the same table, which is why I recommend trying InnoDB out.

Another option might be to run nightly optimizes on their tables if they don't already do so; I know when we had corruption problems, after having it run daily we had no more problems.

Yah an upgrade to 3.23.59 (replication fix in this 3 version) stoped or replication problems we used to have, since then we've upgraded had some problems on some earlier 4.0.x versions but 4.0.20 seems to be working fine.

I just didn't know if because of the way the binlogs for replication work and the differences in InnoDB and INNODB if you've seen any issue with this.

I do agree though if there are massive inserts on the same table all the selects are coming from (as we suspect) this could be a viable option.
Comment
phpslave

Confirmed User

Join Date: Jan 2003

Posts: 548
Share

Post
#16

10-24-2004, 10:41 PM

I"m assuming these tables are keyed right
Comment
Marcus Aurelius

No Refunds Issued.

Join Date: Apr 2003

Posts: 14809
Share

Post
#17

10-24-2004, 10:42 PM

Originally posted by RocHard
Or Lensman could feed the hampsters more often?

I have top secret footage from inside the adult.com offices of the server control station GFY is ran from....an agent lost his life to bring you these...enjoy...
Comment
Varius

Confirmed User

Join Date: Jun 2004

Posts: 6890
Share

Post
#18

10-24-2004, 10:43 PM

Originally posted by phpslave
Yah an upgrade to 3.23.59 (replication fix in this 3 version) stoped or replication problems we used to have, since then we've upgraded had some problems on some earlier 4.0.x versions but 4.0.20 seems to be working fine.

I just didn't know if because of the way the binlogs for replication work and the differences in InnoDB and INNODB if you've seen any issue with this.

I do agree though if there are massive inserts on the same table all the selects are coming from (as we suspect) this could be a viable option.

I think most of my replication problems were in 4.0.13, we're now using 4.0.20 and it's been stable.

I'm using 4.1.5-gamma for our demo servers, for the new IwantU (so I can take advantage of subselects)....have yet to test if that one has any replication or innodb issues....hopefully not

Skype variuscr - Email varius AT gmail
Comment
Varius

Confirmed User

Join Date: Jun 2004

Posts: 6890
Share

Post
#19

10-24-2004, 10:44 PM

Originally posted by phpslave
I"m assuming these tables are keyed right

No idea, haven't had a look at VB's code/sql in years....but I'd definately hope so for their sake

Skype variuscr - Email varius AT gmail
Comment
Varius

Confirmed User

Join Date: Jun 2004

Posts: 6890
Share

Post
#20

10-24-2004, 10:46 PM

BTW, phpslave, are you experienced with references, constraints, multi-field indexes and such in MySQL?

I'm looking for someone to analyze my new DB structure, but so far people who told me they'd give me quotes haven't gotten me any yet......

If you're interested and qualified, hit me up on ICQ 38373031 or email [email protected]

Skype variuscr - Email varius AT gmail
Comment
phpslave

Confirmed User

Join Date: Jan 2003

Posts: 548
Share

Post
#21

10-24-2004, 10:53 PM

Originally posted by Varius
BTW, phpslave, are you experienced with references, constraints, multi-field indexes and such in MySQL?

I'm looking for someone to analyze my new DB structure, but so far people who told me they'd give me quotes haven't gotten me any yet......

If you're interested and qualified, hit me up on ICQ 38373031 or email [email protected]

I'll hit you up tomorrow I'm heading off to bed now, or you can hit me up tomorrow icq: 13792004

and we can see if I can help, no guarantees, if nothing else maybe you can help me
Comment

Previous template Next

Working...