EQEmulator Forums

EQEmulator Forums (https://www.eqemulator.org/forums/index.php)
-   Development::Development (https://www.eqemulator.org/forums/forumdisplay.php?f=590)
-   -   EQEmu Blob to Database Conversion (https://www.eqemulator.org/forums/showthread.php?t=38730)

Akkadius 09-06-2014 03:22 PM

EQEmu Blob to Database Conversion
 
I'm streaming C coding while I'm working on converting the entire character blob over to actual database tables.

I've been working on this over the past few weeks and am about 95% done, however if anyone is interested I have a stream up.

Some people have asked for it in the past so I just put it up while I'm working on stuff anyways.

www.twitch.tv/akkadius

Enjoy.

To give an idea why I am converting the character blob to database tables, 1) we've been wanting to do this forever for many reasons.

1) It will increase overall code performance more than 10 fold with all of the inefficient calls for saving and loading that we do in the database
2) We are saving a lot of blank data, for example EZ's database of characters is 2.6GB, after a mock convert I end up storing approximately 600MB in total in data broken out into individual tables.
3) The speed increase is phenominal as we are not saving everything every single time that a character has done a single little action.
- Whenever a character ups a skill point or spams it, everything is saved (skills/languages/aa/spells/character data/etc)
- Same thing goes for AA's, whenever a character loots or moves coins
- Everytime these save actions are spammed, the character_ table is locked, which leaves an opportunity for hangs to occur at any process because it is waiting for the character_ table to be opened. This is in the end, very inefficient.

GeorgeS 09-28-2014 01:36 AM

I'm updating my tools, and see character_ table has changed..
Do you have any info what character_ binary data is converted to?
(or a tool would help - if you have one)

Thanks
GeorgeS

Akkadius 09-28-2014 01:41 AM

Quote:

Originally Posted by GeorgeS (Post 234271)
I'm updating my tools, and see character_ table has changed..
Do you have any info what character_ binary data is converted to?
(or a tool would help - if you have one)

Thanks
GeorgeS

Not sure what you mean, but these are the tables that are created in the auto conversion from blob convert, in the repack you setup you should be able to view the table schema accordingly:

`character_skills`
`character_languages`
`character_bind`
`character_alternate_abilities`
`character_currency`
`character_data`
`character_spells`
`character_memmed_spells`
`character_disciplines`
`character_material`
`character_tribute`
`character_bandolier`
`character_inspect_messages`
`character_leadership_abilities`

GeorgeS 09-28-2014 10:24 AM

Thanks, I figured it out eventually, but it's a large task to convert my characters over to the new tables. Is there a tool to do this out there?

GeorgeS

Kayen 09-28-2014 10:33 AM

It coverts it automatically when you start your server for the first time while running the current source code.

Just back your database up first just in case.

Nibiuno 11-15-2014 10:42 AM

Have you tested mercenaries after a conversion from the character blob system to the database tables? I can't seem to get them to work post conversion, but if I do not convert, they work fine.


All times are GMT -4. The time now is 12:05 AM.

Powered by vBulletin®, Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.