Auto update conversaion fail.

[Trouble]

Okay any help would be greatly appreciated.
Keep in mind this database is very very old so that might be my problem to begin with. I am trying to update my server to the latest rev which hasn't been done in close to 3 years?
I have the current rev working with just a blank database none of my servers items or accounts or what have you. (My server's database is backed up so I'm not worried about screwing it up just want to make it work with this revision and of course keep all my current characters, mobs, items, and all that jazz.)
When I decided to try and update my database to work with this new rev these are the errors I get after it tries to convert my database to the correct version.
Again any help would be very appreciated thanks in advanced.

c:\EQ\eqdb>shared_memory.exe

c:\EQ\eqdb>world.exe
[World Server] Loading server configuration..
[World Server] CURRENT_VERSION: 1.1.3
[World Server] Added loginserver login.eqemulator.net:5998
[World Server] Connecting to MySQL...
[World Server] HTTP world service disabled.
[World Server] Checking Database Conversions..


::: Legacy Character Data Binary Blob Storage Detected...
----------------------------------------------------------

 Database currently has character data being stored via
  the legacy character storage method and will proceed with converting...

 It is recommended that you backup your database
  before continuing the automatic conversion process...

----------------------------------------------------------

Press ENTER to continue.....


Running character binary blob to database conversion...
Number of Characters in Database: 16547
Table: `character_data` doesn't exist... creating... done...
Table: `character_currency` doesn't exist... creating... done...
Table: `character_alternate_abilities` doesn't exist... creating... done...
Table: `character_bind` doesn't exist... creating... done...
Table: `character_languages` doesn't exist... creating... done...
Table: `character_skills` doesn't exist... creating... done...
Table: `character_spells` doesn't exist... creating... done...
Table: `character_memmed_spells` doesn't exist... creating... done...
Table: `character_disciplines` doesn't exist... creating... done...
Table: `character_material` doesn't exist... creating... done...
Table: `character_tribute` doesn't exist... creating... done...
Table: `character_bandolier` doesn't exist... creating... done...
Table: `character_potionbelt` doesn't exist... creating... done...
Table: `character_inspect_messages` doesn't exist... creating... done...
Table: `character_leadership_abilities` doesn't exist... creating... done...
Starting conversion...

[Crash] EXCEPTION_ACCESS_VIOLATION
[Crash] SymInit: Symbol-SearchPath: '.;c:\EQ\eqdb;c:\EQ\eqdb;C:\Windows;C:\Windo
ws\system32;SRV*C:\websymbols*http://msdl.microsoft.com/download/symbols;', symO
ptions: 530, UserName: 'Blank'
[Crash] OS-Version: 6.1.7601 (Service Pack 1) 0x100-0x1
[Crash] c:\EQ\eqdb\world.exe:world.exe (01310000), size: 4943872 (result: 0), Sy
mType: 'PDB', PDB: 'c:\EQ\eqdb\world.exe'
[Crash] C:\Windows\SysWOW64\ntdll.dll:ntdll.dll (77290000), size: 1572864 (resul
t: 0), SymType: '-exported-', PDB: 'C:\Windows\SysWOW64\ntdll.dll', fileVersion:
 6.1.7601.19135
[Crash] C:\Windows\syswow64\kernel32.dll:kernel32.dll (753D0000), size: 1114112
(result: 0), SymType: '-exported-', PDB: 'C:\Windows\syswow64\kernel32.dll', fil
eVersion: 6.1.7601.19135
[Crash] C:\Windows\syswow64\KERNELBASE.dll:KERNELBASE.dll (76750000), size: 2908
16 (result: 0), SymType: '-exported-', PDB: 'C:\Windows\syswow64\KERNELBASE.dll'
, fileVersion: 6.1.7601.19135
[Crash] C:\Perl\bin\perl512.dll:perl512.dll (28000000), size: 1273856 (result: 0
), SymType: '-exported-', PDB: 'C:\Perl\bin\perl512.dll', fileVersion: 5.12.3.12
04
[Crash] C:\Windows\syswow64\USER32.dll:USER32.dll (74DC0000), size: 1048576 (res
ult: 0), SymType: '-exported-', PDB: 'C:\Windows\syswow64\USER32.dll', fileVersi
on: 6.1.7601.19061
[Crash] C:\Windows\syswow64\GDI32.dll:GDI32.dll (75210000), size: 589824 (result
: 0), SymType: '-exported-', PDB: 'C:\Windows\syswow64\GDI32.dll', fileVersion:
6.1.7601.19091
[Crash] C:\Windows\syswow64\LPK.dll:LPK.dll (74D50000), size: 40960 (result: 0),
 SymType: '-exported-', PDB: 'C:\Windows\syswow64\LPK.dll', fileVersion: 6.1.760
1.18985
[Crash] C:\Windows\syswow64\USP10.dll:USP10.dll (766A0000), size: 643072 (result
: 0), SymType: '-exported-', PDB: 'C:\Windows\syswow64\USP10.dll', fileVersion:
1.626.7601.19054
[Crash] C:\Windows\syswow64\msvcrt.dll:msvcrt.dll (74F50000), size: 704512 (resu
lt: 0), SymType: '-exported-', PDB: 'C:\Windows\syswow64\msvcrt.dll', fileVersio
n: 7.0.7601.17744
[Crash] C:\Windows\syswow64\ADVAPI32.dll:ADVAPI32.dll (74CA0000), size: 659456 (
result: 0), SymType: '-exported-', PDB: 'C:\Windows\syswow64\ADVAPI32.dll', file
Version: 6.1.7601.19135
[Crash] C:\Windows\SysWOW64\sechost.dll:sechost.dll (767A0000), size: 102400 (re
sult: 0), SymType: '-exported-', PDB: 'C:\Windows\SysWOW64\sechost.dll', fileVer
sion: 6.1.7601.18869
[Crash] C:\Windows\syswow64\RPCRT4.dll:RPCRT4.dll (76CA0000), size: 983040 (resu
lt: 0), SymType: '-exported-', PDB: 'C:\Windows\syswow64\RPCRT4.dll', fileVersio
n: 6.1.7601.19135
[Crash] C:\Windows\syswow64\SspiCli.dll:SspiCli.dll (74BE0000), size: 393216 (re
sult: 0), SymType: '-exported-', PDB: 'C:\Windows\syswow64\SspiCli.dll', fileVer
sion: 6.1.7601.19135
[Crash] C:\Windows\syswow64\CRYPTBASE.dll:CRYPTBASE.dll (74BD0000), size: 49152
(result: 0), SymType: '-exported-', PDB: 'C:\Windows\syswow64\CRYPTBASE.dll', fi
leVersion: 6.1.7601.19135
[Crash] C:\Windows\WinSxS\x86_microsoft.windows.common-controls_6595b64144ccf1df
_5.82.7601.18837_none_ec86b8d6858ec0bc\COMCTL32.dll:COMCTL32.dll (70270000), siz
e: 540672 (result: 0), SymType: '-exported-', PDB: 'C:\Windows\WinSxS\x86_micros
oft.windows.common-controls_6595b64144ccf1df_5.82.7601.18837_none_ec86b8d6858ec0
bc\COMCTL32.dll', fileVersion: 5.82.7601.18837
[Crash] c:\EQ\eqdb\LIBMYSQL.dll:LIBMYSQL.dll (6FAE0000), size: 2924544 (result:
0), SymType: '-exported-', PDB: 'c:\EQ\eqdb\LIBMYSQL.dll'
[Crash] C:\Windows\syswow64\WS2_32.dll:WS2_32.dll (76940000), size: 217088 (resu
lt: 0), SymType: '-exported-', PDB: 'C:\Windows\syswow64\WS2_32.dll', fileVersio
n: 6.1.7601.17514
[Crash] C:\Windows\syswow64\NSI.dll:NSI.dll (76DF0000), size: 24576 (result: 0),
 SymType: '-exported-', PDB: 'C:\Windows\syswow64\NSI.dll', fileVersion: 6.1.760
0.16385
[Crash] c:\EQ\eqdb\zlib1.dll:zlib1.dll (62E80000), size: 139264 (result: 0), Sym
Type: '-exported-', PDB: 'c:\EQ\eqdb\zlib1.dll', fileVersion: 1.2.8.0
[Crash] C:\Windows\system32\VERSION.dll:VERSION.dll (74BB0000), size: 36864 (res
ult: 0), SymType: '-exported-', PDB: 'C:\Windows\system32\VERSION.dll', fileVers
ion: 6.1.7600.16385
[Crash] C:\Windows\system32\IMM32.DLL:IMM32.DLL (76D90000), size: 393216 (result
: 0), SymType: '-exported-', PDB: 'C:\Windows\system32\IMM32.DLL', fileVersion:
6.1.7601.17514
[Crash] C:\Windows\syswow64\MSCTF.dll:MSCTF.dll (75970000), size: 835584 (result
: 0), SymType: '-exported-', PDB: 'C:\Windows\syswow64\MSCTF.dll', fileVersion:
6.1.7601.18731
[Crash] C:\Windows\system32\NLAapi.dll:NLAapi.dll (717C0000), size: 65536 (resul
t: 0), SymType: '-exported-', PDB: 'C:\Windows\system32\NLAapi.dll', fileVersion
: 6.1.7601.18685
[Crash] C:\Windows\system32\napinsp.dll:napinsp.dll (717B0000), size: 65536 (res
ult: 0), SymType: '-exported-', PDB: 'C:\Windows\system32\napinsp.dll', fileVers
ion: 6.1.7600.16385
[Crash] C:\Windows\system32\pnrpnsp.dll:pnrpnsp.dll (71790000), size: 73728 (res
ult: 0), SymType: '-exported-', PDB: 'C:\Windows\system32\pnrpnsp.dll', fileVers
ion: 6.1.7600.16385
[Crash] C:\Windows\System32\mswsock.dll:mswsock.dll (71570000), size: 245760 (re
sult: 0), SymType: '-exported-', PDB: 'C:\Windows\System32\mswsock.dll', fileVer
sion: 6.1.7601.18254
[Crash] C:\Windows\system32\DNSAPI.dll:DNSAPI.dll (71520000), size: 278528 (resu
lt: 0), SymType: '-exported-', PDB: 'C:\Windows\system32\DNSAPI.dll', fileVersio
n: 6.1.7601.17570
[Crash] C:\Windows\System32\winrnr.dll:winrnr.dll (71510000), size: 32768 (resul
t: 0), SymType: '-exported-', PDB: 'C:\Windows\System32\winrnr.dll', fileVersion
: 6.1.7600.16385
[Crash] C:\Windows\system32\rasadhlp.dll:rasadhlp.dll (73FE0000), size: 24576 (r
esult: 0), SymType: '-exported-', PDB: 'C:\Windows\system32\rasadhlp.dll', fileV
ersion: 6.1.7600.16385
[Crash] C:\Program Files\NVIDIA Corporation\NetworkAccessManager\bin32\nvLsp.dll
:nvLsp.dll (10000000), size: 270336 (result: 0), SymType: '-exported-', PDB: 'C:
\Program Files\NVIDIA Corporation\NetworkAccessManager\bin32\nvLsp.dll', fileVer
sion: 2.2.0.7316
[Crash] C:\Windows\syswow64\PSAPI.DLL:PSAPI.DLL (75740000), size: 20480 (result:
 0), SymType: '-exported-', PDB: 'C:\Windows\syswow64\PSAPI.DLL', fileVersion: 6
.1.7600.16385
[Crash] C:\Windows\syswow64\ole32.dll:ole32.dll (767D0000), size: 1425408 (resul
t: 0), SymType: '-exported-', PDB: 'C:\Windows\syswow64\ole32.dll', fileVersion:
 6.1.7601.19131
[Crash] C:\Windows\syswow64\OLEAUT32.dll:OLEAUT32.dll (76C10000), size: 585728 (
result: 0), SymType: '-exported-', PDB: 'C:\Windows\syswow64\OLEAUT32.dll', file
Version: 6.1.7601.18679
[Crash] C:\Windows\System32\wshtcpip.dll:wshtcpip.dll (74030000), size: 20480 (r
esult: 0), SymType: '-exported-', PDB: 'C:\Windows\System32\wshtcpip.dll', fileV
ersion: 6.1.7600.16385
[Crash] C:\Windows\System32\wship6.dll:wship6.dll (74140000), size: 24576 (resul
t: 0), SymType: '-exported-', PDB: 'C:\Windows\System32\wship6.dll', fileVersion
: 6.1.7600.16385
[Crash] C:\Windows\system32\IPHLPAPI.DLL:IPHLPAPI.DLL (74B30000), size: 114688 (
result: 0), SymType: '-exported-', PDB: 'C:\Windows\system32\IPHLPAPI.DLL', file
Version: 6.1.7601.17514
[Crash] C:\Windows\system32\WINNSI.DLL:WINNSI.DLL (74B20000), size: 28672 (resul
t: 0), SymType: '-exported-', PDB: 'C:\Windows\system32\WINNSI.DLL', fileVersion
: 6.1.7600.16385
[Crash] C:\Windows\System32\fwpuclnt.dll:fwpuclnt.dll (73FF0000), size: 229376 (
result: 0), SymType: '-exported-', PDB: 'C:\Windows\System32\fwpuclnt.dll', file
Version: 6.1.7601.18283
[Crash] C:\Windows\system32\dbghelp.dll:dbghelp.dll (71C30000), size: 962560 (re
sult: 0), SymType: '-exported-', PDB: 'C:\Windows\system32\dbghelp.dll', fileVer
sion: 6.1.7601.17514
[Crash] c:\eq\source\common\mysql_request_row.cpp (73): MySQLRequestRow::operato
r[]
[Crash] c:\eq\source\common\database_conversions.cpp (945): Database::CheckDatab
aseConvertPPDeblob
[Crash] c:\eq\source\common\database_conversions.cpp (473): Database::CheckDatab
aseConversions
[Crash] c:\eq\source\world\net.cpp (299): main
[Crash] f:\dd\vctools\crt\crtw32\startup\crt0.c (255): __tmainCRTStartup
[Crash] f:\dd\vctools\crt\crtw32\startup\crt0.c (165): mainCRTStartup
[Crash] ERROR: SymGetLineFromAddr64, GetLastError: 487 (Address: 753E338A)
[Crash] 753E338A (kernel32): (filename not available): BaseThreadInitThunk
[Crash] ERROR: SymGetLineFromAddr64, GetLastError: 487 (Address: 772C9A02)
[Crash] 772C9A02 (ntdll): (filename not available): RtlInitializeExceptionChain

[Crash] ERROR: SymGetLineFromAddr64, GetLastError: 487 (Address: 772C99D5)
[Crash] 772C99D5 (ntdll): (filename not available): RtlInitializeExceptionChain


c:\EQ\eqdb>

Edit: I may have figured this out. I will post back in a few hours to close this if I have.

[Uleat]

Did you ever resolve this?

[quetark]

Were you able to resolve this? I have a pretty old database as well and I'm following the same path as you, getting exactly this result. Please share your solution if you found it, please.

If this DB format is just too old to update, does anyone know of an existing script that will just bring the characters forward? That's really my only reason for wanting to update the database... I just want to retain my old characters.

Thanks!

[Uleat]

I've had some thoughts on what may be occurring...

I think there's an issue with array sizes.

I've noticed that some/most of the db conversion code uses tokenized values instead of hard-coded ones.

And, I know those values have changed since he implemented the de-blob code...

Keep an eye out for a future update involving the de-blob process.


I think Akkadius did a pretty good job with the de-blob process..though, I'm not sure if it will catch 100% of the old databases - still, should be pretty high.


EDIT:

I just did a cursory review of the original code and I won't be able to do anything with this in the near future.

It involves more than just array sizes...

Most of the object references have changed in no small degree and it is going to require a complete extraction of those objects and appropriate values from
the original code and then implement it in the current code.

Unfortunately, I don't have any backups containing the old pp and epp blob schemas..so, I wouldn't even be able to test any changes.

[DanCanDo]

Originally Posted by Uleat

Unfortunately, I don't have any backups containing the old pp and epp blob schemas..so, I wouldn't even be able to test any changes.

If you need any "old" source code to look at. Like Rev. 1852 ? (from 2011)
You can find that here :
https://drive.google.com/file/d/0B8u...ew?usp=sharing

[Uleat]

Dan...

You do realize that I'm one of the developers..right?

[DanCanDo]

Yes Uleat (chuckle) I was only trying to help, since you stated "I don't have any backups"
Maybe I misinterpreted that, I apologize if I did.

[quetark]

Do you just need an old DB to test with? I can certainly provide that, since mine is one that's crashing the update. Let me know what you need.

[Uleat]

It may be a little while before I can start a project like that having just started a fairly big one now.

If too much time goes by, just necro the thread to make sure I'm still breathing :P


DanCanDo, it's ok

I do have access to some pretty old code..but, I don't have any database backups that are pre-blob conversion.

I can put changes in a branch and either have someone pass along a viable backup or just have them test for me.


Unfortunately, the entire blob conversion will need to be extracted.

I know that bandolier sizes have changed..the coordinates use the glc3 system now..fields have been added/changed to the original pp/epp structs...

Lot's of work to 're-implement' them :/

[DanCanDo]

Originally Posted by Uleat

DanCanDo, it's ok

I do have access to some pretty old code..but, I don't have any database backups that are pre-blob conversion.

I can put changes in a branch and either have someone pass along a viable backup or just have them test for me.

Oh ok, I do have an old 1751 DB, as well, if you feel the need for it.

[Akkadius]

Originally Posted by quetark

Were you able to resolve this? I have a pretty old database as well and I'm following the same path as you, getting exactly this result. Please share your solution if you found it, please.

If this DB format is just too old to update, does anyone know of an existing script that will just bring the characters forward? That's really my only reason for wanting to update the database... I just want to retain my old characters.

Thanks!

Send me your database to akkadius1@gmail.com and I will find the crash and resolve the issue in source code.

[quetark]

Originally Posted by Akkadius

Send me your database to akkadius1@gmail.com and I will find the crash and resolve the issue in source code.

Sent last night. Let me know if you don't see it come through.

[Akkadius]

Originally Posted by quetark

Sent last night. Let me know if you don't see it come through.

Saw it come through. Will take care of it sometime after work.

[Akkadius]

I debugged this, this is actually an issue with your database being extremly extremely outdated.

ALTER TABLE `character_`
ADD COLUMN `firstlogon`  int(11) NULL DEFAULT 0 AFTER `xtargets`,
ADD COLUMN `inspectmessage`  varchar(200) NULL DEFAULT "" AFTER `firstlogon`;

Run that query and your auto legacy update conversion will run successfully.

[quetark]

I'm still trying to find time to really work this solution. On my first attempt, I had a fully functioning, fully updated EQEmu installation. I dropped peq and loaded in my extremely extremely outdated peq and peqlogindb databases, ran the the Alter Table statement and ran World.exe to update. The update succeeded but the resulting system didn't run. It got hung up somwhere connecting to mysql. One big flaw I see in what I did is that eqemu_config.xml listed my login tables as being the new format. When I loaded in my OLD format DB, the xml file was then pointing in the wrong place for login information. I'll re-do the whole test with the xml properly configured for the old db format and try again when I can. If there are any other things I need to adjust, please let me know.

Thanks for the work you're doing on this. It is appreciated!