https://www.icyphoenix.com/viewtopic.php?f=35&t=8755
-----------------------------------
omarska
Mon 22 Oct, 2012 21:33

Characters Lost After DB Conversion To UTF-8
-----------------------------------
Hi all. First to mention that I am writing from my friend's account - we are both admins of our little site www.omarska.net. He was an active member of IP comunity a few years ago, but now he is very bussy with other stuff.
[hr]
When I found about IP 2.0 I was very pleased to read about it. Therefore I have created a copy of our site (both DB and files) and performed an upgrade. Everything is done, but final result contains some errors.

Tehnical data:
Old version: 1.3.0.53b - avaiable at www.omarska.net
New (upgraded) version: 2.0.0.86 - avaiable at www.omarska.net/icyphoenix/
Use following credentials to access it
[spoiler]Username: omarska Password: MightyGorgon126654[/spoiler]
PHP version: 5.2.17
MySQL version: 5.1.65-cll

The problem:
After DB conversion to UTF-8 some serbian latin characters with diacritics have been lost and now are unreadable. Here is the outcome both for lower case and upper case:
[spoiler]
š = OK
đ = LOST
č = LOST
ć = LOST
ž = OK
Š = OK
Đ = OK
Č = LOST
Ć = LOST
Ž = OK
[/spoiler]

Serbian cyrilic characters all survived.

I have found similar [url=http://www.icyphoenix.com/viewtopic.php?f=2&t=8666]topic by [url=http://www.icyphoenix.com/profile.php?mode=viewprofile&u=7660]Costa, and [url=http://www.icyphoenix.com/viewtopic.php?p=56790#p56790]solution by [url=http://www.icyphoenix.com/profile.php?mode=viewprofile&u=85]TheSteffen but I'm not sure if I can use it in my case.

Second problem:
After clicking on ACP link, nothing happens except sid is added at the end of the URL. The only way I have discovered how to login to ACP is to click on CMS link, and after logging into CMS, I can switch to ACP.

Can anybody help with my problems? No rush, of course  :)
Any help will be appreciated.

Regards,
M.


-----------------------------------
Limun
Tue 23 Oct, 2012 07:06

Re: Characters Lost After DB Conversion To UTF-8
-----------------------------------
can you please check your [b]NEW , upgraded[/b] database Collation

 [img]http://www.icyphoenix.com/files/images/3336/snapshot1.png[/img] 

BTW affter i saw your topic i checked my databases .

Results :

Upgradet databases : was on utf8_bin
Fresh databases 2.0 : one base utf8_bin
                                and one base was on latin_swedish  :shock: 

i found for me a solution to convert al to[b] utf8_general_ci[/b]

result :

 [img]http://www.icyphoenix.com/files/images/3336/snapshot2.png[/img] 

so if you want i can attach my edited "convert_utf8_nodbal.php"


-----------------------------------
omarska
Tue 23 Oct, 2012 12:54

Re: Characters Lost After DB Conversion To UTF-8
-----------------------------------
Thank you for your reply.

MySQL connection collation: utf8_general_ci

Upgraded database collation utf8_bin.

Collation of tables inside my upgraded DB utf8_bin. 
 [img]http://www.icyphoenix.com/files/images/1353/utf8_bin.png[/img] 

There are some tables with prefix _old and collation of those tabels is different. I guess they are not used after the conversion process.
 [img]http://www.icyphoenix.com/files/images/1353/_old.png[/img]

So, you have modified "convert_utf8_nodbal.php" to create utf8_unicode_ci tables? Sure, I would like to try it.

M.


-----------------------------------
Limun
Tue 23 Oct, 2012 13:09

Re: Characters Lost After DB Conversion To UTF-8
-----------------------------------
yep and here it is 

BTW backup your database before 

let me know if you solved problem with characters 

then will see about ACP


-----------------------------------
Joshua203
Tue 23 Oct, 2012 15:18

Re: Characters Lost After DB Conversion To UTF-8
-----------------------------------
[ot][quote user="omarska" post="57173"]First to mention that I am writing from my friend's account[/quote]
Please create your own private account to avoid further confusion, it will only take you a couple of minutes and it's free .. thanks in advance  :wink: 

Also.. try to post only 1 problem per thread, so please open another thread for the second question ..again .. thanks in advance :wink: [/ot]


-----------------------------------
Joshua203
Tue 23 Oct, 2012 22:26

Re: Characters Lost After DB Conversion To UTF-8
-----------------------------------
[ot]About your second bug (ACP problem) ...

Would you like to post this in the bugtracker yourself omarska? I confirm it is a bug, since this is even happening at this site :wink: 

http://www.icyphoenix.com/bugs.php
If you don't have access there please let me know.[/ot]


-----------------------------------
TheSteffen
Thu 25 Oct, 2012 10:58

Re: Characters Lost After DB Conversion To UTF-8
-----------------------------------
[b]omarska[/b],
You still have problems?

What is the collation of the old (IP 1.3) database?
And what letters are there, what language? Serbian?


-----------------------------------
Joshua203
Fri 26 Oct, 2012 16:07

Re: Characters Lost After DB Conversion To UTF-8
-----------------------------------
[ot]I've already reported the acp bug in the bugtracker for you.. http://www.icyphoenix.com/bug.php?bid=132[/ot]


-----------------------------------
Mighty Gorgon
Sat 17 Nov, 2012 12:33

Re: Characters Lost After DB Conversion To UTF-8
-----------------------------------
[b]omarska[/b], did you solve your issue?


