Issues faced during MySQL Upgrade

[avinash.pudota]

Hi,
When i open MySQL/MariaDB Upgrade page, i am facing few issues which conflict with the information i heard.
(i am just checking the possible warnings and issues in all possible upgrade options, and i am not interested in updating to Mariadb, finally i would still update to MySQL 5.7)

First one is, currently i have MySQL 5.6, but i get MariaDB 10.3 as recommended option to upgrade, but i heard that upgrading from MySQL 5.6 to MariaDB 10.3 is generally not recommended.

And second one is if i try to update to MySQL 5.6 to MariaDB 10, i don't get any issues or warnings but the continue button is disabled without showing the reason why it was disabled.

Please check the below screenshots for the same.

I am actually looking to update to MySQL 5.7 from 5.6, is there any checklist to check before updating, apart from backups. Are there any issues other than strict mode which might cause issues to users coming from 5.6? How much time in average will it take to complete the upgrade. In worst case scenario, if my database server doesn't start after update or if upgrade failed and it doesnt revert changes automatically what would be the immediate next steps to make it working again.

 

[cPanelLauren]

Hello,

I believe the issue here is that you're using a non-standard version of MySQL. What is the output of the following commands when run via SSH?

mysql --version

rpm -qa |grep -i mysql

 

[avinash.pudota]

Here is the output


rpm -qa |grep -i mysql

cpanel-mysql-libs-5.6.43-1.cp1186.x86_64
MySQL56-client-5.6.45-1.cp1186.x86_64
cpanel-perl-530-MySQL-Diff-0.60-1.cp1186.noarch
MySQL56-shared-5.6.45-1.cp1186.x86_64
MySQL56-server-5.6.45-1.cp1186.x86_64
cpanel-perl-530-DBD-mysql-4.050-1.cp1186.x86_64
cpanel-mysql-5.6.43-1.cp1186.x86_64
ea-php73-php-mysqlnd-7.3.15-1.1.1.cpanel.x86_64
MySQL56-test-5.6.45-1.cp1186.x86_64
ea-php56-php-mysqlnd-5.6.40-11.11.7.cpanel.x86_64
MySQL56-devel-5.6.45-1.cp1186.x86_64

mysql --version

mysql  Ver 14.14 Distrib 5.6.45, for Linux (x86_64) using  EditLine wrapper

 

[cPanelLauren]

I believe that assumption was wrong, this looks to be fine. MariaDB will always be the recommended solution in this interface, as the system considers MariaDB an upgrade from MySQL. I'm using a test server with 5.7 installed:



You should see similar options to what I have in this interface.

The next interface should take you to Upgrade Warnings where you'd have to click the checkbox to acknowledge the warnings. Until they're checked the continue button will remain unclickable:



It seems pretty odd that the scan that's performed found no warnings (not even normal severity warnings) to add. Is anything noted in the cPanel error logs in relation to this? You can find them at /usr/local/cpanel/logs/error_log

 

[avinash.pudota]

Hi,

To be clear, i get the warning messages and when i select them, i get the continue button activated for all other possible potions except MariaDB 10 ( from MySQL 5.6 to MariaDB 10.0), in this specific option i did not get any warnings and the continue button is disabled. However, i am not worried about it as i am not looking to update to MariaDB

Below are the recent logs from /usr/local/cpanel/logs/error_log

tail -n 100 /usr/local/cpanel/logs/error_log

        cpanel::cpsrvd::receive_and_process_incoming_http_request() called at cpsrvd.pl line 1279
        cpanel::cpsrvd::handle_one_connection(6) called at cpsrvd.pl line 1109
        cpanel::cpsrvd::script() called at cpsrvd.pl line 429

Failed to show template “error400” in login theme “Webimpress” (); falling back to legacy login. at /usr/local/cpanel/Cpanel/Server.pm line 2089.
Use of uninitialized value $document in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 276.
Use of uninitialized value $document in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 279.
Use of uninitialized value $document in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 279.
Use of uninitialized value $document in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 279.
Use of uninitialized value in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 135.
file error - templates/error400: not found at base/show_template.stor.pl line 134.
[2020-03-06 12:12:34 +0530] info [whostmgrd] show_template.stor lacked output with exit code: 1 at /usr/local/cpanel/Cpanel/Server.pm line 1381.
        Cpanel::Server::process_login_template(Cpanel::Server=HASH(0x21cdf70), "Webimpress", "SERVER_NAME", undef, "cp_security_token", undef, "page_to_show", "error400", ...) called at /usr/local/cpanel/Cpanel/Server.pm line 2085
        Cpanel::Server::process_and_send_login_template(Cpanel::Server=HASH(0x21cdf70), "error400", "HTTP/1.1 400 Bad Request\x{d}\x{a}Content-type: text/html; charset=\"u"..., HASH(0x246e268)) called at cpsrvd.pl line 3348
        cpanel::cpsrvd::doerrorstatus(400, "Bad Request") called at cpsrvd.pl line 3198
        cpanel::cpsrvd::parse_request_headers() called at cpsrvd.pl line 1745
        cpanel::cpsrvd::receive_and_process_incoming_http_request() called at cpsrvd.pl line 1279
        cpanel::cpsrvd::handle_one_connection(6) called at cpsrvd.pl line 1109
        cpanel::cpsrvd::script() called at cpsrvd.pl line 429

Failed to show template “error400” in login theme “Webimpress” (); falling back to legacy login. at /usr/local/cpanel/Cpanel/Server.pm line 2089.
Use of uninitialized value $document in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 276.
Use of uninitialized value $document in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 279.
Use of uninitialized value $document in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 279.
Use of uninitialized value $document in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 279.
Use of uninitialized value in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 135.
file error - templates/error400: not found at base/show_template.stor.pl line 134.
[2020-03-06 12:12:35 +0530] info [whostmgrd] show_template.stor lacked output with exit code: 1 at /usr/local/cpanel/Cpanel/Server.pm line 1381.
        Cpanel::Server::process_login_template(Cpanel::Server=HASH(0x21cdf70), "Webimpress", "fourohfour", "", "app_version", "11.86.0.8", "SERVER_PORT", 2087, ...) called at /usr/local/cpanel/Cpanel/Server.pm line 2085
        Cpanel::Server::process_and_send_login_template(Cpanel::Server=HASH(0x21cdf70), "error400", "HTTP/1.1 400 Bad Request\x{d}\x{a}Content-type: text/html; charset=\"u"..., HASH(0x246e268)) called at cpsrvd.pl line 3348
        cpanel::cpsrvd::doerrorstatus(400, "Bad Request") called at cpsrvd.pl line 3198
        cpanel::cpsrvd::parse_request_headers() called at cpsrvd.pl line 1745
        cpanel::cpsrvd::receive_and_process_incoming_http_request() called at cpsrvd.pl line 1279
        cpanel::cpsrvd::handle_one_connection(6) called at cpsrvd.pl line 1109
        cpanel::cpsrvd::script() called at cpsrvd.pl line 429

Failed to show template “error400” in login theme “Webimpress” (); falling back to legacy login. at /usr/local/cpanel/Cpanel/Server.pm line 2089.
Use of uninitialized value $document in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 276.
Use of uninitialized value $document in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 279.
Use of uninitialized value $document in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 279.
Use of uninitialized value $document in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 279.
Use of uninitialized value in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 135.
file error - templates/error400: not found at base/show_template.stor.pl line 134.
[2020-03-06 12:12:37 +0530] info [whostmgrd] show_template.stor lacked output with exit code: 1 at /usr/local/cpanel/Cpanel/Server.pm line 1381.
        Cpanel::Server::process_login_template(Cpanel::Server=HASH(0x21cdf70), "Webimpress", "app_version", "11.86.0.8", "fourohfour", "", "SERVER_PORT", 2087, ...) called at /usr/local/cpanel/Cpanel/Server.pm line 2085
        Cpanel::Server::process_and_send_login_template(Cpanel::Server=HASH(0x21cdf70), "error400", "HTTP/1.1 400 Bad Request\x{d}\x{a}Content-type: text/html; charset=\"u"..., HASH(0x246e268)) called at cpsrvd.pl line 3348
        cpanel::cpsrvd::doerrorstatus(400, "Bad Request") called at cpsrvd.pl line 3198
        cpanel::cpsrvd::parse_request_headers() called at cpsrvd.pl line 1745
        cpanel::cpsrvd::receive_and_process_incoming_http_request() called at cpsrvd.pl line 1279
        cpanel::cpsrvd::handle_one_connection(6) called at cpsrvd.pl line 1109
        cpanel::cpsrvd::script() called at cpsrvd.pl line 429

Failed to show template “error400” in login theme “Webimpress” (); falling back to legacy login. at /usr/local/cpanel/Cpanel/Server.pm line 2089.
Use of uninitialized value $document in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 276.
Use of uninitialized value $document in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 279.
Use of uninitialized value $document in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 279.
Use of uninitialized value $document in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 279.
Use of uninitialized value in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 135.
[2020-03-06 12:12:39 +0530] warn [whostmgrd] (XID stgyhz) Documents are not permitted to contain null characters, or new lines. at cpsrvd.pl line3209.
        cpanel::cpsrvd::parse_request_headers() called at cpsrvd.pl line 1745
        cpanel::cpsrvd::receive_and_process_incoming_http_request() called at cpsrvd.pl line 1279
        cpanel::cpsrvd::handle_one_connection(6) called at cpsrvd.pl line 1109
        cpanel::cpsrvd::script() called at cpsrvd.pl line 429
Use of uninitialized value $document in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 276.
Use of uninitialized value $document in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 279.
Use of uninitialized value $document in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 279.
Use of uninitialized value $document in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 279.
Use of uninitialized value in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 135.
file error - templates/error400: not found at base/show_template.stor.pl line 134.
[2020-03-06 12:12:40 +0530] info [whostmgrd] show_template.stor lacked output with exit code: 1 at /usr/local/cpanel/Cpanel/Server.pm line 1381.
        Cpanel::Server::process_login_template(Cpanel::Server=HASH(0x21cdf70), "Webimpress", "document", undef, "page_to_show", "error400", "cp_security_token", undef, ...) called at /usr/local/cpanel/Cpanel/Server.pm line 2085
        Cpanel::Server::process_and_send_login_template(Cpanel::Server=HASH(0x21cdf70), "error400", "HTTP/1.1 400 Bad Request\x{d}\x{a}Content-type: text/html; charset=\"u"..., HASH(0x246e268)) called at cpsrvd.pl line 3348
        cpanel::cpsrvd::doerrorstatus(400, "Bad Request") called at cpsrvd.pl line 3198
        cpanel::cpsrvd::parse_request_headers() called at cpsrvd.pl line 1745
        cpanel::cpsrvd::receive_and_process_incoming_http_request() called at cpsrvd.pl line 1279
        cpanel::cpsrvd::handle_one_connection(6) called at cpsrvd.pl line 1109
        cpanel::cpsrvd::script() called at cpsrvd.pl line 429

Failed to show template “error400” in login theme “Webimpress” (); falling back to legacy login. at /usr/local/cpanel/Cpanel/Server.pm line 2089.
Use of uninitialized value $document in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 276.
Use of uninitialized value $document in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 279.
Use of uninitialized value $document in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 279.
Use of uninitialized value $document in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 279.
Use of uninitialized value in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 135.
file error - templates/error400: not found at base/show_template.stor.pl line 134.
[2020-03-06 12:12:42 +0530] info [whostmgrd] show_template.stor lacked output with exit code: 1 at /usr/local/cpanel/Cpanel/Server.pm line 1381.
        Cpanel::Server::process_login_template(Cpanel::Server=HASH(0x21cdf70), "Webimpress", "page_to_show", "error400", "document", undef, "cp_security_token", undef, ...) called at /usr/local/cpanel/Cpanel/Server.pm line 2085
        Cpanel::Server::process_and_send_login_template(Cpanel::Server=HASH(0x21cdf70), "error400", "HTTP/1.1 400 Bad Request\x{d}\x{a}Content-type: text/html; charset=\"u"..., HASH(0x246e250)) called at cpsrvd.pl line 3348
        cpanel::cpsrvd::doerrorstatus(400, "Bad Request") called at cpsrvd.pl line 3198
        cpanel::cpsrvd::parse_request_headers() called at cpsrvd.pl line 1745
        cpanel::cpsrvd::receive_and_process_incoming_http_request() called at cpsrvd.pl line 1279
        cpanel::cpsrvd::handle_one_connection(6) called at cpsrvd.pl line 1109
        cpanel::cpsrvd::script() called at cpsrvd.pl line 429

Failed to show template “error400” in login theme “Webimpress” (); falling back to legacy login. at /usr/local/cpanel/Cpanel/Server.pm line 2089.
Use of uninitialized value $document in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 276.
Use of uninitialized value $document in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 279.
Use of uninitialized value $document in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 279.
Use of uninitialized value $document in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 279.
Use of uninitialized value in index at /usr/local/cpanel/Cpanel/Server/Response.pm line 135.

I found some other errors in the log which are discussed in this thread SOLVED - [CPANEL-27695] Failed to show template error400 in login theme

I believe this issue might have been fixed in recent releases, but i am using a custom login theme which was cloned from default and modified long ago which might be the issue.

 

[cPanelLauren]

If you're running at least v78 (looks like you're on v86) of cPanel/WHM that issue should be resolved - this looks to be more related to the custom theme which if misbehaving can cause issues in all aspects of the product.


I know there were issues with MySQL 5.7 -> MariaDB specifically that you cannot go back to MySQL due to the information schema changes 10.3 implements. There is no reports of mysql 5.6 -> mariadb 10.3 upgrades being problematic as far as I am aware and MariaDB has MySQL 5.6 and 5.7 as supported for MariaDB 10.2 and 10.3 - MariaDB versus MySQL - Compatibility

So that wouldn't really explain the inability to click that upgrade. If you're able to switch themes and find that you're unable to perform the upgrade to MySQL I'd suggest opening a ticket.

As for the potential for issues I'd recommend the following:

1. Before you pursue any upgrade of this nature I'd suggest taking full backups of the databases​

2. The upgrade process will let you know if it finds issues with upgrading, if it is a failure it should revert the configuration and you shouldn't be left with non-working dbs​

3. If such a scenario were to occur we have 24/7 support and you'd be welcome to open a ticket which would get emergency status and be addressed shortly​

I can't really tell you how long the update will take as it really depends on the number of databases and their size.

 

[avinash.pudota]

Hi,
I have reverted to default login theme, and i no longer get errors in /usr/local/cpanel/logs/error_log

Now i am confident enough to upgrade to MySQL to 5.7

I have a small doubt. Around 1 year ago i tried installing watchmysql plugin (WatchMySQL cPanel/WHM plugin), it didn't work and i uninstalled immediately, the reference to this plugin in WHM's Service Status page is gone, but i can still see it in cPanel's Service Information page as unknown. It didn't cause any kind of issue till now. Would it cause any issue now while updating.

 

[cPanelLauren]

Hello,

I'm glad to hear that! For the reference to the old plugin, as long as you followed the steps here: Guide to WHM Plugins - Uninstall Plugins - Developer Documentation - cPanel Documentation this shouldn't be of concern.