Google Drive - Backup transport errors "429 Too many requests", but API limits and errors are OK on Google's side

[mariusfv]

First of all: I have already read this topic.

pwd
/usr/local/cpanel/logs/cpbackup_transporter
grep '429' cpbackup_transporter.1675211521.log
[2023-02-01 02:06:28 +0200] info [cpbackup_transporter] Failed with 429: Too Many Requests
...
[2023-02-01 02:26:54 +0200] info [cpbackup_transporter] Net::FTP=GLOB(0x2eb64a0) >>> EPRT |2|2a01:4f8:221:1293::2|42992|
...
[2023-02-02 02:35:51 +0200] info [cpbackup_transporter] Failed with 429: Too Many Requests
[2023-02-02 02:36:03 +0200] info [cpbackup_transporter] Failed with 429: Too Many Requests
[2023-02-02 02:36:21 +0200] info [cpbackup_transporter] Failed with 429: Too Many Requests
[2023-02-02 02:36:38 +0200] info [cpbackup_transporter] Failed with 429: Too Many Requests
[2023-02-02 02:37:30 +0200] info [cpbackup_transporter] Failed with 429: Too Many Requests

Story
About 3-4 days ago emails started appearing with "Google Drive - Backup transport errors".
1. I had connected 1 gmail account (5 years ago), the backups worked all this time without any error.

2. Considering that the backup transport error to Google drive was partial, i.e. out of 10 accounts 7-8 were successfully uploaded and only 2-3 did not work (random each day) I figured out that it was 429 "Too Many Requests" (some API limitations). Investigating the log file confirmed my suspicion.

3. I also linked a Google Workspace (Apps) account to have access to API charts and errors in the Google Console dashboard. (A feature missing from gmail accounts).
As you can see from the following screenshots there are no errors or exceeding API limits:
1 day
6 hours

4. The backup transport error also appeared for the Google Workspace account, i.e. 429 "too many requests". And the API limit for Google Workspace is 20,000/day.

I was wondering what API limits I had exceeded at 10 backups (8 different cPanel accounts) with a total of 23 GB.

Also another annoying bug with this version of WHM (not to open another topic):
In EasyApache it advises (informs you) that PHP version 7.2 is outdated (however I was using 7.4 before). After you uninstall PHP 7.2 through EasyApache the next day it auto-installs itself (3 days in a row I tested this). And all websites are switched to PHP 8.0. Either WHM has some bugs, or CloudLinux (yes, I use CloudLinux, but I prefer "ea-php" from cPanel).

 

[cPRex]

Hey there! The PHP 7.2 issue is likely because you have the older WordPress Manager tool installed. Can you see if that is present on your system? If so, removing that will keep PHP 7.2 from being reinstalled each night.

Are you using a shared Google drive account?

 

[mariusfv]

The problem with transporting backups to Google Drive (Gmail) and Google Drive Workspace (Apps) continues. It randomly transports what backups it wants and the rest get 429 "Too Many Requests".

I have some folders shared in the Gmail account but not the backup folder.
As for Google Workspace (Apps) I have nothing shared.

@Removing the WP Toolkit solved the problem with automatic installation of PHP 7.2 each night.

 

[cPRex]

There isn't anything we can do on our end for the "too many requests" error as that is something that happens on the Google side of things. You might want to speak with them about why this is happening.

I'd just like to clarify that you likely removed "WordPress Manager" and not "WordPress Toolkit" and WPT doesn't have the PHP 7.2 requirement like the older software does.

 

[mariusfv]

@cPRex - It doesn't seem so!
As I specified both in the topic title and in the problem description (see screenshots: point 3) it seems that there are no API limit exceedances or any errors on Google's side.

 

[cPRex]

I don't see what else the issue could be. You're specifically getting a "too many requests" error from Google when the backup runs, as that isn't an error that cPanel would generate.

If you'd like to make a ticket we can take a deeper look at this issue, but it does sound like there is an issue with the area you are transporting your files to on the Google side. If you can make a ticket, please post the number here so I can follow along.