Fix MySQL error "Plugin caching_sha2_password could not be loaded"

Got the following error:

ERROR 1045 (28000): Plugin caching_sha2_password could not be loaded: /usr/lib/x86_64-linux-gnu/mariadb19/plugin/caching_sha2_password.so: cannot open shared object file: No such file or directory

The fix for it is to recreate the MySQL password with which you are connecting to the server:

ALTER USER 'user'@'ip.add.re.ss'
IDENTIFIED WITH mysql_native_password
BY 'password';