Tungsten Replicator 6.1.0

Build: 77

Release Date: 31 Jul 2019

End of Life Date: 15 Aug 2024

Product End of Life

This release is past End of Life.

Release 6.1.0 contains both significant improvements as well as some needed bugfixes. One of the main features of this release is MySQL 8 support.

The Tungsten Stack now supports the new MySQL 8.0 authentication plugins. Both sha256_password and caching_sha2_password (the new default) are supported by the Replicator.

More info on these authentication plugins can be found here

The Drizzle driver has been updated to support these new authentication methods, and the MySQL Connector/J 8 is also supported.

Improvements, new features and functionality (5)

Command-line Tools (2)

• A new utility script has been added to the release, tungsten_post_process, which assists with the graceful maintenance of the static cross-site replicator configuration files on disk.
  Issue: CT-761
• Two new utility scripts have been added to the release to help with setting the Replicator position:

  • tungsten_find_position, which assists with locating information in the THL based on the provided MySQL binary log event position and outputs a dsctl set command as output.
  • tungsten_find_seqno, which assists with locating information in the THL based on the provided sequence number and outputs a dsctl set command as output.
  Issue: CT-934

Core Replicator (2)

• Upgraded the Drizzle driver to support MySQL 8 authentication protocols (SHA256, caching_sha2).
  Issues: CT-931, CT-914, CT-966

• A new, beta-quality command has been included called prov-sl.sh which is intended to eventually replace the current tungsten_provision_slave script.

  Currently, prov-sl.sh supports provisioning Replicas using mysqldump andxtrabackup tools, and is MySQL 8-compatible.

  The prov-sl.sh command is written in Bash, has less dependencies compared to the current version and is meant to fix a number of issues with the current version.

  Backups are streamed from source to target so that an intermediate write to disk is not performed, resulting in faster provisioning times.

  Logs are written to $CONTINUENT_ROOT/service_logs/prov-sl.log (i.e. /opt/continuent/service_logs/prov-sl.log).

  For example, provision a Replica from [source db] using mysqldump (default):

  shell> prov-sl.sh -s {source db}

  As another example, use xtrabackup for the backup method, with 10 parallel threads (default is 4), and ssh is listening on port 2222:

  shell> prov-sl.sh -s {source db} -n xtrabackup -t 10 -p 2222

  Warning

  At the moment, prov-sl.sh does not support Composite Active/Active topologies when used with Tungsten Clustering, however it will be included in a future release.
  Issues: CT-809, CT-963, CT-855, CT-723, CT-614

Amazon Redshift Replication (1)

• The Redshift Applier now allows AWS authentication using IAM Roles. Previously authentication was possible via Access and Secret Key pairs only.
  Issue: CT-980

Bug Fixes (5)

Core Replicator (2)

• Now properly extracting the Geometry datatype.
  Issue: CT-997
• Added support for missing charset GB18030 to correct WARN extractor.mysql.MysqlBinlog Unknown charset errors.
  Issues: CT-932, CT-915

Amazon Redshift Replication (2)

• Loading data into Redshift would fail with the following error if a row of data contained a specific control character (0x00 (NULL))

  Missing newline: Unexpected character 0x30 found at location nnn

  Issue: CT-984
• The ddl_map.json file used by the apply_schema_changes filter was missing a rule to handle ALTER TABLE statements when replicating between MySQL and Redshift
  Issue: CT-1002

Filters (1)

• The extract_schema_change filter wasn't escaping " (double-quotes) and the generated JSON would then cause the applier to error with:

  pendingExceptionMessage: SyntaxError: missing } after property list
        (../../tungsten-replicator//support/filters-javascript/apply_schema_changes.js#236(eval)#1)

  Issue: CT-1011