Tungsten Replicator 6.0 Manual
			Next

Tungsten Replicator 6.0 Manual

Abstract

This manual documents Tungsten Replicator 6.0. This includes information for:

Tungsten Replicator

Build date: 2022-03-31 (c2a92db)

Up to date builds of this document: Tungsten Replicator 6.0 Manual (Online), Tungsten Replicator 6.0 Manual (PDF)

Table of Contents

Preface

1. Introduction

1.1. Tungsten Replicator

2. Deployment Overview

2.1. Deployment Sources

2.2. Best Practices

2.3. Common tpm Options During Deployment

2.4. Starting and Stopping Tungsten Replicator

2.5. Configuring Startup on Boot

2.6. Removing Datasources from a Deployment

2.7. Understanding Deployment Styles and Topologies

2.8. Understanding Heterogeneous Deployments

3. Deploying MySQL Extractors

3.1. MySQL Replication Pre-Requisites

3.2. Deploying a Primary/Replica Topology

3.3. Deploying an Extractor for Amazon Aurora

3.4. Replicating Data Out of a Cluster

4. Deploying Appliers

4.1. Deploying the MySQL Applier

4.2. Deploying the Amazon Redshift Applier

4.3. Deploying the Vertica Applier

4.4. Deploying the Kafka Applier

4.5. Deploying the MongoDB Applier

4.6. Deploying the Hadoop Applier

4.7. Deploying the Oracle Applier

4.8. Deploying the PostgreSQL Applier

5. Deployment: Advanced

5.1. Deploying the Replicator using the AWS Marketplace AMI

5.2. Deploying a Fan-In Topology

5.3. Deploying Multiple Replicators on a Single Host

5.4. Replicating Data Into an Existing Dataservice

5.5. Deploying Parallel Replication

5.6. Batch Loading for Data Warehouses

6. Deployment: Security

6.1. Enabling Security

6.2. Disabling Security

6.3. Creating Suitable Certificates

6.4. Installing from a Staging Host with Manually Generated Certificates

6.5. Installing via INI File with Manually Generated Certificates

6.6. Replacing the TLS Certificate from a Staging Directory

6.7. Removing TLS Encryption from a Staging Directory

6.8. Enabling Database SSL

6.9. Configure Tungsten<>Database Secure Communication

7. Operations Guide

7.1. The Home Directory

7.2. Establishing the Shell Environment

7.3. Understanding Replicator Roles

7.4. Checking Replication Status

7.5. Managing Transaction Failures

7.6. Provision or Reprovision a Replica

7.7. Creating a Backup

7.8. Restoring a Backup

7.9. Deploying Automatic Replicator Recovery

7.10. Migrating and Seeding Data

7.11. Switching Primary Hosts

7.12. Configuring Parallel Replication

7.13. Performing Database or OS Maintenance

7.14. Upgrading Tungsten Replicator

7.15. Monitoring Tungsten Cluster

7.16. Rebuilding THL on the Primary

8. Command-line Tools

8.1. The clean_release_directory Command

8.2. The check_tungsten_latency Command

8.3. The check_tungsten_online Command

8.4. The check_tungsten_services Command

8.5. The deployall Command

8.6. The ddlscan Command

8.7. The dsctl Command

8.8. env.sh Script

8.9. The load-reduce-check Tool

8.10. The materialize Command

8.11. The tungsten_merge_logs Script

8.12. The multi_trepctl Command

8.13. The tungsten_newrelic_event Command

8.14. The query Command

8.15. The replicator Command

8.16. The startall Command

8.17. The stopall Command

8.18. The thl Command

8.19. The trepctl Command

8.20. The tpasswd Command

8.21. The tungsten_get_mysql_datadir Script

8.22. The tungsten_health_check Script

8.23. The tungsten_monitor Script

8.24. The tungsten_prep_upgrade Script

8.25. The tungsten_provision_thl Command

8.26. The tungsten_provision_slave Script

8.27. The tungsten_read_master_events Script

8.28. The tungsten_send_diag Script

8.29. The tungsten_set_position Script

8.30. The tungsten_skip_seqno Script

8.31. The undeployall Command

9. The tpm Deployment Command

9.1. Comparing Staging and INI tpm Methods

9.2. Processing Installs and Upgrades

9.3. tpm Staging Configuration

9.4. tpm INI File Configuration

9.5. tpm Commands

9.6. tpm Common Options

9.7. tpm Validation Checks

9.8. tpm Configuration Options

10. Replication Filters

10.1. Enabling/Disabling Filters

10.2. Enabling Additional Filters

10.3. Filter Status

10.4. Filter Reference

10.5. Standard JSON Filter Configuration

10.6. JavaScript Filters

11. Performance and Tuning

11.1. Block Commit

11.2. Improving Network Performance

11.3. Tungsten Replicator Block Commit and Memory Usage

A. Release Notes

B. Prerequisites

B.1. Requirements

B.2. Staging Host Configuration

B.3. Host Configuration

B.4. MySQL Database Setup

B.5. Prerequisite Checklist

C. Troubleshooting

C.1. Contacting Support

C.2. Error/Cause/Solution

C.3. Known Issues

C.4. Troubleshooting Timeouts

C.5. Troubleshooting Backups

C.6. Running Out of Diskspace

C.7. Troubleshooting SSH and tpm

C.8. Troubleshooting Data Differences

C.9. Comparing Table Data

C.10. Troubleshooting Memory Usage

D. Files, Directories, and Environment

D.1. The Tungsten Cluster Install Directory

D.2. Log Files

D.3. Environment Variables

E. Terminology Reference

E.1. Transaction History Log (THL)

E.2. Generated Field Reference

F. Internals

F.1. Extending Backup and Restore Behavior

F.2. Character Sets in Database and Tungsten Cluster

F.3. Understanding Replication of Date/Time Values

F.4. Memory Tuning and Performance

F.5. Tungsten Replicator Pipelines and Stages

F.6. Tungsten Cluster Schemas

G. Frequently Asked Questions (FAQ)

H. Ecosystem Support

I. Configuration Property Reference

List of Figures

List of Tables

		Next
		Preface

Continuent Documentation

Tungsten Replicator 6.0 Manual

Continuent Ltd