Tungsten Replicator 5.2 Manual

Continuent Ltd

Abstract

This manual documents Tungsten Replicator 5.2. This includes information for:

  • Tungsten Replicator

  • Tungsten Replicator for Oracle Replication

  • Tungsten Replicator for Analytics and Big Data

Build date: 2017-10-17 (986d6d3)

Up to date builds of this document: Tungsten Replicator 5.2 Manual (Online), Tungsten Replicator 5.2 Manual (PDF)


Table of Contents

Preface
1. Legal Notice
2. Conventions
3. Quickstart Guide
1. Introduction
1.1. Tungsten Replicator
1.1.1. Extractor
1.1.2. Appliers
1.1.3. Transaction History Log (THL)
1.1.4. Filtering
2. Deployment
2.1. Deployment Sources
2.1.1. Using the TAR/GZipped files
2.1.2. Using the RPM and DEB package files
2.2. Best Practices
2.2.1. Best Practices: Deployment
2.2.2. Best Practices: Operations
2.2.3. Best Practices: Maintenance
2.3. Prepare Hosts
2.3.1. Prepare MySQL Hosts
2.3.2. Deploy SSH Keys
2.4. Common tpm Options During Deployment
2.5. Starting and Stopping Tungsten Replicator
2.6. Configuring Startup on Boot
2.7. Removing Datasources from a Deployment
2.7.1. Removing a Datasource from an Existing Deployment
3. MySQL-only Deployments
3.1. Deploying a Master/Slave Topology
3.1.1. Monitoring a Master/Slave Dataservice
3.2. Deploying a Multi-master Topology
3.2.1. Preparing Hosts for Multimaster
3.2.2. Installing Multimaster Deployments
3.2.3. Management and Monitoring of Multimaster Deployments
3.2.4. Alternative Multimaster Deployments
3.3. Deploying a Fan-In Topology
3.3.1. Management and Monitoring Fan-in Deployments
3.4. Deploying Multiple Replicators on a Single Host
3.4.1. Prepare: Multiple Replicators
3.4.2. Install: Multiple Replicators
3.4.3. Best Practices: Multiple Replicators
3.5. Replicating Data Out of a Cluster
3.5.1. Prepare: Replicating Data Out of a Cluster
3.5.2. Deploy: Replicating Data Out of a Cluster
3.5.3. Best Practices: Replicating Data Out of a Cluster
3.6. Replicating Data Into an Existing Dataservice
4. Heterogeneous Deployments
4.1. How Heterogeneous Replication Works
4.1. MySQL to Oracle, Oracle to MySQL, and Oracle to Oracle Replication
4.1. Native Applier Replication (e.g. MongoDB)
4.1. Batch Loading
4.1. Schema Creation and Replication
5. Heterogeneous Oracle Deployments
5.1. Oracle Replication using Redo Reader
5.1.1. Oracle Redo Reader Replication Operation
5.1.2. Preparing the Oracle Environment for Replication
5.1.3. Installing an Oracle to Oracle Deployment
5.1.4. Setting the Replication Start Position
5.1.5. Provisioning an Oracle Replication Solution
5.1.6. Oracle Redo Reader Tuning
5.1.7. Changing the Configured Schema
5.2. Deploying Oracle Replication for Disaster Recovery
5.2.1. Prepare: Oracle Replication for Disaster Recovery
5.2.2. Install: Oracle Replication for Disaster Recovery
5.2.3. Best Practices: Oracle Replication for Disaster Recovery
5.3. Deploying Oracle Replication for Migration
5.3.1. Prepare: Oracle Replication for Migration
5.3.2. Install: Oracle Replication for Migration
5.3.3. Best Practices: Oracle Replication for Migration
5.4. Deploying Oracle to MySQL Replication
5.4.1. Prepare: Oracle to MySQL Replication
5.4.2. Install: Oracle to MySQL Replication
5.4.3. Best Practices: Oracle to MySQL Replication
5.5. Deploying Oracle to Hadoop Replication
5.5.1. Prepare: Oracle to Hadoop Replication
5.5.2. Install: Oracle to Hadoop Replication
5.5.3. Best Practices: Oracle to Hadoop Replication
5.6. Deploying Oracle to Vertica Replication
5.6.1. Prepare: Oracle to Vertica Replication
5.6.2. Install: Oracle to Vertica Replication
5.6.3. Best Practices: Oracle to Vertica Replication
5.7. Deploying Oracle Replication using CDC
5.7.1. How Oracle Extraction Works
5.7.2. Data Type Differences and Limitations
5.7.3. Creating an Oracle to MySQL Deployment
5.7.4. Creating an Oracle to Oracle Deployment
5.7.5. Deployment with Provisioning
5.7.6. Updating CDC after Schema Changes
5.7.7. CDC Cleanup and Correction
5.7.8. Tuning CDC Extraction
5.7.9. Troubleshooting Oracle CDC Deployments
6. Heterogeneous MySQL Deployments
6.1. Deploying a Heterogeneous MySQL Source Replicator
6.1.1. Preparing MySQL Hosts for Heterogeneous Deployments
6.1.2. Choosing a Master MySQL Standalone Replication Type
6.2. Deploying MySQL to Oracle Replication
6.2.1. Prepare: MySQL to Oracle Replication
6.2.2. Install: MySQL to Oracle Replication
6.3. Deploying MySQL to MongoDB Replication
6.3.1. Preparing Hosts for MongoDB Replication
6.3.2. Installing MongoDB Replication
6.3.3. Management and Monitoring of MongoDB Deployments
6.4. Deploying MySQL to Hadoop Replication
6.4.1. Hadoop Replication Operation
6.4.2. Preparing Hosts for Hadoop Replication
6.4.3. Installing Hadoop Replication
6.5. Deploying MySQL to Amazon RDS Replication
6.5.1. Preparing Hosts for Amazon RDS Replication
6.5.2. Installing MySQL to Amazon RDS Replication
6.5.3. Management and Monitoring of Amazon RDS Deployments
6.5.4. Changing Amazon RDS Instance Configurations
6.6. Deploying Amazon RDS to MySQL Replication
6.6.1. Preparing Hosts for Replicating from Amazon RDS
6.6.2. Installing Amazon RDS to MySQL Replication
6.6.3. Management and Monitoring Deployment from Amazon RDS
6.6.4. Changing Amazon RDS Instance Configurations
6.7. Deploying MySQL to Amazon Redshift Replication
6.7.1. Redshift Replication Operation
6.7.2. Preparing Hosts for Amazon Redshift Deployments
6.7.3. Installing Amazon Redshift Replication
6.7.4. Verifying your Redshift Installation
6.7.5. Keeping CDC Information
6.7.6. Management and Monitoring of Amazon Redshift Deployments
6.7.7. Troubleshooting Amazon Redshift Installations
6.8. Deploying MySQL to Vertica Replication
6.8.1. Preparing Hosts for Vertica Deployments
6.8.2. Installing Vertica Replication
6.8.3. Management and Monitoring of Vertica Deployments
6.8.4. Troubleshooting Vertica Installations
6.9. Deploying MySQL to Elasticsearch Replication
6.9.1. Preparing Hosts for Elasticsearch Replication
6.9.2. Installing Elasticsearch Replication
6.9.3. Management and Monitoring of Elasticsearch Deployments
6.10. Deploying MySQL to Kafka Replication
6.10.1. Preparing Hosts for Kafka Replication
6.10.2. Installing Kafka Replication
6.10.3. Management and Monitoring of Kafka Deployments
6.11. Deploying MySQL to Cassandra Replication
6.11.1. Preparing Hosts for Cassandra Deployments
6.11.2. Installing Cassandra Replication
6.11.3. Management and Monitoring of Cassandra Deployments
6.11.4. Troubleshooting Cassandra Installations
7. Advanced Deployments
7.1. Deploying Parallel Replication
7.1.1. Application Prerequisites for Parallel Replication
7.1.2. Enabling Parallel Apply
7.1.3. Channels
7.1.4. Disk vs. Memory Parallel Queues
7.1.5. Parallel Replication and Offline Operation
7.1.6. Adjusting Parallel Replication After Installation
7.1.7. Monitoring Parallel Replication
7.1.8. Controlling Assignment of Shards to Channels
7.2. Batch Loading for Data Warehouses
7.2.1. How It Works
7.2.2. Important Limitations
7.2.3. Batch Applier Setup
7.2.4. JavaScript Batchloader Scripts
7.2.5. Staging Tables
7.2.6. Character Sets
7.2.7. Supported CSV Formats
7.2.8. Columns in Generated CSV Files
7.2.9. Batchloading Opcodes
7.2.10. Time Zones
7.3. Additional Configuration and Deployment Options
7.3.1. Deploying Multiple Replicators on a Single Host
7.4. Deploying SSL Secured Replication and Administration
7.4.1. Creating the Truststore and Keystore
7.4.2. SSL and Administration Authentication
7.4.3. Configuring the Secure Service through tpm
7.5. Deployment Security
7.5.1. Disabling Security
7.5.2. Creating Suitable Certificates
7.5.3. Installing from a Staging Host with Manually Generated Certificates
7.5.4. Installing via INI File with Manually Generated Certificates
7.5.5. Replacing the TLS Certificate from a Staging Directory
7.5.6. Removing TLS Encryption from a Staging Directory
8. Operations Guide
8.1. The Tungsten Replication Home Directory
8.2. Establishing the Shell Environment
8.3. Replicator Roles
8.4. Checking Replication Status
8.4.1. Understanding Replicator States
8.4.2. Replicator States During Operations
8.4.3. Changing Replicator States
8.5. Managing Transaction Failures
8.5.1. Identifying a Transaction Mismatch
8.5.2. Skipping Transactions
8.6. Provision or Reprovision a Slave
8.7. Creating a Backup
8.7.1. Using a Different Backup Tool
8.7.2. Using a Different Directory Location
8.7.3. Creating an External Backup
8.8. Restoring a Backup
8.8.1. Restoring a Specific Backup
8.8.2. Restoring an External Backup
8.8.3. Restoring from Another Slave
8.8.4. Manually Recovering from Another Slave
8.9. Deploying Automatic Replicator Recovery
8.10. Migrating and Seeding Data
8.10.1. Migrating from MySQL Native Replication 'In-Place'
8.10.2. Migrating from MySQL Native Replication Using a New Service
8.10.3. Seeding Data through MySQL
8.10.4. Seeding Data through tungsten_provision_thl
8.11. Using the Parallel Extractor
8.11.1. Advanced Configuration Parameters
8.12. Switching Master Hosts
8.13. Configuring Parallel Replication
8.14. Performing Database or OS Maintenance
8.14.1. Performing Maintenance on a Single Slave
8.14.2. Performing Maintenance on a Master
8.14.3. Performing Maintenance on an Entire Dataservice
8.14.4. Upgrading or Updating your JVM
8.15. Making Online Schema Changes
8.16. Upgrading Tungsten Replicator
8.16.1. Upgrading Tungsten Replication using tpm
8.16.2. Installing an Upgraded JAR Patch
8.17. Monitoring Tungsten Replication
8.17.1. Managing Log Files with logrotate
8.17.2. Monitoring Status Using cacti
8.17.3. Monitoring Status Using nagios
8.18. Rebuilding THL on the Master
9. Command-line Tools
9.1. The clean_release_directory Command
9.2. The check_tungsten_latency Command
9.3. The check_tungsten_online Command
9.4. The check_tungsten_services Command
9.5. The deployall Command
9.6. The ddlscan Command
9.6.1. Optional Arguments
9.6.2. Supported Templates and Usage
9.7. The dsctl Command
9.7.1. dsctl get Command
9.7.2. dsctl set Command
9.7.3. dsctl reset Command
9.7.4. dsctl help Command
9.8. env.sh Script
9.9. The load-reduce-check Tool
9.9.1. Generating Staging DDL
9.9.2. Generating Live DDL
9.9.3. Materializing a View
9.9.4. Generating Sqoop Load Commands
9.9.5. Generating Metadata
9.9.6. Compare Loaded Data
9.10. The materialize Command
9.11. The multi_trepctl Command
9.11.1. multi_trepctl Options
9.11.2. multi_trepctl Commands
9.12. The prepare-offboard-fetcher.pl Command
9.13. The query Command
9.14. The replicator Command
9.15. The setupCDC.sh Command
9.16. The startall Command
9.17. The stopall Command
9.18. The thl Command
9.18.1. thl Position Commands
9.18.2. thl list Command
9.18.3. thl index Command
9.18.4. thl purge Command
9.18.5. thl info Command
9.18.6. thl help Command
9.19. The trepctl Command
9.19.1. trepctl Options
9.19.2. trepctl Global Commands
9.19.3. trepctl Service Commands
9.20. The tpasswd Command
9.21. The tungsten_provision_thl Command
9.21.1. Provisioning from RDS
9.21.2. tungsten_provision_thl Reference
9.22. The tungsten_provision_slave Script
9.23. The tungsten_read_master_events Script
9.24. The tungsten_send_diag Script
9.25. The tungsten_set_position Script
9.26. The undeployall Command
9.27. The updateCDC.sh Command
9.28. The vmrr Command
10. The tpm Deployment Command
10.1. Comparing Staging and INI tpm Methods
10.2. Processing Installs and Upgrades
10.3. tpm Staging Configuration
10.3.1. Configuring default options for all services
10.3.2. Configuring a single service
10.3.3. Configuring a single host
10.3.4. Reviewing the current configuration
10.3.5. Installation
10.3.6. Upgrades from a Staging Directory
10.3.7. Configuration Changes from a Staging Directory
10.3.8. Converting from INI to Staging
10.4. tpm INI File Configuration
10.4.1. Creating an INI file
10.4.2. Installation with INI File
10.4.3. Upgrades with an INI File
10.4.4. Configuration Changes with an INI file
10.4.5. Converting from Staging to INI
10.5. tpm Commands
10.5.1. tpm configure Command
10.5.2. tpm diag Command
10.5.3. tpm fetch Command
10.5.4. tpm firewall Command
10.5.5. tpm help Command
10.5.6. tpm install Command
10.5.7. tpm mysql Command
10.5.8. tpm query Command
10.5.9. tpm reset Command
10.5.10. tpm reset-thl Command
10.5.11. tpm restart Command
10.5.12. tpm reverse Command
10.5.13. tpm ssh-copy-cert Command
10.5.14. tpm start Command
10.5.15. tpm stop Command
10.5.16. tpm update Command
10.5.17. tpm validate Command
10.5.18. tpm validate-update Command
10.6. tpm Common Options
10.7. tpm Validation Checks
10.8. tpm Configuration Options
10.8.1. A tpm Options
10.8.2. B tpm Options
10.8.3. C tpm Options
10.8.4. D tpm Options
10.8.5. E tpm Options
10.8.6. F tpm Options
10.8.7. H tpm Options
10.8.8. I tpm Options
10.8.9. J tpm Options
10.8.10. L tpm Options
10.8.11. M tpm Options
10.8.12. N tpm Options
10.8.13. O tpm Options
10.8.14. P tpm Options
10.8.15. R tpm Options
10.8.16. S tpm Options
10.8.17. T tpm Options
10.8.18. U tpm Options
10.8.19. V tpm Options
10.8.20. W tpm Options
11. Replication Filters
11.1. Enabling/Disabling Filters
11.2. Enabling Additional Filters
11.3. Filter Status
11.4. Filter Reference
11.4.1. ansiquotes.js Filter
11.4.2. BidiRemoteSlave (BidiSlave) Filter
11.4.3. breadcrumbs.js Filter
11.4.4. BuildAuditTable Filter
11.4.5. BuildIndexTable Filter
11.4.6. CaseMapping (CaseTransform) Filter
11.4.7. CDCMetadata (CustomCDC) Filter
11.4.8. ColumnName Filter
11.4.9. ConsistencyCheck Filter
11.4.10. ConvertStringFromMySQL Filter
11.4.11. DatabaseTransform (dbtransform) Filter
11.4.12. dbrename.js Filter
11.4.13. dbselector.js Filter
11.4.14. dbupper.js Filter
11.4.15. dropcolumn.js Filter
11.4.16. dropcomments.js Filter
11.4.17. dropmetadata.js Filter
11.4.18. dropstatementdata.js Filter
11.4.19. Dummy Filter
11.4.20. EnumToString Filter
11.4.21. EventMetadata Filter
11.4.22. foreignkeychecks.js Filter
11.4.23. Heartbeat Filter
11.4.24. insertsonly.js Filter
11.4.25. Logging Filter
11.4.26. MySQLSessionSupport (mysqlsessions) Filter
11.4.27. NetworkClient Filter
11.4.28. nocreatedbifnotexists.js Filter
11.4.29. OptimizeUpdates Filter
11.4.30. PrimaryKey Filter
11.4.31. PrintEvent Filter
11.4.32. Rename Filter
11.4.33. ReplicateColumns Filter
11.4.34. Replicate Filter
11.4.35. SetToString Filter
11.4.36. Shard Filter
11.4.37. shardbyseqno.js Filter
11.4.38. shardbytable.js Filter
11.4.39. SkipEventByType Filter
11.4.40. TimeDelay (delay) Filter
11.4.41. tosingledb.js Filter
11.4.42. truncatetext.js Filter
11.4.43. zerodate2null.js Filter
11.5. JavaScript Filters
11.5.1. Writing JavaScript Filters
12. Performance and Tuning
12.1. Block Commit
12.1.1. Monitoring Block Commit Status
12.2. Improving Network Performance
12.3. Tungsten Replicator Block Commit and Memory Usage
A. Release Notes
A.1. Tungsten Replicator 5.2.1 GA (21 Sep 2017)
A.2. Tungsten Replicator 5.2.0 GA (19 July 2017)
B. Prerequisites
B.1. Requirements
B.1.1. Operating Systems Support
B.1.2. Database Support
B.1.3. RAM Requirements
B.1.4. Disk Requirements
B.1.5. Java Requirements
B.1.6. Cloud Deployment Requirements
B.2. Staging Host Configuration
B.3. Host Configuration
B.3.1. Creating the User Environment
B.3.2. Configuring Network and SSH Environment
B.3.3. Directory Locations and Configuration
B.3.4. Configure Software
B.3.5. sudo Configuration
B.4. MySQL Database Setup
B.4.1. MySQL Version Support
B.4.2. MySQL Configuration
B.4.3. MySQL User Configuration
B.4.4. MySQL Unprivileged Users
B.5. Oracle Database Setup
B.5.1. Oracle Version Support
B.5.2. Oracle Environment Variables
C. Troubleshooting
C.1. Contacting Support
C.1.1. Support Request Procedure
C.1.2. Creating a Support Account
C.1.3. Generating Diagnostic Information
C.1.4. Open a Support Ticket
C.1.5. Open a Support Ticket via Email
C.1.6. Getting Updates for all Company Support Tickets
C.1.7. Support Severity Level Definitions
C.2. Error/Cause/Solution
C.2.1. There were issues configuring the sandbox MySQL server
C.2.2. 'subscription exists' when setting up CDC on Oracle
C.2.3. Too many open processes or files
C.2.4. Replicator runs out of memory
C.2.5. OptimizeUpdatesFilter cannot filter, because column and key count is different. Make sure that it is defined before filters which remove keys (eg. PrimaryKeyFilter)
C.2.6. ORA-00257: ARCHIVER ERROR. CONNECT INTERNAL ONLY, UNTIL FREED
C.2.7. Unable to update the configuration of an installed directory
C.2.8. Services requires a reset
C.2.9. Attempt to write new log record with equal or lower fragno: seqno=3 previous stored fragno=32767 attempted new fragno=-32768
C.2.10. The session variable SQL_MODE when set to include ALLOW_INVALID_DATES does not apply statements correctly on the slave.
C.2.11. MySQLExtractException: unknown data type 0
C.3. Known Issues
C.3.1. Triggers
C.4. Troubleshooting Timeouts
C.5. Troubleshooting Backups
C.6. Running Out of Diskspace
C.7. Troubleshooting SSH and tpm
C.8. Troubleshooting Data Differences
C.8.1. Identify Structural Differences
C.8.2. Identify Data Differences
C.9. Comparing Table Data
C.10. Troubleshooting Memory Usage
D. Files, Directories, and Environment
D.1. The Tungsten Replication Install Directory
D.1.1. The backups Directory
D.1.2. The releases Directory
D.1.3. The service_logs Directory
D.1.4. The share Directory
D.1.5. The thl Directory
D.1.6. The tungsten Directory
D.2. Log Files
D.3. Environment Variables
E. Terminology Reference
E.1. Transaction History Log (THL)
E.1.1. THL Format
E.2. Generated Field Reference
E.2.1. Terminology: Fields accessFailures
E.2.2. Terminology: Fields active
E.2.3. Terminology: Fields activeSeqno
E.2.4. Terminology: Fields appliedLastEventId
E.2.5. Terminology: Fields appliedLastSeqno
E.2.6. Terminology: Fields appliedLatency
E.2.7. Terminology: Fields applier.class
E.2.8. Terminology: Fields applier.name
E.2.9. Terminology: Fields applyTime
E.2.10. Terminology: Fields autoRecoveryEnabled
E.2.11. Terminology: Fields autoRecoveryTotal
E.2.12. Terminology: Fields averageBlockSize
E.2.13. Terminology: Fields blockCommitRowCount
E.2.14. Terminology: Fields cancelled
E.2.15. Terminology: Fields channel
E.2.16. Terminology: Fields channels
E.2.17. Terminology: Fields clusterName
E.2.18. Terminology: Fields commits
E.2.19. Terminology: Fields committedMinSeqno
E.2.20. Terminology: Fields criticalPartition
E.2.21. Terminology: Fields currentBlockSize
E.2.22. Terminology: Fields currentEventId
E.2.23. Terminology: Fields currentLastEventId
E.2.24. Terminology: Fields currentLastFragno
E.2.25. Terminology: Fields currentLastSeqno
E.2.26. Terminology: Fields currentTimeMillis
E.2.27. Terminology: Fields dataServerHost
E.2.28. Terminology: Fields discardCount
E.2.29. Terminology: Fields doChecksum
E.2.30. Terminology: Fields estimatedOfflineInterval
E.2.31. Terminology: Fields eventCount
E.2.32. Terminology: Fields extensions
E.2.33. Terminology: Fields extractTime
E.2.34. Terminology: Fields extractor.class
E.2.35. Terminology: Fields extractor.name
E.2.36. Terminology: Fields filter.#.class
E.2.37. Terminology: Fields filter.#.name
E.2.38. Terminology: Fields filterTime
E.2.39. Terminology: Fields flushIntervalMillis
E.2.40. Terminology: Fields fsyncOnFlush
E.2.41. Terminology: Fields headSeqno
E.2.42. Terminology: Fields intervalGuard
E.2.43. Terminology: Fields lastCommittedBlockSize
E.2.44. Terminology: Fields lastCommittedBlockTime
E.2.45. Terminology: Fields latestEpochNumber
E.2.46. Terminology: Fields logConnectionTimeout
E.2.47. Terminology: Fields logDir
E.2.48. Terminology: Fields logFileRetainMillis
E.2.49. Terminology: Fields logFileSize
E.2.50. Terminology: Fields masterConnectUri
E.2.51. Terminology: Fields masterListenUri
E.2.52. Terminology: Fields maxChannel
E.2.53. Terminology: Fields maxDelayInterval
E.2.54. Terminology: Fields maxOfflineInterval
E.2.55. Terminology: Fields maxSize
E.2.56. Terminology: Fields maximumStoredSeqNo
E.2.57. Terminology: Fields minimumStoredSeqNo
E.2.58. Terminology: Fields name
E.2.59. Terminology: Fields offlineRequests
E.2.60. Terminology: Fields otherTime
E.2.61. Terminology: Fields pendingError
E.2.62. Terminology: Fields pendingErrorCode
E.2.63. Terminology: Fields pendingErrorEventId
E.2.64. Terminology: Fields pendingErrorSeqno
E.2.65. Terminology: Fields pendingExceptionMessage
E.2.66. Terminology: Fields pipelineSource
E.2.67. Terminology: Fields processedMinSeqno
E.2.68. Terminology: Fields queues
E.2.69. Terminology: Fields readOnly
E.2.70. Terminology: Fields relativeLatency
E.2.71. Terminology: Fields resourcePrecedence
E.2.72. Terminology: Fields rmiPort
E.2.73. Terminology: Fields role
E.2.74. Terminology: Fields seqnoType
E.2.75. Terminology: Fields serializationCount
E.2.76. Terminology: Fields serialized
E.2.77. Terminology: Fields serviceName
E.2.78. Terminology: Fields serviceType
E.2.79. Terminology: Fields shard_id
E.2.80. Terminology: Fields simpleServiceName
E.2.81. Terminology: Fields siteName
E.2.82. Terminology: Fields sourceId
E.2.83. Terminology: Fields stage
E.2.84. Terminology: Fields started
E.2.85. Terminology: Fields state
E.2.86. Terminology: Fields stopRequested
E.2.87. Terminology: Fields store.#
E.2.88. Terminology: Fields storeClass
E.2.89. Terminology: Fields syncInterval
E.2.90. Terminology: Fields taskCount
E.2.91. Terminology: Fields taskId
E.2.92. Terminology: Fields timeInCurrentEvent
E.2.93. Terminology: Fields timeInStateSeconds
E.2.94. Terminology: Fields timeoutMillis
E.2.95. Terminology: Fields totalAssignments
E.2.96. Terminology: Fields transitioningTo
E.2.97. Terminology: Fields uptimeSeconds
E.2.98. Terminology: Fields version
F. Internals
F.1. Extending Backup and Restore Behavior
F.1.1. Backup Behavior
F.1.2. Restore Behavior
F.1.3. Writing a Custom Backup/Restore Script
F.1.4. Enabling a Custom Backup Script
F.2. Character Sets in Database and Tungsten Replication
F.3. Understanding Replication of Date/Time Values
F.3. Best Practices
F.4. Memory Tuning and Performance
F.4.1. Understanding Tungsten Replicator Memory Tuning
F.5. Tungsten Replicator Stages
F.6. Tungsten Replication Schemas
G. Frequently Asked Questions (FAQ)
H. Ecosystem Support
H.1. Continuent Github Repositories
I. Configuration Property Reference

List of Figures

3.1. Topologies: Master/Slave
3.2. Topologies: Multiple-masters
3.3. Topologies: Fan-in
3.4. Topologies: Replicating Data Out of a Cluster
3.5. Topologies: Replicating into a Dataservice
4.1. Topologies: Heterogeneous Operation
5.1. Topologies: Oracle to Oracle with Redo Reader
5.2. Topologies: Oracle to Oracle with Redo Reader for Migration
5.3. Topologies: Oracle to MySQL with Redo Reader
5.4. Topologies: Oracle to Hadoop with Redo Reader
5.5. Topologies: Oracle to HP Vertica with Redo Reader
5.6. Topologies: MySQL to Oracle
5.7. Topologies: Oracle to MySQL
5.8. Topologies: Oracle to Oracle
5.9. Oracle Extraction with Synchronous CDC
5.10. Oracle Extraction with Asynchronous CDC
6.1. Topologies: MySQL to Oracle
6.2. Topologies: MySQL to MongoDB
6.3. Topologies: MySQL to Hadoop
6.4. Topologies: MySQL to Hadoop Replication Operation
6.5. Topologies: MySQL to Amazon RDS
6.6. Topologies: Amazon RDS to MySQL
6.7. Topologies: MySQL to Amazon Redshift
6.8. Topologies: MySQL to Redshift Replication Operation
6.9. Topologies: MySQL to Vertica
6.10. Topologies: MySQL to Elasticsearch
6.11. Topologies: MySQL to Kafka
6.12. Topologies: MySQL to Cassandra
7.1. Batchloading: JavaScript
8.1. Migration: Migrating Native Replication using a New Service
8.2. Parallel Extractor: Extraction Sequence
8.3. Parallel Extractor: Extraction Operation
8.4. Cacti Monitoring: Example Graphs
10.1. tpm Staging Based Deployment
10.2. tpm INI Based Deployment
11.1. Filters: Pipeline Stages on Masters
11.2. Filters: Pipeline Stages on Slaves
B.1. Tungsten Deployment

List of Tables

2.1. Key Terminology
5.1. Data Type differences when replicating data from MySQL to Oracle
5.2. Data Type Differences when Replicating from Oracle to MySQL or Oracle
5.3. setupCDC.conf Configuration File Parameters
6.1. Data Type differences when replicating data from MySQL to Oracle
6.2. Hadoop Replication Directory Locations
6.3. Optional Elasticsearch Applier Properties
6.4. Optional Kafka Applier Properties
7.1. Continuent Tungsten Directory Structure
9.1. check_tungsten_latency Options
9.2. check_tungsten_online Options
9.3. check_tungsten_services Options
9.4. ddlscan Command-line Options
9.5. ddlscan Supported Templates
9.6. dsctl Commands
9.7. dsctl Command-line Options
9.8. dsctl Command-line Options
9.9. dsctl Command-line Options
9.10. multi_trepctl Command-line Options
9.11. multi_trepctl--output Option
9.12. multi_trepctl Commands
9.13. prepare-offboard-fetcher.pl Common Options
9.14. query Common Options
9.15. replicator Commands
9.16. replicator Commands Options for condrestart
9.17. replicator Commands Options for console
9.18. replicator Commands Options for restart
9.19. replicator Commands Options for start
9.20. setupCDC.conf Configuration Options
9.21. thl Options
9.22. trepctl Command-line Options
9.23. trepctl Replicator Wide Commands
9.24. trepctl Service Commands
9.25. trepctl backup Command Options
9.26. trepctl clients Command Options
9.27. trepctl offline-deferred Command Options
9.28. trepctl online Command Options
9.29. trepctl purge Command Options
9.30. trepctl reset Command Options
9.31. trepctl setrole Command Options
9.32. trepctl shard Command Options
9.33. trepctl status Command Options
9.34. trepctl wait Command Options
9.35. tpasswd Common Options
9.36. tungsten_provision_slave Command-line Options
9.37. tungsten_read_master_events Command-line Options
9.38. tungsten_send_diag Command-line Options
9.39. tungsten_set_position Command-line Options
10.1. TPM Deployment Methods
10.2. tpm Core Options
10.3. tpm Commands
10.4. tpm Common Options
10.5. tpm Validation Checks
10.6. tpm Configuration Options
D.1. Continuent Tungsten Directory Structure
D.2. Continuent Tungsten tungsten Sub-Directory Structure
E.1. THL Event Format