5.8. Deploying MySQL to Vertica Replication
Hewlett-Packard's Vertica provides support for BigData, SQL-based analysis
and processing. Integration with MySQL enables data to be replicated live
from the MySQL database directly into Vertica without the need to manually
export and import the data.
Replication to Vertica operates as follows:
Data is extracted from the source database into THL.
When extracting the data from the THL, the Vertica replicator writes the
data into CSV files according to the name of the source tables. The
files contain all of the row-based data, including the global
transaction ID generated by Tungsten Replicator during replication, and the
operation type (insert, delete, etc) as part of the CSV data.
The CSV data is then loaded into Vertica into staging tables.
SQL statements are then executed to perform updates on the live version
of the tables, using the CSV, batch loaded, information, deleting old
rows, and inserting the new data when performing updates to work
effectively within the confines of Vertica operation.
Figure 5.9. Topologies: MySQL to Vertica
Setting up replication requires setting up both the master and slave
components as two different configurations, one for MySQL and the other for
Vertica. Replication also requires some additional steps to ensure that the
Vertica host is ready to accept the replicated data that has been extracted.
Tungsten Replicator uses all the tools required to perform these operations
during the installation and setup.