alibaba/canal

Canal is a distributed database binlog incremental subscription and consumption framework that captures real-time data changes from MySQL and MariaDB sources. It provides a modular architecture for routing these changes to various message queues like Kafka, RocketMQ, and RabbitMQ, while also supporting direct synchronization to downstream systems such as Elasticsearch, HBase, and Kudu. The system includes comprehensive administrative interfaces, remote configuration management, and monitoring capabilities to facilitate large-scale data integration and ETL workflows.

This period focused on modernizing the codebase with Java 8+ features, implementing GTID-based synchronization, and supporting MySQL 8.0 authentication protocols. The architecture was refactored to support remote configuration, dynamic MQ partitioning, and enhanced security through SSL and encrypted passwords.

62 changes

This period focused on expanding Canal's ecosystem by introducing a new client adapter framework for data synchronization to targets like HBase, RDB, and message queues. Concurrently, the project integrated Prometheus metrics and authentication into the server and embedded components, while also adding Docker support and RDS binlog parsing capabilities.

37 changes

This period focused on establishing a centralized management interface and expanding the system's connectivity. A new Canal Admin API and web UI were introduced to control server instances, while the connector core was refactored to support modular message queue integrations. Additionally, the codebase grew to include adapters for Elasticsearch, Kudu, and TableStore, alongside new client and server connectors for Kafka, RabbitMQ, RocketMQ, and Pulsar.

35 changes

This period focused on modernizing the deployment and operational capabilities of the project. Key additions included Helm charts for Kubernetes-based orchestration, multi-architecture Dockerfile support for amd64 and arm64 platforms, and enhanced security features like SSL/TLS for MySQL connections. Additionally, the codebase expanded its observability by exposing JVM metrics via Prometheus and improved reliability through comprehensive unit testing.

6 changes

alibaba/canal was measured the same way every project in this corpus was: the same rubric, at a pinned commit, with the result published in full. Point the surveyor at a repository you know and see whether you agree with it.