discoproject/disco

Disco is a distributed computing framework that manages cluster operations, job scheduling, and data processing. It provides a Python-based CLI and web interface for controlling the master and nodes, while supporting MapReduce and pipeline-based job execution across various storage backends like HDFS, S3, and Redis. The system includes a distributed filesystem (DDFS) for data management and offers deployment automation for cloud environments.

This period established the foundational architecture of the Disco project, replacing legacy Python and shell-based build systems with a standardized Erlang/Rebar build process and C bindings. The team implemented core utility modules, configuration constants, and a new Sphinx-based documentation structure to support the framework's development.

10 changes

This period focused on introducing the DDFS distributed file system and a comprehensive set of command-line interfaces for cluster and data management. The team also reorganized the Python library structure to support multiple input schemes and improved Python 3 compatibility across the codebase.

15 changes

This period focused on stabilizing the codebase through comprehensive test coverage and introducing robust packaging for Debian and RPM distributions. It also expanded deployment options with Docker, systemd, and cloud automation scripts, while providing practical examples for complex workflows like job chaining and MapReduce algorithms.

13 changes

discoproject/disco was measured the same way every project in this corpus was: the same rubric, at a pinned commit, with the result published in full. Point the surveyor at a repository you know and see whether you agree with it.