Meniscus is a tenant aware, scalable, distributed, streaming framework for processing, and transforming log messages from multiple and diverse event sources. Meniscus follows a source to sink model and allows for messages to be routed through a grid of load balanced workers to absorb load and enhance messages based on tenant configuration.
Meniscus Design Goals
* Stress the utilization of standards, of which there are many for this problem domain
* Adhere to compliance rules related to system and application event logging
* Support multiple tenants in secure isolation
* Impact client infrastructure as little as possible
* Allow for direct application integration via a structured publication endpoint
* Design for platform efficiency, durability and scalability
* Provide administrators with text search capability of all events processed and stored for a given tenant
* Provide well formed a set of API specifications for configuration and administration
* Provide common sinks for already existing systems such as Ceilometer
* The architecture must be resilient to multiple failures
* Support end-to-end runtime mutability via hot configuration swapping
View full history Series and milestones
trunk series is the current focus of development.
