From the course: Microservices: Asynchronous Messaging
Join today to access over 24,400 courses taught by industry experts.
Log aggregation
From the course: Microservices: Asynchronous Messaging
Log aggregation
- [Instructor] Log aggregation is one of those areas in the stream data platform that we first visit. When talking about log aggregation, there are really two separate parts of the process. Most diagrams only focus on the log aggregation activities of the message broker itself. And indeed, it can aggregate logs from various systems, usually, however, in a raw format. Transformations, however, are not traditionally done in the stream data platform itself. It is usually preferred to keep all logs in the original format so as to not lose context or metadata from the log itself. As such, they become disjointed. Readability of log messages directly impacts the utilization of them. If logs are disjointed and a human has to piece them together, points will be lost. The log aggregation that I'm mostly referring to is in a consumption engine. The log messages are transformed into a common format and shipped to a system designed…
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.
