From the course: Big Data in the Age of AI
Join today to access over 24,700 courses taught by industry experts.
Batch processing vs. stream processing
From the course: Big Data in the Age of AI
Batch processing vs. stream processing
- [Instructor] Jazz music is inseparably connected with improvisation. With a small combo, it's possible to have just the outlines of the tune and then create the whole thing on the go. When it works well, it can be an extraordinary experience. But once you have more than a few musicians, say the 15 to 20 that are in a big band, you can still have improvised solos, but everything else usually has to be composed in advance to work well, to coordinate and make a wonderful experience. There's an analogy between this, between improvisation and composition in music and in data. In jazz, the improvisation, the coming up in the stream of the moment versus the composition where the work has to be done ahead of time and you got to put a bow on it before you move on, that's a lot like in data, what is called stream processing, where you're processing the data as it comes in, live in real time, versus batch processing, where you take data that's been wrapped up and put a bow on it, it's in a…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.
