| Description |
1 online resource (1 streaming video file (34 min., 16 sec.)) |
| Performer |
Presenters, James Terwilliger, Badrish Chandramouli, Jonathan Goldstein. |
| Note |
Title from title screen (viewed July 23, 2020). |
| Summary |
"The Trill data engine is the power behind many of Microsoft's offerings, from products like Azure Stream Analytics to billion-dollar services like Bing Ads. It has now been open-sourced and is available to everyone. But it has been a long path to get there. James Terwilliger, Badrish Chandramouli, and Jonathan Goldstein explore the history of decades of streaming data processing at Microsoft: a beginning in research, a first product in StreamInsight, the transition to the cloud, and all the pain points along the way. A key result of that lineage and learning has been the Trill engine, which has three key properties a single standalone data processing engine for all temporal data, no matter if the data is streamed or stored; a simple API that integrates seamlessly with the programming language; and performance without ego, a willingness to use every lesson learned to improve throughput in every way possible. They dive deep into why each of those properties is important through examples. A simple application to demonstrate the basics of Trill: joins, aggregation, windowing; a more complicated application to demonstrate the power of Trill's API: progressive windowing, regular expressions and pattern detection, data-dependent windows; and an overview of the kind of query used by Bing Ads, a query to run a multi-billion-dollar business. You'll see a performance showcase: running the previous examples to demonstrate how Trill got its name--processing a trillion events per day on a single node. This session is from the 2019 O'Reilly Strata Conference in New York, NY."--Resource description page |
| Subject |
O'Reilly Strata Data Conference (2019 : New York, N.Y.)
|
|
Microsoft Research.
|
|
Data transmission systems.
|
|
Application program interfaces (Computer software)
|
|
Cloud computing.
|
|
Electronic data processing.
|
|
Interfaces de programmation d'applications. |
|
Infonuagique. |
|
APIs (interfaces) |
|
Application program interfaces (Computer software) |
|
Cloud computing |
|
Data transmission systems |
|
Electronic data processing |
| Added Author |
Chandramouli, Badrish, on-screen presenter.
|
|
Goldstein, Jonathan, on-screen presenter.
|
| Added Title |
Crown jewel of Microsoft's streaming pipeline explained |
|
More Resources