Distributed Async Await: A New Programming Model for the Cloud

Dive into the future of cloud dev with Distributed Async Await. Simplify your code and conquer the chaos of distributed systems. Learn the ins and outs of async-await, functions, promises, and more. Transform your approach to scalable, reliable, and delightful cloud apps. 🚀 #CloudDev #AsyncAwait

1. A ScyllaDB Community
Distributed Async Await
Dominik Tornow
Founder & CEO of Resonate HQ

2. Resonate HQ
Dominik Tornow
Founder & CEO at Resonate HQ, Inc
■Began my career in Silicon Valley in 2006
■Focus on concurrent, distributed systems
■Distributed Async Await by day
■Think Distributed Systems by night

3. Space
Time

4. Space

5. Time

6. Concurrency
P | Q

7. Distribution
P | Q | ⚡

8. P = a • b • c
Q = x • y • z

9. a • b • c • x • y • z
a • b • x • c • y • z
a • b • x • y • c • z
a • b • x • y • z • c
a • x • b • c • y • z
a • x • b • y • c • z
a • x • b • y • z • c
a • x • y • b • c • z
a • x • y • b • z • c

10. a
x
a • b
a • x
x • a
x • y
a • b • c
a • b • x
a • x • b

11. (P | Q | ⚡) ≡ (P • Q) ∨ (Q • P)

12. " #
Concurrency Partial Order Coordination
Distribution Partial Failure Recovery

14. Distributed Async Await
Dead Simple Distributed Systems

15. Dead Simple to Understand
Dead Simple to Develop
Dead Simple to Operate

16. Formalization of
Concurrent Structure
Formalization of
Recovery
Async Await local no
Distributed
Async Await
global yes

17. Express
concurrent and distributed structure
Distributed Programming Model
Execute
concurrent and distributed structure
Distributed Execution Model

19. async function downloadAndSummarizeUrls(urls: string[]) {
return Promise.all(urls.map(u => downloadAndSummarizeUrl(u)));
}
async function downloadAndSummarizeUrl(url: string) {
let content = await download(url);
let summary = await summarize(content);
return summary;
}

20. Execution
Execution
Promise
Promise
Promise
ExecutionPromise
ExecutionPromise
Promise Execution
ExecutionPromise
Execution

22. async function downloadAndSummarizeUrls(context : Context, urls: string[]) {
return Promise.all(urls.map(u => context.rfc(downloadAndSummarizeUrl, u)));
}
async function downloadAndSummarizeUrl(context : Context, url: string) {
let content = await context.lfc(download, url);
let summary = await context.lfc(summarize, content);
return summary;
}

23. Execution
Execution
Promise
ID
Promise
ID
Promise
ID
Execution
Promise
ID
Execution
Promise
ID
Promise
ID
Execution
Execution
Promise
ID
Execution

24. Execution
Execution
Promise
ID
Promise
ID
Promise
ID
Execution
Promise
ID
Execution
Promise
ID
Promise
ID
Execution
Execution
Promise
ID
Execution

25. Execution
Execution
Promise
ID
Promise
ID
Promise
ID
Execution
Promise
ID
Execution
Promise
ID
Promise
ID
Execution
Execution
Promise
ID
Execution

26. Functions & Promises
Distributed Programming Model

27. Function
Execution
Promise
Function
Execution
Promise
Caller Calleeinvokes
awaits

28. Function
Execution
Promise
Function
Execution
Promise
Caller Calleeinvokes
awaits
Unique IdentifierUnique Identifier

29. Architecture Overview
Distributed Execution Model

30. Execution Execution
Execution ExecutionExecutionExecution
Resonate
Server
Node nNode 1
Execution
λ1.1
Execution
λ1.n
Execution
λn.1
Execution
λn.n
Resonate SDK Resonate SDK
Application Layer
Distributed Application
Platform Layer
Distributed Runtime
Promise
π1.1
Promise
π1.n
Promise
πn.1
Promise
πn.n

31. Execution Execution
Execution ExecutionExecutionExecution
Resonate
Server
Node nNode 1
Execution
λ1.1
Execution
λ1.n
Execution
λn.1
Execution
λn.n
Resonate SDK Resonate SDK
Application Layer
Distributed Application
Platform Layer
Distributed Runtime
Promise
π1.1
Promise
π1.n
Promise
πn.1
Promise
πn.n

32. Execution Execution
Execution ExecutionExecutionExecution
Node nNode 1
Execution
λ1.1
Execution
λ1.n
Execution
λn.1
Execution
λn.n
Resonate SDK Resonate SDK
Application Layer
Distributed Application
Platform Layer
Distributed Runtime
Promise
π1.1
Promise
π1.n
Promise
πn.1
Promise
πn.n
Resonate
Server

33. Execution Execution
Execution ExecutionExecutionExecution
Resonate
Server
Node nNode 1
Execution
λ1.1
Execution
λ1.n
Execution
λn.1
Execution
λn.n
Resonate SDK Resonate SDK
Application Layer
Distributed Application
Platform Layer
Distributed Runtime
Promise
π1.1
Promise
π1.n
Promise
πn.1
Promise
πn.n

34. Execution Execution
Execution ExecutionExecutionExecution
Resonate
Server
Node n
Execution
λ1.1
Execution
λ1.n
Execution
λn.1
Execution
λn.n
Resonate SDK Resonate SDK
Application Layer
Distributed Application
Platform Layer
Distributed Runtime
Promise
π1.1
Promise
π1.n
Promise
πn.1
Promise
πn.n
Node 1

35. Execution Execution
Execution ExecutionExecutionExecution
Resonate
Server
Node n
Execution
λ1.1
Execution
λ1.n
Execution
λn.1
Execution
λn.n
Resonate SDK Resonate SDK
Application Layer
Distributed Application
Platform Layer
Distributed Runtime
Promise
π1.1
Promise
π1.n
Promise
πn.1
Promise
πn.n
Node 1

36. Distributed Event Loop Protocol
Distributed Execution Model

37. Caller Callee
Caller Callee
invoke function
return promise
await
return

38. Caller Promise
Caller Promise
invoke function
return promise
await
resume
Callee
Callee
register callback
return
invoke

39. Caller Server CalleeSDK SDK
create promise
invoke function
await
register callback
register callback
send invoke
invoke
return
complete promise
send resume
resume

40. Distributed Task Protocol
Distributed Async Await

41. Server Transport App Node
Server Transport App Node
claim url
claim url
claim
task
heartbeat
ack
complete
ack

42. Resonate HQ
Thank you! Let’s connect.
Dominik Tornow
[email protected]
@DominikTornow
https://resonatehq.io