Elk - An introduction

So, what is the ELK Stack? "ELK" is the acronym for three open source projects: Elasticsearch, Logstash, and Kibana. Elasticsearch is a search and analytics engine. Logstash is a server‑side data processing pipeline that ingests data from multiple sources simultaneously, transforms it, and then sends it to a "stash" like Elasticsearch. Kibana lets users visualize data with charts and graphs in Elasticsearch.

1. Elastic Stack,
When and How?
1

2. @KeyvanIraji
[email protected]
@keyvaniraji
@HosseinShemshadi
Hossein.Shemshadi
@gmail.com
@H_Shemshadi

3. What is our problems?
•Full text search on Persian messages.
3
•BI Dashboard
•ETL
•Search engine
•Log Analyzer
•Monitoring
•Sensor Monitoring
•CQRS –read side

4. 4

5. 5

6. Which companies uses ELK
6
Supporting e-commerce
search for 60+ countries
in 21+languages
Generate Actionable
value from game play
data and server events
Searching Across 800
million listings in sub
seconds
Powering the search for
Interplanetary discovery
Delivering a better help
experience for over a
billion users
Providing search on
azure and powering
social dynamics

7. Which companies uses ELK
7
Supporting e-commerce
search for 60+ countries
in 21+languages
Unlocking yesterday’s
content for the future of
media search
Reducing system
downtime at the basis of
cisco’s cloud native
Enhancing user
experience by processing
over a billion of events
every day
Aggregating business
metrics to control critical
marketplace behaviors
And many
others…

8. Specifications
8

9. Specifications
9

10. Specifications
10

11. Specifications
11

12. Specifications
12

13. Specifications
13

14. ElasticSearchvs Relational databases
14
ElasticSearch Relationaldatabases
Index Database
Type Table
Document Row
Field Column
Analyze Index
_id Primary key
Mapping Schema
Shard Physical partition
Route Logical partition
Parent/child,nested Relational
DSL Query SQL

15. How to use
15

16. Logstash
16

17. Logstash
17

18. Logstash
18

19. ElasticSearch
19

20. ElasticSearch
20

21. ElasticSearch
21

22. CRUD
22
•Create

23. CRUD
23
•GET

24. CRUD
24
•Update

25. CRUD
25
•Delete

26. Search
26

27. Search
27

28. Kibana
28

29. Kibana
29

30. Kibana
30

31. Sample solution
31

32. Sample solution
32

33. Sample solution
33

34. Sample solution
34

35. Sample solution
35
+
+

36. Is it suitable for you?
•Data Structure.
36
•You Need ACIDity?
•You need fast write?
•You are a startup?
•Your problem is small?

37. 37

38. @KeyvanIraji
[email protected]
@keyvaniraji
@HosseinShemshadi
Hossein.Shemshadi
@gmail.com
@H_Shemshadi