'

Collecting Uncertain Data the Reactive Way

Понравилась презентация – покажи это...





Слайд 0

Collecting Uncertain Data the Reactive Way Jeff Smith @jeffksmithjr


Слайд 1

x.ai is a personal assistant who schedules meetings for you


Слайд 2


Слайд 3

Reactive Machine Learning


Слайд 4


Слайд 5


Слайд 6


Слайд 7

Machine Learning Systems


Слайд 8

Machine Learning Systems


Слайд 9

Machine Learning Systems


Слайд 10

Traits of Reactive Systems


Слайд 11

Traits of Reactive Systems


Слайд 12

Reactive Strategies


Слайд 13

Reactive Strategies


Слайд 14

Reactive Machine Learning


Слайд 15

Reactive Machine Learning


Слайд 16

Reactive Machine Learning


Слайд 17

Collecting Data


Слайд 18


Слайд 19


Слайд 20


Слайд 21

What’s for dinner?


Слайд 22


Слайд 23


Слайд 24


Слайд 25


Слайд 26


Слайд 27


Слайд 28

Reactive Data Collection


Слайд 29

Modeling Uncertain Data


Слайд 30

Certain Data Model case class ZebraReading(sensorId: Int, locationId: Int, timestamp: Long, count: Int)


Слайд 31


Слайд 32

Uncertainty Interval 27 33


Слайд 33

Uncertain Data Model case class PreyReading(sensorId: Int, locationId: Int, timestamp: Long, animalsLowerBound: Double, animalsUpperBound: Double, percentZebras: Double)


Слайд 34

Scaling Data Collection


Слайд 35


Слайд 36

Simple Data Architecture


Слайд 37

Simple Data Architecture


Слайд 38

Mutable State case class Region(id: Int) import collection.mutable.HashMap var densities = new HashMap[Region, Double]() densities.put(Region(4), 52.4)


Слайд 39

Scaling with Queues


Слайд 40

Scaling with Queues


Слайд 41

Out of Order Updates


Слайд 42

Out of Order Updates densities.put(Region(6), 73.6) densities.put(Region(6), 0.5) densities.get(Region(6)).get


Слайд 43

Out of Order Updates densities.put(Region(6), 73.6) densities.put(Region(6), 0.5) densities.get(Region(6)).get densities.put(Region(6), 0.5) densities.put(Region(6), 73.6) densities.get(Region(6)).get


Слайд 44

Concurrent Collections import collection.mutable._ var synchronizedDensities = new LinkedHashMap[Region, Double]() with SynchronizedMap[Region, Double]


Слайд 45

Scaling with Locks


Слайд 46

Scaling with Locks


Слайд 47

Immutable Facts case class PreyReading(sensorId: Int, locationId: Int, timestamp: Long, animalsLowerBound: Double, animalsUpperBound: Double, percentZebras: Double) implicit val preyReadingFormatter = Json.format[PreyReading]


Слайд 48

Immutable Facts val reading = PreyReading(36, 12, currentTimeMillis(), 12.0, 18.0, 0.60) val setDoc = bucket.set[PreyReading](readingId(reading), reading)


Слайд 49

Scaling with Distributed Databases


Слайд 50

Scaling with Distributed Databases


Слайд 51

Handling Incomplete Data


Слайд 52

Distributed Data Storage


Слайд 53

Querying Complete Data (bucket.searchValues[PreyReading]("prey", "by_sensor_id") (new Query().setIncludeDocs(true))) .enumerate.apply(Iteratee.foreach { doc => println(s"Prey Reading: $doc")})


Слайд 54

Complete Data


Слайд 55

Partition Tolerance


Слайд 56

Partition Tolerance


Слайд 57

Partition Tolerance


Слайд 58

Partition Tolerance


Слайд 59

Querying Incomplete Data (bucket.searchValues[PreyReading]("prey", "by_sensor_id") (new Query().setIncludeDocs(true))) .enumerate.apply(Iteratee.foreach { doc => println(s"Prey Reading: $doc")})


Слайд 60

Incomplete Data


Слайд 61

Incomplete Data


Слайд 62

Reactive Data Collection


Слайд 63

For Later


Слайд 64

MANNING reactivemachinelearning.com medium.com/data-engineering Jeff Smith


Слайд 65

x.ai @xdotai hello@human.x.ai New York, New York


Слайд 66

skillsmatter.com/conferences/ 6862-scala-exchange-2015#skillscasts


Слайд 67

Thank You


Слайд 68

Collecting Uncertain Data the Reactive Way Jeff Smith @jeffksmithjr


Слайд 69


×

HTML:





Ссылка: