The document discusses big data computation technology and analysis using Scala. It covers the growth of big data, challenges with computing large amounts of data, and alternatives to batch processing like Hadoop. It then focuses on using Scala and Akka for big data projects due to their support for concurrency, parallelism and real-time processing. The document concludes that there are now multiple real-time alternatives beyond Hadoop for big data and that Scala and Akka are facilitating growth in this area.

1. Big Data Computation Technology And
Analysis With Scala
Vikas Hazrati, Knoldus Software LLP
Big Data Innovation
Conference (c)

2. About Me
CTO at Knoldus Software
Writing a book titled “Building
performant and concurrent systems
with Scala and Akka”
Working with Scala and Big Data for
the last 3 years
Big Data Innovation
Conference (c)

3. what?
Add content
Big Data Innovation
Conference (c)
2011 - 1.8 zettabytes
(1.8 trillion gigabytes)
big-data market is expected
to grow from
US$3.2 billion in
2010 to
US$16.9 billion in 2015

4. Big Data Innovation
Conference (c)
Lot of data
Lot of compute
Long time to compute it
so what?

5. About Me
Big Data Innovation
Conference (c)

6. hadoop
Big Data Innovation
Conference (c)
Batch processing, non interactive
X real time

7. alternates
Big Data Innovation
Conference (c)
Lucene
CEP
NoSQL
Combination
of
parallel processing

8. to build it :-{
Difficult!
Domain + Language + Performance
Big Data Innovation
Conference (c)

9. to build it :-{
Domain Expertise
Language Expertise
Performance Expertise
Big Data Innovation
Conference (c)

10. to build it :-{
Domain Expertise
Language Expertise
Performance Expertise
Big Data Innovation
Conference (c)

11. scala
Add content
Big Data Innovation
Conference (c)

12. scala
Big Data Innovation
Conference (c)

13. Big Data Innovation
Conference (c)

14. Akka
Big Data Innovation
Conference (c)

15. actor message passing
Add content
Big Data Innovation
Conference (c)

16. actor message passing
Add content
Big Data Innovation
Conference (c)

17. tooling?
Big Data Innovation
Conference (c)

18. Spark
Big Data Innovation
Conference (c)

19. Spark
Big Data Innovation
Conference (c)

20. Spark
Big Data Innovation
Conference (c)

21. Spark
Big Data Innovation
Conference (c)

22. Delite
DSL for Heterogenous Parallel
Architectures
Big Data Innovation
Conference (c)

23. Delite
Big Data Innovation
Conference (c)

24. Delite
Big Data Innovation
Conference (c)

25. decooda liquid data platform
Big Data Innovation
Conference (c)

26. Real time parallel execution
Big Data Innovation
Conference (c)

27. Big Data Innovation
Conference (c)

28. Big Data Innovation
Conference (c)

29. conclusions
Big Data Innovation
Conference (c)
Multiple real time alternatives
beyond Hadoop
Scala and Akka facilitating
growth

30. vikas@knoldus.com
www.knoldus.com
@knolspeak
fb - KnoldusSoftware
Big Data Innovation
Conference (c)