COMPSCI 61A Lecture Notes - Lecture 36: Fault Tolerance, Apache Spark, Mapreduce

• School: Berkeley
• Department: Computer Science
• Course: COMPSCI 61A
• Professor: De Nero John

Document Summary

Operating systems provide, stable consistent interface to unreliable, inconsistent hardware. Networks provide a robust data trasnfer interface to constantly evolving communications infrastructure databases provide declarative interface to complex software that stores and retrieves infrmation efficiently. Distributed systems provide a unified interface to a cluster of multiple machines. Unix operating system, used heavily, influential in all os design. Portability: the same os on different hardware multi-tasking : many processes running concurrently on a machine. Plain text: data is stored and shared in text format. Modularity: small tools are composed flexibly via pipes. Standard streams in a unix-like os are similar to python iterators. Python was built in a unix environemnt as another program. Refer to sys. stdin and sys. stdout values provide access to teh unix standard. Default is that people can read streams as files. Python program has an interface that supports iteration, read, and write methods. Using files tatkes advantage of the operating system text processing abstraction.