https://www.i-programmer.info/news/150-training-a-education/15816-2022-10-22-15-13-25.html * I Programmer HOME Toggle Navigation * Books + Book Reviews + Book Watch + Programmer's Bookshelf + Bargain Computer Books * Articles + The Core o Python o Javascript o WPF Workings o Joomla o PHP o Theory o Silverlight o C# o Artifical Intelligence o Other Languages o Visual Basic o C/C++ o Mobile o Database o ASP .NET o Hardware/IoT o Graphics/Imaging o UI/UX o Perl o WinRT o HTML/CSS o jQuery o Ruby o Android o Security o Methodology & Testing o Cloud + Babbage's Bag + Projects + Programmer Puzzles o C# o C++ o Java o JavaScript o Python o PHP o Sharpen Your Coding Skills + History o Machines o People o Software & computer languages + Swift's Spreadsheets o Finance o Personal o General + Professional Programmer o Accreditation & Training o I Programmer o Resources and Tools + I Programmer Weekly + eBooks + Stone Tapes + CodeBin * News + o Register o Change Region o About Us + Take The ETH Zurich Big Data Course For Free Written by Nikos Vaggalis Friday, 28 October 2022 A great course on everything Big Data taught at ETH Zurich University by Professor Ghislain Fourny. The recorded lectures of fall 2021 are up on Youtube for everyone to enjoy. The notion behind Big Data that this course adopts is that : Information society has to turn data into information, information into knowledge, knowledge into value. This has become increasingly complex. Data comes in larger volumes, diverse shapes, from different sources. Data is more heterogeneous and less structured than forty years ago. Nevertheless, it still needs to be processed fast, with support for complex operations. The course revolves around the database technologies and the most important database design principles that lay the foundations of the Big Data universe. These are distributed storage, the syntax, models, validation, processing, indexing, and querying, all fitted to the Big Data model. Looking more into them we find that they are expanded into : * physical storage: distributed file systems (HDFS), object storage (S3), key-value stores * logical storage: document stores (MongoDB), column stores (HBase), graph databases (neo4j), data warehouses (ROLAP) * data formats and syntaxes (XML, JSON, RDF, Turtle, CSV, XBRL, YAML, protocol buffers, Avro) * data shapes and models (tables, trees, graphs, cubes) * type systems and schemas: atomic types, structured types (arrays, maps), set-based type systems (?, *, ) * an overview of functional, declarative programming languages across data shapes (SQL, XQuery, JSONiq, Cypher, MDX) * the most important query paradigms (selection, projection, joining, grouping, ordering, windowing) * paradigms for parallel processing, two-stage (MapReduce) and DAG-based (Spark) * resource management (YARN) * what a data center is made of and why it matters (racks, nodes, . . . ) * underlying architectures (internal machinery of HDFS, HBase, Spark, neo4j) * optimization techniques (functional and declarative paradigms, query plans, rewrites, indexing) * applications Subsequently, those subjects are spread out in a 40 recorded lectures, each video up to 45 minutes in length : * Introduction * Lessons learnt (1/2/3) * Object storage (1/2/3) * Distributed file systems (1/2/3) * Syntax (1/2/3) * Wide column stores (1/2/3) * Data models (1/2/3) * Massive Parallel Processing I MapReduce (1/2) * Resource management (1/2) * Massive parallel processing II: Spark (1/2/3/4) * Performance at large scales (1/2) * Document stores (1/2/3/4) * Querying trees (1/2/3/4) * Graph databases (1/2/3) * Data warehouses and cubes (1/2/3) * Wrap up (1/2) All the videos are very interesting but I particularly liked the series on "Wide column stores". There also "Big Data for Engineers" being taught which is similar to Big Data, but it's adapted for non Computer Scientists. Big Data is addressed purely to Computer Science students. In the end watching through should have gained you an overview and understanding of the Big Data landscape.Armed with this knowledge you should be able to make informed decisions addressing any of your projects' needs. ethlogo More Information YouTube playlist Related Articles OS-Climate - Open Source To Tackle Climate Change Google's Cloud Spanner To Settle the Relational vs NoSQL Debate? To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on Twitter, Facebook or Linkedin. Banner --------------------------------------------------------------------- Isis Improves Value Types 13/10/2022 Apache Isis, a framework for developing UIs for domain-driven apps in Java, has been updated with a new milestone release. Isis 2 M8 adds new core extensions and has major improvements to its value ty [ ... ] + Full Story --------------------------------------------------------------------- Amazon Astro Can Patrol Your Home And Business 02/10/2022 Astro, Amazon's diminutive wheeled robot, is no longer just a home robot. It security features now target small to medium-sized businesses and it has a new role as a pet minder. + Full Story More News * Kotlin Multiplatform Libraries Now In Preview * TypeScript A Decade On * Meta Identifies 400 Apps That Steal Logins * Deno Adds API Support For Node.js Compatibility * Sigstore Reaches General Availability * Next.js Adds Turbopack Bundler * Brand New Data Science Courses on edX * Whisper Open Source Speech Recognition You Can Use * Matter V1.0 Announced * Python 3.11 Released * Memorial University's Intro to Game Programming * PostgreSQL 15 Released - What's New * JetBrains Fleet IDE Now In Public Preview pythondata Comments Make a Comment or View Existing Comments Using Disqus or email your comment to: comments@i-programmer.info Last Updated ( Friday, 28 October 2022 ) [INS::INS] RSS feed of news items only I Programmer News Copyright (c) 2009-2022 i-programmer.info. All Rights Reserved.