menuicon

Undergraduate Study

DATA5441: Networks and High-dimensional Inference

General Information

1st semester 2021, Lecturers: Lamiae Azizi and Eduardo G. Altmann..

Forum, Notebooks, etc.

We will use Edstem. Sydney Uni students should access it from canvas or register here

Classes

Tuesdays 9-11 and Wednesdays 9-11; Carslaw Building, 8th Floor, room 829 (AGR room) or via Zoom: 8833 6350 240

Consultation time

Wednesdays 11am-12pm, via Zoom (same ID as lectures) or in office, Carslaw 522.

Assessment

Exam (40%), Assignments (30%), and Project (30%). Attendance to class is essential.

There will be assignments every one or two weeks. The final assignment mark will be the mean of the individual assignment marks.

Project

The project takes place in Weeks 12 and 13.

Abstract

In our interconnected world, networks are an increasingly important representation of datasets and systems. This unit will investigate how this network approach to problems can be pursued through the combination of mathematical models and datasets. You will learn different mathematical models of networks and understand how these models explain non-intuitive phenomena, such as the small world phenomenon (short paths between nodes despite clustering), the friendship paradox (our friends typically have more friends than we have), and the sudden appearance of epidemic-like processes spreading through networks. You will learn computational techniques needed to infer information about the mathematical models from data and, finally, you will learn how to combine mathematical models, computational techniques, and real-world data to draw conclusions about problems. More generally, network data is a paradigm for high-dimensional interdependent data, the typical problem in data science. By doing this unit you will develop computational and mathematical skills of wide applicability in studies of networks, data science, complex systems, and statistical physics.

Objectives and learning outcome

Develop analytical, numerical, and modeling skills that help to connect abstract mathematical ideas to real-world systems represented as networks.

References

  • Networks: An Introduction, Mark Newman, Oxford Univ Press, 2010.
  • Network Science book, L. Barabasi, 2017 http://barabasi.com/networksciencebook/
  • Dynamical Processes on Complex Networks, A. Barrat, M. Barthélemy, A. Vespignani, Cambridge University Press, 2012
  • Statistical mechanics of complex networks, R. Albert & A. Barabasi, Rev. Mod. Phys. 2002.
  • The Structure and Function of Complex Networks, M. Newman, SIAM Review, 2002.

Software for computation

Network data :

Tentative week-by-week outline

  • 1 (1/3) Networks, data science, and high dimensions (E)
  • 2 (8/3) Centrality measures (L)
  • 3 (15/3) Random Graph Models (L)
  • 4 (22/3) Random Graphs vs. Complex Networks (L)
  • 5 (29/3) Mechanistic models: small world and preferential attachment (L)

(Mid-semester break)

  • 6 (12/4) Exponential Random Graph Models (L)
  • 7 (19/4) Community Detection in Networks (L)
  • 8 (26/4) Inference in Networks (L)
  • 9 (2/5) Stochastic Block Models (L)
  • 10 (9/5) Network Resilience (E)
  • 11 (16/5) Cascades and spreading in Networks (E)
  • 12 (23/5) Dynamical systems in Networks (E)
  • 13 (30/5) Project presentation and Exam preparation (L,E)