DATA5441: Networks and High-dimensional Inference
Forum, Notebooks, etc.
Tuesdays 9-11 and Wednesdays 9-11; Carslaw Building, 8th Floor, room 829 (AGR room) or via Zoom: 8833 6350 240
Wednesdays 11am-12pm, via Zoom (same ID as lectures) or in office, Carslaw 522.
Exam (40%), Assignments (30%), and Project (30%). Attendance to class is essential.
There will be assignments every one or two weeks. The final assignment mark will be the mean of the individual assignment marks.
The project takes place in Weeks 12 and 13.
In our interconnected world, networks are an increasingly important representation of datasets and systems. This unit will investigate how this network approach to problems can be pursued through the combination of mathematical models and datasets. You will learn different mathematical models of networks and understand how these models explain non-intuitive phenomena, such as the small world phenomenon (short paths between nodes despite clustering), the friendship paradox (our friends typically have more friends than we have), and the sudden appearance of epidemic-like processes spreading through networks. You will learn computational techniques needed to infer information about the mathematical models from data and, finally, you will learn how to combine mathematical models, computational techniques, and real-world data to draw conclusions about problems. More generally, network data is a paradigm for high-dimensional interdependent data, the typical problem in data science. By doing this unit you will develop computational and mathematical skills of wide applicability in studies of networks, data science, complex systems, and statistical physics.
Objectives and learning outcome
Develop analytical, numerical, and modeling skills that help to connect abstract mathematical ideas to real-world systems represented as networks.
- Networks: An Introduction, Mark Newman, Oxford Univ Press, 2010.
- Network Science book, L. Barabasi, 2017 http://barabasi.com/networksciencebook/
- Dynamical Processes on Complex Networks, A. Barrat, M. Barthélemy, A. Vespignani, Cambridge University Press, 2012
- Statistical mechanics of complex networks, R. Albert & A. Barabasi, Rev. Mod. Phys. 2002.
- The Structure and Function of Complex Networks, M. Newman, SIAM Review, 2002.
Software for computation
- Networkx: https://networkx.github.io
- graphtool: https://graph-tool.skewed.de
- igraph: http://igraph.org
- Pajek: http://vlado.fmf.uni-lj.si/pub/networks/pajek/
- Jupyter Notebooks: http://jupyter.org
Network data :
- Netzschleuder: https://networks.skewed.de/
- SNAP http://snap.stanford.edu/data/index.html
- SOPSAHL http://toreopsahl.com/datasets
- Index of Complex Networks – University of Colorado Boulder: https://icon.colorado.edu/
Tentative week-by-week outline
- 1 (1/3) Networks, data science, and high dimensions (E)
- 2 (8/3) Centrality measures (L)
- 3 (15/3) Random Graph Models (L)
- 4 (22/3) Random Graphs vs. Complex Networks (L)
- 5 (29/3) Mechanistic models: small world and preferential attachment (L)
- 6 (12/4) Exponential Random Graph Models (L)
- 7 (19/4) Community Detection in Networks (L)
- 8 (26/4) Inference in Networks (L)
- 9 (2/5) Stochastic Block Models (L)
- 10 (9/5) Network Resilience (E)
- 11 (16/5) Cascades and spreading in Networks (E)
- 12 (23/5) Dynamical systems in Networks (E)
- 13 (30/5) Project presentation and Exam preparation (L,E)