Mathematical Foundations for Complex Systems Modelling
Residues of two rational contour integrals
Use the method of residues to find
Worth rereading:
Solution
Poles (both inside
Simple poles, so multiply by
Residue theorem:
Poles:
Which lie inside the contour:
Only
Mathematical Foundations for Complex Systems Modelling
Residue evaluation of a trigonometric integral
(a) Use residues to find
Worth rereading:
Solution
No solution yet. Write one in the note: 20261015135839-residue_evaluation_of_a_trigonometric_integral
Mathematical Foundations for Complex Systems Modelling
Properties of the Fourier transform and an ODE
Let
; (as printed on the sheet; for the prefactor is ); , , and in general ;- with
, .
(b) Find the Fourier transform of
(c) Use the Fourier transform to solve
Worth rereading:
Solution
No solution yet. Write one in the note: 20261015135839-properties_of_the_fourier_transform_and_an_ode
Mathematical Foundations for Complex Systems Modelling
Fourier series of two piecewise functions
Two functions are defined on
Worth rereading:
Solution
No solution yet. Write one in the note: 20261015135839-fourier_series_of_two_piecewise_functions
Mathematical Foundations for Complex Systems Modelling
The logarithm of a radius is harmonic
Show that
Worth rereading:
Solution
No solution yet. Write one in the note: 20261015135839-the_logarithm_of_a_radius_is_harmonic
Mathematical Foundations for Complex Systems Modelling
Laplace transform properties and power-law tails
For
(a) Assuming
for ; ; ; .
(b) Suppose
Worth rereading:
Solution
No solution yet. Write one in the note: 20261015135839-laplace_transform_properties_and_power_law_tails
Mathematical Foundations for Complex Systems Modelling
Residues for two contours around a pole
Use residues to evaluate, with anticlockwise contours
(c) Assuming
Worth rereading:
Solution
No solution yet. Write one in the note: 20261015135839-residues_for_two_contours_around_a_pole
Mathematical Foundations for Complex Systems Modelling
Green's function of a forced damped oscillator
The forced damped harmonic oscillator obeys
Worth rereading:
Solution
No solution yet. Write one in the note: 20261015135839-green_s_function_of_a_forced_damped_oscillator
Mathematical Foundations for Complex Systems Modelling
Linear ODE systems by matrix methods
Solve using matrix methods:
(a)
Worth rereading:
Solution
Solution to a with matrix approach:
Variation of parameters approach:
Mathematical Foundations for Complex Systems Modelling
Linear system with complex eigenvalues
Solve using matrix methods:
Solution
No solution yet. Write one in the note: 20261015135839-linear_system_with_complex_eigenvalues
Mathematical Foundations for Complex Systems Modelling
Point minimising summed squared distances to a triangle
Given a triangle with vertices
Solution
No solution yet. Write one in the note: 20261015135839-point_minimising_summed_squared_distances_to_a_triangle
Mathematical Foundations for Complex Systems Modelling
Rank and spectrum of the outer product u u-dagger
For
Worth rereading:
Solution
No solution yet. Write one in the note: 20261015135839-rank_and_spectrum_of_the_outer_product_u_u_dagger
Mathematical Foundations for Complex Systems Modelling
Eigenvalues and eigenvectors of Hermitian matrices
Let
Worth rereading:
Solution
No solution yet. Write one in the note: 20261015135839-eigenvalues_and_eigenvectors_of_hermitian_matrices
Mathematical Foundations for Complex Systems Modelling
Diagonalising a real symmetric 2x2 matrix
(i) Prove that every
(ii) Deduce that
Solution
No solution yet. Write one in the note: 20261015135839-diagonalising_a_real_symmetric_2x2_matrix
Mathematical Foundations for Complex Systems Modelling
General second-order linear ODE as a first-order system
Consider
(a) Put
Solution
No solution yet. Write one in the note: 20261015135839-general_second_order_linear_ode_as_a_first_order_system
Mathematical Foundations for Complex Systems Modelling
Homogeneous 2x2 systems by matrix exponential or eigenvectors
Solve the initial value problems by writing
Solution
No solution yet. Write one in the note: 20261015135839-homogeneous_2x2_systems_by_matrix_exponential_or_eigenvector
Mathematical Foundations for Complex Systems Modelling
Non-homogeneous linear system with exponential forcing
Solve
Solution
No solution yet. Write one in the note: 20261015135839-non_homogeneous_linear_system_with_exponential_forcing
Mathematical Foundations for Complex Systems Modelling
Moments of the Gaussian and double factorial asymptotics
(a) Prove, for integer
Worth rereading:
Solution
Partial (a)
Mathematical Foundations for Complex Systems Modelling
Laplace method for an integral with a sine power
Find the leading behaviour as
Worth rereading:
Solution
No solution yet. Write one in the note: 20261015135839-laplace_method_for_an_integral_with_a_sine_power
Mathematical Foundations for Complex Systems Modelling
Independence of the sum of two dice and the first die
Two fair dice are rolled. Prove that for every
Solution
I began by considering every possible value
Sample space and events:
Counting:
Only one outcome lies in both:
Now the sum of 2, where
but
Mathematical Foundations for Complex Systems Modelling
CDF of the difference of two teetotum spins
A teetotum is a 4-sided spinning top with sides marked A, D, H, T. It is spun twice and the two letters are recorded in order. Write down the sample space.
Interpret the letters as numbers
Worth rereading:
Solution
Mathematical Foundations for Complex Systems Modelling
Area of a lemniscate-bounded domain and a Gaussian integration by parts
(a) The area of a planar domain
Worth rereading:
Solution
No solution yet. Write one in the note: 20261015135839-area_of_a_lemniscate_bounded_domain_and_a_gaussian_integrati
Mathematical Foundations for Complex Systems Modelling
Elementary identities from the axioms of probability
Let
Worth rereading:
Solution
No solution yet. Write one in the note: 20261015135839-elementary_identities_from_the_axioms_of_probability
Mathematical Foundations for Complex Systems Modelling
Diffusion kernel conserves total mass
The solution of the diffusion equation is
Solution
No solution yet. Write one in the note: 20261015135839-diffusion_kernel_conserves_total_mass
Mathematical Foundations for Complex Systems Modelling
Heat equation on an interval by a sine series
Consider
Worth rereading:
Solution
No solution yet. Write one in the note: 20261015135839-heat_equation_on_an_interval_by_a_sine_series
Mathematical Foundations for Complex Systems Modelling
Laplace method for three integrals
Find the leading asymptotics as
Worth rereading:
Solution
No solution yet. Write one in the note: 20261015135839-laplace_method_for_three_integrals
Mathematical Foundations for Complex Systems Modelling
Sample space and CDF for two balls from a bag; union and independence
(a) A bag holds 4 balls numbered 1 to 4. Two balls are drawn and their numbers recorded in order. Write down the sample space. Let
(b) Let
Solution
No solution yet. Write one in the note: 20261015135839-sample_space_and_cdf_for_two_balls_from_a_bag_union_and_inde
Mathematical Foundations for Complex Systems Modelling
Moment generating functions of the Poisson and exponential laws
(i) A Poisson random variable
(ii) A continuous RV
Worth rereading:
Solution
No solution yet. Write one in the note: 20261019175229-moment_generating_functions_of_the_poisson_and_exponential_l
Mathematical Foundations for Complex Systems Modelling
The Dirac delta as a Gaussian limit and its Fourier representation
(i) Verify that
(ii) Combine the regularisation (1) of the Dirac delta-function with the Gaussian integral identity (see Week 3 lectures)
(iii) Verify that
Worth rereading:
Solution
No solution yet. Write one in the note: 20261019175229-the_dirac_delta_as_a_gaussian_limit_and_its_fourier_represen
Mathematical Foundations for Complex Systems Modelling
Characteristic function of the simple Bernoulli random walk
A simple Bernoulli random walk of a particle on
Denoting by
(i) the characteristic function
(ii) Find
Worth rereading:
Solution
No solution yet. Write one in the note: 20261019175229-characteristic_function_of_the_simple_bernoulli_random_walk
Mathematical Foundations for Complex Systems Modelling
The Wiener process density solves the diffusion equation
The Wiener process
and is continuous in with probability 1. has independent increments: for all the future increments , , are independent of the past values .- The increments are Gaussian:
is normally distributed with mean and variance , .
Use the characteristic function
Worth rereading:
Solution
No solution yet. Write one in the note: 20261019175229-the_wiener_process_density_solves_the_diffusion_equation
Mathematical Foundations for Complex Systems Modelling
A bivariate Gaussian density: normalisation, marginals and covariance
Given a
(i) Verify that the j.p.d.f. is correctly normalised:
(ii) Show that both
(iii) Further show that the covariance is
(iv) Assume that
Solution
No solution yet. Write one in the note: 20261019175229-a_bivariate_gaussian_density_normalisation_marginals_and_cov
Mathematical Foundations for Complex Systems Modelling
The Dirac delta of a function with isolated zeros
Sketch a proof of the identity
Worth rereading:
Solution
No solution yet. Write one in the note: 20261019175229-the_dirac_delta_of_a_function_with_isolated_zeros
Mathematical Foundations for Complex Systems Modelling
Sums of independent variables and the central limit theorem
(i) Assume that
(ii) Prove the Central Limit Theorem: for a set
Worth rereading:
Solution
No solution yet. Write one in the note: 20261019175229-sums_of_independent_variables_and_the_central_limit_theorem
Mathematical Foundations for Complex Systems Modelling
Symmetric random walk: exact law and Gaussian limit
Consider the symmetric Bernoulli random walk defined in Problem 3 (
(i) Use expression (3) to show that the probability for
(ii) By considering the limiting shape of (5) for
Solution
No solution yet. Write one in the note: 20261019175229-symmetric_random_walk_exact_law_and_gaussian_limit
Mathematical Foundations for Complex Systems Modelling
Jensen's inequality
The function
(i) Let
(ii) Let
(iii) Let
Solution
No solution yet. Write one in the note: 20261019175229-jensen_s_inequality
Mathematical Foundations for Complex Systems Modelling
Lorentzian delta sequence and the Dirac comb
Verify that
(i)
(ii) Use the above to show that for any real
Worth rereading:
Solution
No solution yet. Write one in the note: 20261019175229-lorentzian_delta_sequence_and_the_dirac_comb
Mathematical Foundations for Complex Systems Modelling
Bernoulli variable moments and the random-walk covariance
(i) A Bernoulli random variable
(ii) Denoting by
Worth rereading:
Solution
No solution yet. Write one in the note: 20261019175229-bernoulli_variable_moments_and_the_random_walk_covariance
Mathematical Foundations for Complex Systems Modelling
Contour Integration over Unit Circle
Prove that
Worth rereading:
Solution
No solution yet. Write one in the note: 20261022104704-contour_integration_over_unit_circle
Mathematical Foundations for Complex Systems Modelling
System of ODEs and Matrix Exponential
Rewrite the system of ordinary differential equations
Worth rereading:
Solution
No solution yet. Write one in the note: 20261022104704-system_of_odes_and_matrix_exponential
Mathematical Foundations for Complex Systems Modelling
Fourier Transform of Second-Order ODE
Find the Fourier transform
Worth rereading:
Solution
No solution yet. Write one in the note: 20261022104704-fourier_transform_of_second_order_ode
Mathematical Foundations for Complex Systems Modelling
Laplace Method for Trigonometric Integral
Using Laplace method find the leading asymptotics of the following integral as
Worth rereading:
Solution
No solution yet. Write one in the note: 20261022104704-laplace_method_for_trigonometric_integral
Mathematical Foundations for Complex Systems Modelling
Sample Space of Ordered Pairs
A bag contains 4 balls, all bearing distinct numbers from the set
Solution
No solution yet. Write one in the note: 20261022104704-sample_space_of_ordered_pairs
Mathematical Foundations for Complex Systems Modelling
CDF of Absolute Difference
A bag contains 4 balls, all bearing distinct numbers from the set
Worth rereading:
Solution
No solution yet. Write one in the note: 20261022104704-cdf_of_absolute_difference
Mathematical Foundations for Complex Systems Modelling
MaxEnt Estimation of Offspring Count
A number
Solution
No solution yet. Write one in the note: 20261022104704-maxent_estimation_of_offspring_count
Mathematical Foundations for Complex Systems Modelling
MaxEnt Distribution for Two-Group Voters
There are
Worth rereading:
Solution
No solution yet. Write one in the note: 20261022104704-maxent_distribution_for_two_group_voters
Mathematical Foundations for Complex Systems Modelling
Partition Function for Two-Group Voters
Compute the partition function
Solution
No solution yet. Write one in the note: 20261022104704-partition_function_for_two_group_voters
Mathematical Foundations for Complex Systems Modelling
Lagrange Parameters in Terms of Average Leads
Determine an expression for
Solution
No solution yet. Write one in the note: 20261022104704-lagrange_parameters_in_terms_of_average_leads
Mathematical Foundations for Complex Systems Modelling
Chebyshev against the normal approximation for a Poisson sample mean
Let
a) Using the Chebyshev inequality, give an estimate for
Solution
No solution yet. Write one in the note: 20261019175229-chebyshev_against_the_normal_approximation_for_a_poisson_sam
Mathematical Foundations for Complex Systems Modelling
Is a coin that shows 64 heads in 100 tosses fair
A coin is tossed 100 times and the number of times it lands on head,
Solution
No solution yet. Write one in the note: 20261019175229-is_a_coin_that_shows_64_heads_in_100_tosses_fair
Mathematical Foundations for Complex Systems Modelling
Joint pmf and rate function for three-party voting counts
The MaxEnt probabilities for the voting patterns
(a) Verify the expressions for the marginal probabilities
(b) Using the expression for
(c) Use the Stirling approximation of the factorials in the multinomial coefficient of (b) to show that the joint pmf
(d) From the structure of the expression for
Solution
No solution yet. Write one in the note: 20261019175229-joint_pmf_and_rate_function_for_three_party_voting_counts
Mathematical Foundations for Complex Systems Modelling
Random points in the unit square and the law of large numbers
Worth rereading:
Solution
No solution yet. Write one in the note: 20261019175229-random_points_in_the_unit_square_and_the_law_of_large_number
Mathematical Foundations for Complex Systems Modelling
Multinomial coefficients and entropy
The number of ways of arranging
Solution
No solution yet. Write one in the note: 20261019175229-multinomial_coefficients_and_entropy
Mathematical Foundations for Complex Systems Modelling
Boltzmann's argument for maximum entropy inference
Consider a three-party voter whose voting decision we call
The number of voting histories that give vote counts
Solution
No solution yet. Write one in the note: 20261019175229-boltzmann_s_argument_for_maximum_entropy_inference
Mathematical Foundations for Complex Systems Modelling
Taylor expansions and standard series
Give the Taylor expansion up to third order in
, 2. , 3. , 4. , 5. , 6. .
What functions are represented by the following series expansions? For which real values of
Solution
No solution yet. Write one in the note: 20261019175229-taylor_expansions_and_standard_series
Mathematical Foundations for Complex Systems Modelling
Seventeen standard integrals
Compute the following indefinite and definite integrals.
Hint: for some of them integration by parts,
, 2. , 3. , , 5. , 6. , , 8. , 9. , , 11. , 12. , , 14. , 15. , , 17. .
Solution
No solution yet. Write one in the note: 20261019175229-seventeen_standard_integrals
Mathematical Foundations for Complex Systems Modelling
ODE for production and decay
Find the solution to
Solution
No solution yet. Write one in the note: 20261019175229-ode_for_production_and_decay
Mathematical Foundations for Complex Systems Modelling
Projectile range is maximised at which angle
A projectile is thrown upward from the surface of the Earth at an angle
Solution
No solution yet. Write one in the note: 20261019175229-projectile_range_is_maximised_at_which_angle
Mathematical Foundations for Complex Systems Modelling
Analysing four functions and sketching their graphs
Analyse the functions listed below: find zeros, asymptotes, maxima, minima, and extract their asymptotic behaviour as
, 2. , 3. , 4. .
Solution
No solution yet. Write one in the note: 20261019175229-analysing_four_functions_and_sketching_their_graphs
Theory of Complex Networks
Simple and directed graphs and their vertex and edge sets
Which of the three graphs below is simple? Which of them is directed? Give for each of them the vertex set
Solution
None of the graphs has a self-interaction, so all three are simple. Only
An edge
: , with links , , , , , , , , . : , with the eight links for . : , with links , , , , .
Theory of Complex Networks
Adjacency matrices of the Tutorial 1 graphs
Calculate the adjacency matrices of the three graphs of exercise 1, after relabelling the nodes of the left graph so that its vertex set becomes
Solution
Convention:
Relabel the left graph by sending the nodes that point at the hub to
| old | 2 | 10 | 6 | 11 | 3 | 9 | 5 | 7 | 4 |
| new | 1 | 6 | 7 | 8 | 9 | 2 | 3 | 4 | 5 |
The middle graph is already labelled
The right graph is already labelled
Theory of Complex Networks
Graph of a local street neighbourhood and its length-three paths
Draw a graph corresponding with your local street neighbourhood, and determine its adjacency matrix. How many paths of length three does your graph have? Register an account on Edstem following the link https://edstem.org/us/join/CguTku. Optional: post your result on the forum in the category "Tutorials: Week1".
Worth rereading:
Solution
No solution yet. Write one in the note: 20261019175229-graph_of_a_local_street_neighbourhood_and_its_length_three_p
Theory of Complex Networks
In- and out-degrees of the Tutorial 1 graphs
Calculate all in-degrees and all out-degrees of the three graphs of exercise 1.
Worth rereading:
Solution
Convention:
The left graph is directed, so its in- and out-degrees differ (original labels):
| 2 | 3 | 4 | 5 | 6 | 7 | 9 | 10 | 11 | |
|---|---|---|---|---|---|---|---|---|---|
| 0 | 4 | 1 | 1 | 0 | 2 | 1 | 0 | 0 | |
| 1 | 4 | 1 | 0 | 1 | 0 | 0 | 1 | 1 |
The other two graphs are not directed, so
- Middle:
, and for the other eight nodes. - Right:
, , .
Theory of Complex Networks
Neighbourhood sets of the directed Tutorial 1 graph
Determine the neighbourhood sets of the left graph of exercise 1.
Worth rereading:
Solution
The in-neighbourhood
| 2 | ||
| 3 | ||
| 4 | ||
| 5 | ||
| 6 | ||
| 7 | ||
| 9 | ||
| 10 | ||
| 11 |
Theory of Complex Networks
In-degree equals out-degree in undirected graphs
Prove that in non-directed graphs
Worth rereading:
Solution
With the convention
In-degree equals out-degree. A non-directed graph has
Degree as a diagonal of
Theory of Complex Networks
Sum of in-degrees equals sum of out-degrees
Prove that in directed graphs
Worth rereading:
Solution
Both sums count every link exactly once. Relabelling the dummy indices
Theory of Complex Networks
Clustering coefficient via triangle counts
Show that in any simple non-directed graph with adjacency matrix
Worth rereading:
Solution
Closed 3-walks from
Each triangle is walked in both directions:
so it is counted twice:
Theory of Complex Networks
Clustering coefficients in the Tutorial 1 graphs
Calculate the clustering coefficients of all nodes in the middle and the right graph of exercise 1. Why would we not calculate them for the left graph?
Worth rereading:
Solution
No solution yet. Write one in the note: 20261015174012-clustering_coefficients_in_the_tutorial_1_graphs
Theory of Complex Networks
Path counts in the Tutorial 1 graphs
Use the adjacency matrices from exercise 2 to prove that the left graph of exercise 1 has exactly four paths of length three and no paths of length 4 or larger. Argue why the middle and right graphs contain paths of every length
Solution
No solution yet. Write one in the note: 20261015174013-path_counts_in_the_tutorial_1_graphs
Theory of Complex Networks
Clustering coefficient vanishes on trees
Let
Worth rereading:
Solution
Since a tree cannot be cyclical and cannot have triangles, we say that the numerator term
Suppose a triangle through
So
Theory of Complex Networks
Neumann series for the resolvent of an adjacency matrix
Prove the identity
Solution
No solution yet. Write one in the note: 20261015135839-neumann_series_for_the_resolvent_of_an_adjacency_matrix
Theory of Complex Networks
Connectivity as an equivalence relation
Let
Solution
No solution yet. Write one in the note: 20261015135839-connectivity_as_an_equivalence_relation
Theory of Complex Networks
Closeness and betweenness of nodes 2 and 3 in two tutorial graphs
Calculate the closeness centrality and the betweenness centrality of nodes
Solution
Theory of Complex Networks
Closeness centralities of the two ends of a tree edge
Consider the tree in the figure. The edge connecting node 1 to node 2 divides the tree into two disjoint regions containing
Show that the closeness centrality
Worth rereading:
Solution
Theory of Complex Networks
Betweenness centrality of a tree node whose removal splits the tree
Consider a tree of size
Worth rereading:
Solution
No solution yet. Write one in the note: 20261019175229-betweenness_centrality_of_a_tree_node_whose_removal_splits_t
Theory of Complex Networks
Adjacency spectrum and eigenvector centrality of the star graph
Calculate the adjacency matrix eigenvalue spectrum
Worth rereading:
Solution
No solution yet. Write one in the note: 20261019175229-adjacency_spectrum_and_eigenvector_centrality_of_the_star_gr
Theory of Complex Networks
Pearson correlation similarity derivation
Show that the definition of the Pearson correlation similarity
Worth rereading:
Solution
No solution yet. Write one in the note: 20261022104820-pearson_correlation_similarity_derivation
Theory of Complex Networks
Equivalence of cosine similarity forms
Show that the two expressions given for the cosine similarity
Worth rereading:
Solution
No solution yet. Write one in the note: 20261022104820-equivalence_of_cosine_similarity_forms
Theory of Complex Networks
Bounds and equality conditions for cosine similarity
Show that
Worth rereading:
Solution
No solution yet. Write one in the note: 20261022104820-bounds_and_equality_conditions_for_cosine_similarity
Theory of Complex Networks
Book recommendation using cosine similarity on bipartite graph
The graph is a bipartite graph of books (squares) and customers (circles). Each edge links a book to a customer if that customer purchased the corresponding book. Customer 5 would like to purchase a new book. Please provide a recommendation to this customer by using the cosine similarity.
Worth rereading:
Solution
No solution yet. Write one in the note: 20261022104820-book_recommendation_using_cosine_similarity_on_bipartite_gra
Theory of Complex Networks
Equivalence of Pearson correlation similarity forms
Show that the two expressions given for the Pearson correlation similarity
Worth rereading:
Solution
No solution yet. Write one in the note: 20261022104820-equivalence_of_pearson_correlation_similarity_forms
Theory of Complex Networks
Bound on Pearson correlation similarity
Show that
Worth rereading:
Solution
No solution yet. Write one in the note: 20261022104820-bound_on_pearson_correlation_similarity
Theory of Complex Networks
Degree distributions for canonical graphs
Calculate the degree distributions
Worth rereading:
Solution
No solution yet. Write one in the note: 20261022104820-degree_distributions_for_canonical_graphs
Theory of Complex Networks
Joint degree distribution of connected node pairs
Calculate the joint distribution of degrees of connected node pairs
Worth rereading:
Solution
No solution yet. Write one in the note: 20261022104820-joint_degree_distribution_of_connected_node_pairs
Theory of Complex Networks
Degree assortativity of sample graphs
Compute the assortativity
Worth rereading:
Solution
No solution yet. Write one in the note: 20261022104820-degree_assortativity_of_sample_graphs
Theory of Complex Networks
Marginals of joint degree distribution on directed graphs
Let
Worth rereading:
Solution
No solution yet. Write one in the note: 20261022104820-marginals_of_joint_degree_distribution_on_directed_graphs
Elements of Statistical Learning
Symmetric Bernoulli: normalisation, mean, variance, entropy
For
Worth rereading:
Solution
No solution yet. Write one in the note: 20261015135839-symmetric_bernoulli_normalisation_mean_variance_entropy
Elements of Statistical Learning
Normalisation of the binomial distribution
Prove, for integer
Worth rereading:
Solution
No solution yet. Write one in the note: 20261015135839-normalisation_of_the_binomial_distribution
Elements of Statistical Learning
Mean and variance of the binomial distribution
Show that the binomial distribution has mean
Worth rereading:
Solution
No solution yet. Write one in the note: 20261015135839-mean_and_variance_of_the_binomial_distribution
Elements of Statistical Learning
Normalisation of the beta distribution
Starting from
Worth rereading:
Solution
No solution yet. Write one in the note: 20261015135839-normalisation_of_the_beta_distribution
Elements of Statistical Learning
Completing the square for the Gaussian conditional and marginal
Use completing the square in the exponent to derive the results in PRML Eqs. (2.141)-(2.142), the conditional and marginal Gaussian formulae.
Solution
First problem:
Likelihood and prior:
Bayes, dropping the normalising constants:
Expand both squares:
Collect by power of
so the exponent is
Complete the square:
Match coefficients:
Precision:
Mean (multiply top and bottom by
Elements of Statistical Learning
Eigenvector expansion of a covariance matrix and its inverse
Show that a real symmetric matrix
Solution
No solution yet. Write one in the note: 20261015135839-eigenvector_expansion_of_a_covariance_matrix_and_its_inverse
Elements of Statistical Learning
Mean and covariance of a sum of independent random vectors
Let
Solution
No solution yet. Write one in the note: 20261015135839-mean_and_covariance_of_a_sum_of_independent_random_vectors
Elements of Statistical Learning
Gaussian-gamma conjugate posterior
Consider a univariate Gaussian
Worth rereading:
Solution
No solution yet. Write one in the note: 20261015135839-gaussian_gamma_conjugate_posterior
Elements of Statistical Learning
Bayesian Linear Regression and EM Algorithm
Consider the following Bayesian linear regression model
with
Worth rereading:
Solution
No solution yet. Write one in the note: 20261022104744-bayesian_linear_regression_and_em_algorithm
Elements of Statistical Learning
Discriminative Classification and Laplace Approximation
Consider the following supervised learning problem: we are given some data
(c) [20 marks] Show that the gradient of the log-likelihood
Worth rereading:
Solution
No solution yet. Write one in the note: 20261022104745-discriminative_classification_and_laplace_approximation
Elements of Statistical Learning
Hierarchical Clustering and Gaussian Mixture Models
Consider the following measured inputs:
(a) [25 marks] Using the Euclidean distance in
Solution
No solution yet. Write one in the note: 20261022104745-hierarchical_clustering_and_gaussian_mixture_models
Elements of Statistical Learning
Gaussian Linear Model, Ridge Regression, and Regularization
Consider the Gaussian linear model for prediction in matrix form, i.e.
(a) [20 marks] Derive the maximum likelihood estimators
(b) [10 marks] Let
(c) [20 marks] Now consider the ridge regression estimator for
(d) [10 marks] Sketch the plot of the MSE as a function of
(e) [30 marks] Mathematically, what is the connection between the ridge regression estimator and estimators given by Bayesian linear models? Explain what is instead the difference in the way the regularisation parameter is chosen and list one advantage and one disadvantage in each case.
(f) [10 marks] Explain how to modify the penalty term in the regularized regression problem so that the resulting estimator has the property of sparsity.
Worth rereading:
Solution
No solution yet. Write one in the note: 20261017161340-gaussian_linear_model_ridge_regression_and_regularization
Elements of Statistical Learning
Discriminative vs Generative Classification and Laplace Approximation
(a) (i) [10 marks] State briefly what is meant by discriminative and generative approaches to classification. List one benefit and one problem with each approach.
(ii) [25 marks] Consider the case of binary classification where we wish to determine if an input point
(iii) [25 marks] Assuming the class conditional density
(iv) [10 marks] Describe how using basis functions one might extend the above result to more complicated predictors for the class probabilities.
(b) Consider the following supervised learning problem: we are given some data
(i) [10 marks] Assuming that the labels
(ii) [20 marks] For the case of a zero mean Gaussian prior over
Solution
No solution yet. Write one in the note: 20261017161340-discriminative_vs_generative_classification_and_laplace_appr
Elements of Statistical Learning
Gaussian Process Definition, Valid Kernels, and GP Regression
Consider Gaussian Processes (GPs) on inputs
(a) [10 marks] State the definition for a stochastic process
(b) [10 marks] Show that the covariance function
(c) [10 marks] Show that, for an arbitrary function
(d) [15 marks] Consider two independent zero-mean GPs
(e) Now consider a Gaussian process regression
(f) Let
Solution
No solution yet. Write one in the note: 20261017161340-gaussian_process_definition_valid_kernels_and_gp_regression
Elements of Statistical Learning
Mixture Distributions, EM Algorithm, and K-Means Connection
Consider a random variable
(a) [20 marks] Derive the expressions of the expectation and covariance matrix of
(b) [25 marks] Outline how the EM algorithm can be used to estimate the parameters
Let us now assume that
(c) [35 marks] Derive the expressions of the update formulas for
(d) [20 marks] Assume now that
Solution
No solution yet. Write one in the note: 20261017161340-mixture_distributions_em_algorithm_and_k_means_connection
Elements of Statistical Learning
Univariate Normal MLE, MAP, and Empirical Bayes
Consider an independent and identically distributed sample
(a) [5 marks] Derive the expression of the maximum likelihood estimator for the mean
Worth rereading:
Solution
No solution yet. Write one in the note: 20261022104745-univariate_normal_mle_map_and_empirical_bayes
Elements of Statistical Learning
K-Means Clustering, Silhouette Index, and GMM
You measured the following data points:
(a) [5 marks] Using the Euclidean distance in
Solution
No solution yet. Write one in the note: 20261022104745-k_means_clustering_silhouette_index_and_gmm
Elements of Statistical Learning
Generative Classification and Decision Rule
You are tasked to develop a classifier for a set of univariate observations with 3 possible classes, using the generative model
and the loss function given by the matrix
(a) [7 marks] Assuming the parameters
Worth rereading:
Solution
No solution yet. Write one in the note: 20261022104745-generative_classification_and_decision_rule
Elements of Statistical Learning
Gaussian Processes and Kernel Validity
Consider Gaussian Processes (GPs) on inputs
and you are given one input value
Solution
No solution yet. Write one in the note: 20261022104745-gaussian_processes_and_kernel_validity
Risk Neutral Valuation: Pricing and Hedging Derivatives
Arbitrage in a two-asset binomial market (A=10, B=50)
A binomial two-asset market has
Worth rereading:
Solution
No solution yet. Write one in the note: 20261015135839-arbitrage_in_a_two_asset_binomial_market_a_10_b_50
Risk Neutral Valuation: Pricing and Hedging Derivatives
Arbitrage in a two-asset binomial market (A=10, B=11)
A binomial two-asset market has
Worth rereading:
Solution
No solution yet. Write one in the note: 20261015135839-arbitrage_in_a_two_asset_binomial_market_a_10_b_11
Risk Neutral Valuation: Pricing and Hedging Derivatives
No-arbitrage condition in a trinomial market
A trinomial two-asset market has values
Solution
No solution yet. Write one in the note: 20261015135839-no_arbitrage_condition_in_a_trinomial_market
Risk Neutral Valuation: Pricing and Hedging Derivatives
Payoff diagrams for a call and a put
Plot the payoff functions of a put and a call option as functions of the terminal stock price
Worth rereading:
Solution
No solution yet. Write one in the note: 20261015135839-payoff_diagrams_for_a_call_and_a_put
Risk Neutral Valuation: Pricing and Hedging Derivatives
Call price by replication in a binomial market
A market has a risky binomial asset with
Worth rereading:
Solution
No solution yet. Write one in the note: 20261015135839-call_price_by_replication_in_a_binomial_market
Risk Neutral Valuation: Pricing and Hedging Derivatives
Pricing a third asset in an incomplete trinomial market
Two tradable assets follow a trinomial model with
- Verify, using Question 3, that
and admit no arbitrage. - What goes wrong when finding
by the replication argument from lecture? - Find all values of
for which there is no arbitrage.
Solution
No solution yet. Write one in the note: 20261015135839-pricing_a_third_asset_in_an_incomplete_trinomial_market
Risk Neutral Valuation: Pricing and Hedging Derivatives
Arbitrage in a binomial model and the martingale measure
Write down a binomial model for two assets in which there is an arbitrage. What happens when you try to solve for a martingale measure?
Solution
Risk Neutral Valuation: Pricing and Hedging Derivatives
Call price by the numeraire method
Repeat the pricing of a call from Exercise Set 1, Question 5 using the numeraire method from lecture (risk-free asset as numeraire) instead of replication.
Market: risky binomial asset
Worth rereading:
Solution
No solution yet. Write one in the note: 20261015135839-call_price_by_the_numeraire_method
Risk Neutral Valuation: Pricing and Hedging Derivatives
Range of no-arbitrage prices by martingale measures
Consider the trinomial model of Exercise Set 1, Question 6 (
Worth rereading:
Solution
No solution yet. Write one in the note: 20261015135839-range_of_no_arbitrage_prices_by_martingale_measures
Risk Neutral Valuation: Pricing and Hedging Derivatives
Changing numeraire from A to B
In lecture the martingale probability was
Solution
No solution yet. Write one in the note: 20261015135839-changing_numeraire_from_a_to_b
Risk Neutral Valuation: Pricing and Hedging Derivatives
Pricing a third asset in a two-step binomial model
A two-step binomial model of asset values has parameters \[
\]
with all branching probabilities strictly positive. Find the value at time zero of a third asset which has terminal values
Worth rereading:
Solution
No solution yet. Write one in the note: 20261019175229-pricing_a_third_asset_in_a_two_step_binomial_model
Risk Neutral Valuation: Pricing and Hedging Derivatives
Matching the binomial branching probability to the stock drift
A binomial model for a stock has up factor
i) Show that the branching probability satisfies
Worth rereading:
Solution
No solution yet. Write one in the note: 20261019175229-matching_the_binomial_branching_probability_to_the_stock_dri
Risk Neutral Valuation: Pricing and Hedging Derivatives
Risk-neutral branching probability in the small-step binomial model
A binomial stock model has up and down factors
i) Compute the risk-neutral branching probability, and compare it to the one computed in lecture.
ii) Compute to order
Worth rereading:
Solution
No solution yet. Write one in the note: 20261019175229-risk_neutral_branching_probability_in_the_small_step_binomia
Risk Neutral Valuation: Pricing and Hedging Derivatives
Binomial pricing of a European call and put against their payoffs
A stock price and money market have parameters
Worth rereading:
Solution
No solution yet. Write one in the note: 20261019175229-binomial_pricing_of_a_european_call_and_put_against_their_pa
Modelling Quantum Many-body Systems
From the two-fermion wavefunction to the Slater determinant
Fermions obey the Pauli principle. This translates into the antisymmetry of the wavefunction under particle exchange:
Solution
No solution yet. Write one in the note: 20261019175229-from_the_two_fermion_wavefunction_to_the_slater_determinant
Modelling Quantum Many-body Systems
Landau levels of a charged particle in a magnetic field
Landau levels play a key role in the theory of the Integer Quantum Hall Effect (IQHE). Consider the non-relativistic Schrödinger equation for a charged particle in a magnetic field. Show that the energy levels are quantised as
Solution
No solution yet. Write one in the note: 20261019175229-landau_levels_of_a_charged_particle_in_a_magnetic_field
Modelling Quantum Many-body Systems
Bose-Einstein condensation and its transition temperature
Discuss the phenomenon of Bose-Einstein Condensation (BEC). What is the transition temperature for the onset of BEC in three dimensions? How does the result change if the atoms are confined in a harmonic potential?
Solution
No solution yet. Write one in the note: 20261019175229-bose_einstein_condensation_and_its_transition_temperature
Nothing left for today. The bank is clear until the next review falls due.