Of Notes

Gaussian Process Definition, Valid Kernels, and GP Regression

1 min read · revised 17 October 2026 · ·

Table of Contents

Problem

Consider Gaussian Processes (GPs) on inputs .

(a) [10 marks] State the definition for a stochastic process to be a GP with mean function and covariance function . Explain what it means for the covariance function to be valid.

(b) [10 marks] Show that the covariance function is valid, if is a symmetric positive definite matrix.

(c) [10 marks] Show that, for an arbitrary function , the covariance function is valid.

(d) [15 marks] Consider two independent zero-mean GPs and with covariance functions and respectively. Let , and let be the corresponding Gram matrix. Show that is a valid covariance function.

(e) Now consider a Gaussian process regression , where is a Gaussian process. (i) [15 marks] Find the marginal distribution of . (ii) [20 marks] Consider predicting a new observation at . By considering the joint distribution of and or otherwise, find the predictive distribution of .

(f) Let for a one-dimensional input with the kernel function and you are given one input value and corresponding observation . (i) [10 marks] Compute the predictive distribution in and discuss what happens in the limit . (ii) [10 marks] Compute the predictive distribution in and discuss what happens in the limit .

Solution

/ or Ctrl K
search; empty, it shows notes to revise and lately read
m
mark this note to revise, or unmark it
c
cover maths, proofs and solutions to test yourself
n
uncover the next covered item
y
copy this note’s org-roam link
e
copy this note as markdown, LaTeX kept as TeX
p
the next problem to work; there h hints, s shows the solution, x passes it for today
→ ← j k space
turn the page, when reading in pages
l
on the map, trace the greatest distance, then the longest path
double-click
a formula, to copy its TeX
rest on maths
bind a part of a formula and open the wheel of notes it comes from; scroll or ↑ ↓ widens it, 1–6 goes
?
this card