Posts

Derivation of classic edge-detection kernels including Sobel, Scharr, and Laplacian of Gaussian.

• #Computer Vision
• #Machine Learning
• #Maths

Brief derivation of the CQL-SAC algorithm and its implementation in Gymnasium.

• #Reinforcement Learning
• #Machine Learning
• #Maths
• #Algorithm

Replicating and extending experiments from Sutton's original TD learning paper on the random walk prediction problem.

• #Reinforcement Learning
• #Temporal Difference
• #Coursework
• #Maths