cross entropy

PHOTO EMBED

Wed Feb 15 2023 07:44:12 GMT+0000 (Coordinated Universal Time)

Saved by @xiajiun #python #loss #rmse

import numpy as np

def cross_entropy(p, q):
return -sum([p[i] * np.log(q[i]) for i in range(len(p))])

p = [0, 0, 0, 1]
q = [0.45, 0.2, 0.02, 0.33]
cross_entropy(p, q)
content_copyCOPY

Designing Machine Learning Systems Chapter 2