The math involved in LLMs is not complex for anyone that has passed undergrad Calc and Linear Algebra classes. If you know derivatives, the chain rule and some matrix basics you can figure them out with enough studying.

The hard part about LLMs is not the math but the neural net architecture innovations they brought (eg self-attention)