We prove the existence of a module for the largest Mathieu group, whose trace functions are weight
2
2
quasimodular forms. Restricting to the subgroup fixing a point, we see that the integrality of these functions is equivalent to certain divisibility conditions on the number of
F
p
\mathbb {F}_p
points on Jacobians of modular curves. Extending such expressions to arbitrary primes, we find trace functions for modules of cyclic groups of prime order with similar connections. Moreover, for cyclic groups we give an explicit vertex operator algebra construction whose trace functions are given only in terms of weight
2
2
Eisenstein series.