Gemma Scope is a set of sparse autoencoders designed for the 9B and 2B models of Gemma. It acts like a microscope, helping us analyze the internal activations of these models, thereby deepening our understanding of the concepts behind them. These autoencoders can be used to study the internal activations of the models, similar to how biologists use microscopes to examine the cells of plants and animals.