ModularStarEncoder-300M is an encoder model fine-tuned on the SynthCoNL dataset based on the ModularStarEncoder-1B pre-trained model. It is specifically designed for code-to-code and text-to-code retrieval tasks. This model uses hierarchical self-distillation technology, allowing users to choose different layer versions according to their computing power.
Natural Language Processing
Transformers