Popular GitHub Repositories for Tokenized Sentences

? Scalable embedding, reasoning, ranking for images and sentences with CLIP

BioWordVec & BioSentVec: pre-trained embeddings for biomedical words and sentences

PyTorch Re-Implementation of "Generating Sentences from a Continuous Space" by Bowman et al 2015 https://arxiv.org/abs/1511.06349

[ICLR2025 Spotlight?] Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters

Computing similarity of two sentences with google's BERT algorithm。利用Bert计算句子相似度。语义相似度计算。文本相似度计算。

A Neural Language Style Transfer framework to transfer natural language text smoothly between fine-grained language styles like formal/casual, active/passive, and many more. Created by Prithiviraj Damodaran. Open to pull requests and other forms of collaboration.

[NeurIPS'22] Tokenized Graph Transformer (TokenGT), in PyTorch

The official code ??? for - TOTEM: TOkenized Time Series EMbeddings for General Time Series Analysis

?Language Model based sentences scoring library

Examine two sentences and determine whether they have the same meaning.

Target-dependent sentiment classification in news articles reporting on political events. Includes a high-quality data set of over 11k sentences and a state-of-the-art classification model.

Code for the ACL 2018 paper "Neural Document Summarization by Jointly Learning to Score and Select Sentences"

How to encode sentences in a high-dimensional vector space, a.k.a., sentence embedding.

GraphParser is a semantic parser which can convert natural language sentences to logical forms and graphs.

Closed-Loop Supervised Fine-Tuning of Tokenized Traffic Models. CVPR 2025.

CLIP as a service - Embed image and sentences, object recognition, visual reasoning, image classification and reverse image search

Tokenize English sentences using neural networks.

This is simple python macro script for LibreOffice to help you generate content from selected words/sentences with OpenAI & Google AI

Template-Based Question Generation from Retrieved Sentences for Improved Unsupervised Question Answering

NSLinguisticTagger provides a uniform interface to a variety of natural language processing functionality with support for many different languages and scripts. One can use this class to segment natural language text into paragraphs , sentences, or words and tag information about those segments such as parts of speech, lexical class, lemma!