AIbase
Home
AI Tutorial

Lexical-Analyser

Public

词法分析，也称为扫描，是编译器的第一个阶段。在这个阶段，编译器会从左到右逐个字符地读取源程序，并将这些字符组织成一个个记号（token）。

cprogramming-languagelexical-analysislexical-analyzerlinuxtokenization
Creat：2025-03-26T20:53:07
Update：2025-03-26T21:16:39
https://www.geeksforgeeks.org/introduction-of-lexical-analysis/
0
Stars
0
Stars Increase

Related projects

Transformers

Hot
bert

? Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

153615
2年前
+136today

Rust

Hot
compiler

Empowering everyone to build reliable and efficient software.

108357
9个月前
+91today

TypeScript

Hot
javascript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

107029
10个月前
+53today

Generative Ai For Beginners

Hot
ai

21 Lessons, Get Started Building with Generative AI ? https://microsoft.github.io/generative-ai-for-beginners/

102828
11个月前
+172today

LLMs From Scratch

Hot
ai

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

80697
1年前
+221today

D2l Zh

Hot
book

《动手学深度学习》：面向中文读者、能运行、可讨论。中英文版被70多个国家的500多所大学用于教学。

74277
9个月前
+60today

Gpt_academic

academic

为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss等。

69771
9个月前
+15today

Superset

analytics

Apache Superset is a Data Visualization and Data Exploration Platform

69287
9个月前
+45today

LLaMA Factory

Hot
agent

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

63700
9个月前
+147today

Sway

compiler

? Empowering everyone to build reliable and efficient smart contracts.

62067
9个月前
-1today