Data loaders and abstractions for text and NLP
Industrial-strength Natural Language Processing (NLP)
The Classical Language Toolkit
A natural language interface for computers
ExtractThinker is a Document Intelligence library for LLMs
Semantic search and workflows for medical/scientific papers
The no-nonsense RAG chunking library
ReFT: Representation Finetuning for Language Models
Extract schema, statistics and entities from datasets
Superlinked is a Python framework for AI Engineers
A Repo For Document AI
Stanford NLP Python library for many human languages
Trained models & code to predict toxic comments
An LLM-powered knowledge curation system that researches topics
Data and tools for generating and inspecting OLMo pre-training data
Efficient Retrieval Augmentation and Generation Framework
Underthesea - Vietnamese NLP Toolkit
Han Language Processing
Large Language Model Text Generation Inference
A Heterogeneous Benchmark for Information Retrieval
The library to build & auto-optimize LLM applications
The most accurate natural language detection library for Python
Data processing for and with foundation models
Toolkit for conversational AI
Persian NLP Toolkit