Run a fast ChatGPT-like model locally on your device. This combines the LLaMA foundation model with an open reproduction of Stanford Alpaca a fine-tuning of the base model to obey instructions (akin to the RLHF used to train ChatGPT) and a set of modifications to llama.cpp to add a chat interface. Download the zip file corresponding to your operating system from the latest release. The weights are based on the published fine-tunes from alpaca-lora, converted back into a PyTorch checkpoint with a modified script and then quantized with llama.cpp the regular way.

Features

  • Run a fast ChatGPT-like model locally on your device
  • If you have more than 10GB of RAM, you can use the higher quality 13B model
  • Combines the LLaMA foundation model with an open reproduction of Stanford Alpaca
  • The weights are based on the published fine-tunes from alpaca-lora,
  • You can add other launch options
  • You can now type to the AI in the terminal and it will reply

Project Samples

Alpaca.cpp Screenshot 1

Project Activity

See All Activity >

Categories

Large Language Models (LLM), ChatGPT Apps, Generative AI, AI Models

License

MIT License

Follow Alpaca.cpp

Alpaca.cpp Web Site

Other Useful Business Software
Turn traffic into pipeline and prospects into customers Icon
Turn traffic into pipeline and prospects into customers

For account executives and sales engineers looking for a solution to manage their insights and sales data

Docket is an AI-powered sales enablement platform designed to unify go-to-market (GTM) data through its proprietary Sales Knowledge Lake™ and activate it with intelligent AI agents. The platform helps marketing teams increase pipeline generation by 15% by engaging website visitors in human-like conversations and qualifying leads. For sales teams, Docket improves seller efficiency by 33% by providing instant product knowledge, retrieving collateral, and creating personalized documents. Built for GTM teams, Docket integrates with over 100 tools across the revenue tech stack and offers enterprise-grade security with SOC 2 Type II, GDPR, and ISO 27001 compliance. Customers report improved win rates, shorter sales cycles, and dramatically reduced response times. Docket’s scalable, accurate, and fast AI agents deliver reliable answers with confidence scores, empowering teams to close deals faster.
Learn More
Rate This Project
Login To Rate This Project

User Ratings

5.0 out of 5 stars
★★★★★
★★★★
★★★
★★
★
1
0
0
0
0
ease 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 5 / 5
features 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 5 / 5
design 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 5 / 5
support 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 5 / 5

User Reviews

Filter Reviews:
All
  • justinj24 Posted 2023-04-04
    Really great for running a ChatGPT-style model on my own device.
Read more reviews >

Additional Project Details

Operating Systems

Android, Linux, Mac, Windows

Programming Language

C, C++

Related Categories

C++ Large Language Models (LLM), C++ ChatGPT Apps, C++ Generative AI, C++ AI Models, C Large Language Models (LLM), C ChatGPT Apps, C Generative AI, C AI Models

Registered

2023-03-21
Report inappropriate content