High-performance inference of OpenAI's Whisper automatic speech recognition (ASR) model.

Supported platforms:

Mac OS (Intel and Arm)
iOS
Android
Linux / FreeBSD
WebAssembly
Windows (MSVC and MinGW]
Raspberry Pi

Features

  • Plain C/C++ implementation without dependencies
  • Apple silicon first-class citizen - optimized via Arm Neon and Accelerate framework
  • AVX intrinsics support for x86 architectures
  • VSX intrinsics support for POWER architectures
  • Mixed F16 / F32 precision
  • Low memory usage (Flash Attention)
  • Zero memory allocations at runtime
  • Runs on the CPU
  • C-style API

Project Samples

whisper.cpp Screenshot 1

Project Activity

See All Activity >

Categories

Speech Recognition, Raspberry Pi, LLM Inference

License

MIT License

Follow whisper.cpp

whisper.cpp Web Site

Other Useful Business Software
Auth for GenAI | Auth0 Icon
Auth for GenAI | Auth0

Enable AI agents to securely access tools, workflows, and data with fine-grained control and just a few lines of code.

Easily implement secure login experiences for AI Agents - from interactive chatbots to background workers with Auth0. Auth for GenAI is now available in Developer Preview
Try free now
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of whisper.cpp!

Additional Project Details

Operating Systems

Linux, FreeBSD, Android, Apple iPhone, Mac, Windows

Programming Language

C++, C

Related Categories

C++ Speech Recognition Software, C++ Raspberry Pi Software, C++ LLM Inference Tool, C Speech Recognition Software, C Raspberry Pi Software, C LLM Inference Tool

Registered

2023-03-26
Report inappropriate content