Audio
This page contains a concise overview of projects funded by NLnet foundation that belong to the topic Audio (see the topic index).
Open digital sound ecosystem
We mostly think about sound processing in the exciting and artistic land of music production, but audio processing and synthesis is an essential part of our modern internet experience. The hardware we use to render audio is pretty opaque, involving almost exclusively proprietary chips from relatively obscure vendors. This issue propagates into the firmware and software stack.
Enter stage right: Free and Open Source music production, audio processing, music distribution software and hardware. Together, the people building and maintaining the open sound ecosystem bring more freedom to everyone who interacts with digital audio. They democratise music production for amateurs. They bring openness to the audio stack. They enable artists and creators to audit, control, and truly understand their tools. And they bring those who enjoy listening to music independence from Big Tech providers.
- cables.gl — Creative tool for graphics and 3D content
-
Cables is a tool which allows people to create beautiful, interactive, visual web content without knowing how to type a line of code. Your work is easily exportable at any time, so you can embed it into your website, use it an immersive VR experience, or integrate into other kinds of creative output. Cables patches can be published, shared, copied and remixed by the entire community. This allows people to constantly learn new things from each other.
By developing a standalone version, that works outside of the browser, cables will open up even more for contributions from the open source community. It will be, at the same time, a development environment for contributors, and an offline version of the cables editor. As a side effect, using it with native modules on any major platform and operating system will open up a whole new area of how and where to use cables to create content.
Read more about cables.gl.
- Faircamp 1.0 — Self-hostable, maintenance-free websites for audio producers
-
Faircamp is a static site generator for audio producers, empowering artists, labels and everyone else working with sound to distribute their work on their own, with low resource requirements and little to no maintenance effort. The aims within this project are to address usability, accessibility and cultural concerns, to improve documentation, to implement missing core architecture components and complete the embedding functionality, as well as complementary bugfixing and smaller feature additions.
Read more about Faircamp 1.0.
- Federating Mirlo — Connecting artists and audiences with ActivityPub
-
Mirlo provides a user-friendly space to help artists sell digital music and merch, receive financial support, manage mailing lists, and share with their supporters. The goal of federating Mirlo is to connect more artists with more supporters, towards a resilient and lively ecosystem of audio art. Federating Mirlo also presents an opportunity to improve the self-install story: as Mirlo instances will be able to communicate with one another and connect with the wider fediverse through the ActivityPub protocol, organizations managing their own instance of Mirlo can effortlessly tap into a broader discovery landscape for their artists.
Read more about Federating Mirlo.
- Funkwhale — ActivityPub-driven audio streaming and sharing
-
Funkwhale is a federated platform that provides tools for managing, publishing, and sharing audio content using the ActivityPub protocol. In this project, the team will expand the use of ActivityPub and extend the integrations with other ActivityPub-powered platforms. The flagship web app will be redesigned, adding support for more content types in its API, creating new features that integrate with MusicBrainz, and making the mobile Android offering feature-complete as well as adding a (Tauri based cross-desktop app.
Read more about Funkwhale.
- Kdenlive — Parametrised keyframes for modern non-linear video editor
-
Kdenlive is an open source video editing application with advanced features. Besides the usual editing tools, effects and color scopes, we also have advanced features like proxy editing, speech to text and automatic background removal. This project improves the editing experience by bringing a dope sheet to adjust the effects. Users will be able to decide which parameters to animate and how in a central place, within a single timeline.
Read more about Kdenlive.
- Miru — Multi-track video editing and real-time AR effects
-
Miru is a new set of modular, extensible Web platform tools and components for still image and multi-track video editing and state-of-the-art, real-time AR. Using WebGL, WebAssembly, and open source, mobile-optimized machine learning models, Miru will give people on the social web the tools to edit images and apply interactive effects to recorded video without compromising on privacy and transparency. Miru aims to provide intuitive and user-friendly UIs which developers can easily integrate into their Web apps regardless of the frontend frameworks they use.
Read more about Miru.
- Multisoni — Modern and efficient real-time audio playback engine
-
Multisoni is a versatile audio engine for all creative uses. For demanding real-time uses (such as video games, VR, live installations) there is a lack of free/libre audio authoring tools to map playback and effects to trigger events and interaction parameters, suitable for industrial purposes.
Multisoni is designed to meet this need: it manages many input sources - either samples or synthesis, with support for input plugins - source and effect patching, and rendering for a variety of output systems ranging from binaural stereo to complicated multichannel setups, drawing on existing open-source solutions for audio hardware abstraction and raw audio stream management. One of its main objectives is to put creative users - sound designers, composers - on an equal footing with developer users.
Read more about Multisoni.
- PeerTube — A decentralised streaming video platform
-
PeerTube is a free, libre and federated video platform. Video is a very popular class of content and meanwhile accounts for a signicant share of internet traffic, but the choice of hosting has a lot of implications - if you send your viewers to some proprietary platform because you want to avoid cost, what happens after they watch your video? And who watches them watch? PeerTube allows for a federation of interconnected hosts (so more choice of videos wherever you go to see them) while containing the risk of exposing users to profiling, algorithmic pressure that favors extreme content, censorship and other negative aspects of centralised services like YouTube or Vimeo. PeerTube implements the ActivityPub standard and works with peer-to-peer distribution - and therefore viewing. This means no slowing down when a video suddenly goes viral, and much lower distribution costs thanks to shared bandwidth. PeerTube aims to make it easier to host videos on the server side, while remaining practical, ethical and fun on the Internet user side. In this project, Framasoft will work on PeerTube 4.0 with interesting new features such as better search, live streaming, channel customisation and improved accessibility.
Read more about PeerTube.
- Tiliqua — Open audio DSP for FPGAs
-
Tiliqua is an open-hardware DSP library and reference hardware design which aims to make it easier for musicians and engineers to get started in the world of audio DSP in the context of FPGAs. The Tiliqua DSP library is a suite of commonly-used audio DSP components, written in Amaranth HDL, that can be easily composed in Python to construct a custom FPGA-based DSP pipeline. The Tiliqua reference platform is fully compatible with open-source FPGA toolchains and designed to the Eurorack standard (the most popular hardware synthesizer format) lowering the barrier to entry for those with low/no hardware development experience.
Read more about Tiliqua.
- Zrythm — Libre digital audio workstation
-
Zrythm is a digital audio workstation (DAW) that enables musicians and producers to create professional-quality music. Built with modern C++ using Qt/QML and JUCE, it targets electronic music workflows with advanced capabilities such as signal-based modulation and clip looping that proprietary tools have long monopolized. Building on lessons learned from the v1 release, this grant accelerates development toward Zrythm v2, porting core functionality to the new Qt/QML stack: audio and MIDI recording, arranger editing, and chord assistance. The goal is a stable, mature alternative to proprietary DAWs that guarantees users the freedom to study, modify, and share their creative tools.
Read more about Zrythm.
- Heavy Compiler Collection — Unified DSP and Interface Design for Audio Plugins
-
HVCC is a python-based dataflow audio programming language compiler that generates C/C++ code and a variety of specific framework wrappers. It leverages creative coding and the Pure Data visual programming language as a design interface for optimized and embeddable DSP code. It has found uses in different fields like procedural game audio, desktop production plugins and embedded hardware systems.
This project aims to use the Pure Data visual language to allow for the immediate design of the user interface of these applications. The user will then be able to creatively put together both the underlying audio processing and at the same time the visual control interface of their project.
Read more about Heavy Compiler Collection.
- Noise Nugget — FOSS digital audio processing
-
Noise Nugget is an ultra-compact development board for audio synthesis and processing, providing all the complexity of digital audio in a simple, reusable, open-source, and open-hardware module. With an emphasis on low cost, small form factor, and design for manufacturing. The end goal is to provide a complete solution (hardware and software) for anyone to discover and experiment with digital audio, while opening an easy way to transition to production of audio products in series. The project is entering a new stage, with an upgraded hardware and a new ecosystem of software libraries to fully exploit the processing capabilities.
Read more about Noise Nugget.
- TBD DSP toolkit — Open hardware audio processing module
-
TBD DSP Toolkit is an open-source platform for audio DSP for experimentation, learning, and audio research. It brings together more than 50 high-quality generators and effects within a modular, easily extensible architecture. TBD has a flexible approach to embedded audio processing, and tries to deliver an accessible, musician-friendly environment, both in software and hardware. A key new component is a standalone desktop version of the hardware, including standard MIDI connectivity, designed to welcome users beyond the Eurorack community and make the platform easier to adopt for education, prototyping, and instrument design. This includes a redesigned, intuitive web user interface and UX guidelines to help developers build playable, musician-centered DSP modules, clear documentation and example use-cases and reference workflows. By uniting developer flexibility with musician usability, TBD aims to offer a resilient, open-source alternative in a landscape dominated by proprietary platforms. All software is released under GPL 3.0, and updated open hardware designs will be published in KiCad.
Read more about TBD DSP toolkit.