Formats and FFmpeg

WAV, MP3 and FLAC are built in. OGG, Opus, AAC and video use FFmpeg, which is found on your computer or downloaded.

Files are read by their content, not their extension, and written by the extension of the name you give. audioSave( audio, "x.ogg", 16, 96 ) writes Ogg Vorbis at 96 kbps, and audioLoad( "clip.mp4" ) reads the sound of a video.

FLAC

The FLAC encoder and decoder are written for this module, in plain Java. Written files were checked against FFmpeg: it decodes them to identical samples, with the checksums valid. Music compresses to 40 to 55 percent of the size of the WAV. The decoder reads FLAC from other encoders too, including their LPC compression.

FFmpeg

FFmpeg is a separate program that the module starts as a process. It is looked for in this order:

1. The module setting ffmpeg (a path to the program, or to the folder that has it)
2. The BX_AUDIO_FFMPEG environment variable
3. The copy installed in ~/.bxaudio/ffmpeg
4. The PATH

If none is found, the module can download one for your computer (about 66 MB on Linux and macOS, 110 MB on Windows) into ~/.bxaudio/ffmpeg. Every file is checked against a pinned size and SHA-256 before it is used, and nothing is installed if a check fails. This happens by itself the first time something needs FFmpeg, unless autoInstall is false. To do it ahead of time or see the state:

bx-audio ffmpeg            # is it available, which version, which encoders
bx-audio ffmpeg install    # download it now, with progress

status = audioFfmpeg();     // available, source, path, version, encoders, installable, downloadSizeMB
audioFfmpegInstall( ( name, done, total ) => println( name & " " & int( done * 100 / total ) & "%" ) );

Downloads are available for Linux and macOS on amd64 and arm64 (builds by martin-riedl.de) and Windows on amd64 (builds by gyan.dev). On any other system install FFmpeg yourself, or point the module at it.

Licensing. FFmpeg and its builds carry their own licenses, LGPL or GPL depending on how they were built, and these builds include GPL components. The module never bundles or links FFmpeg. You download it from its provider onto your computer, and it runs as its own program. If your use needs a particular FFmpeg license, install your own build and set ffmpeg to it. See Licenses.

Video

info = videoInfo( "clip.mp4" );       // seconds, size, video {codec,width,height,fps}, audio {codec,channels,sampleRate}
sound = audioLoad( "clip.mp4" );      // the first audio stream, as 32 bit float at its own rate
audioMux( video="clip.mp4", audio=newSound, output="scored.mp4" );

audioMux copies the picture without re-encoding it. webm output uses Opus, everything else AAC. See Trailers and video.

Markers

audioMarkers writes the points in time an editor or a player shows, from { time, label, duration } structs:

markers = [ { time: 0, label: "Intro" }, { time: 12.5, label: "Verse" }, { time: 65, label: "Chorus" } ];
println( audioMarkers( markers, "youtube" ) );
audioMarkers( markers, "edl", "markers.edl", 25 );       // DaVinci Resolve markers at 25 fps

Settings