xufulong
3 years ago
parent
2226a57eb4
commit
345cf7a512
@ -0,0 +1,368 @@ |
|||||||
|
# 前言 |
||||||
|
FFmpeg是一个跨平台的多媒体库，也是目前音视频领域应用最广泛的库。包括libavcodec、libavformat、libavutil、</br> |
||||||
|
libavdevice、libavfilter、libswscale、libswresample、libpostproc等模块。其中avcodec用于编解码，</br> |
||||||
|
avformat用于解封装，avutil是提供工具类，avdevice用于各平台的设备接入，avfilter提供滤镜操作，</br> |
||||||
|
swscale提供图像缩放与像素格式转换，swresample提供音频重采样，postproc提供高级处理。</br> |
||||||
|
|
||||||
|
# 一、准备工作 |
||||||
|
## 1、下载ffmpeg源码 |
||||||
|
使用git命令：git clone https://github.com/FFmpeg/FFmpeg.git。 |
||||||
|
|
||||||
|
## 2、下载ndk源码 |
||||||
|
在Android开发者文档可以下载到ndk源码，[ndk下载链接](https://developer.android.com/ndk/downloads)。 |
||||||
|
根据实际需求选择对应ndk版本，建议下载ndk-r20b稳定版。mac电脑配置ndk系统环境变量步骤如下： |
||||||
|
(1)、在命令行输入vim ~/.bash_profile |
||||||
|
(2)、输入i进行编辑模式 |
||||||
|
(3)、编写export NDK_PATH=xxx/xxx/android-ndk-r20b |
||||||
|
(4)、按下esc退出编辑模式，输入:wq保存并退出 |
||||||
|
|
||||||
|
# 二、编译ffmpeg源码 |
||||||
|
## 1、分析configure结构 |
||||||
|
在FFmpeg源码目录有个configure配置脚本，使用./configure --help进行查看，可以看到如下结构的编译选项：</br> |
||||||
|
|
||||||
|
| Help options: | Description | |
||||||
|
|:------------------------|:----------------------------| |
||||||
|
| --help | print this message | |
||||||
|
| --list-decoders | show all available decoders | |
||||||
|
| --list-encoders | show all available encoders | |
||||||
|
| --list-hwaccels | show all available hardware | |
||||||
|
| --list-demuxers | show all available demuxers | |
||||||
|
| --list-muxers | show all available muxers | |
||||||
|
| --list-parsers | show all available parsers | |
||||||
|
| --list-protocols | show all available protocols| |
||||||
|
| --list-filters | show all available filters | |
||||||
|
|
||||||
|
Licensing options: |
||||||
|
--enable-gpl allow use of GPL code [no] |
||||||
|
--enable-version3 upgrade (L)GPL to version 3 [no] |
||||||
|
--enable-nonfree allow use of nonfree code [no] |
||||||
|
|
||||||
|
Configuration options: |
||||||
|
--prefix=PREFIX install in PREFIX [/usr/local] |
||||||
|
--disable-static do not build static libraries [no] |
||||||
|
--enable-shared build shared libraries [no] |
||||||
|
--enable-small optimize for size instead of speed |
||||||
|
--disable-all disable components, libraries |
||||||
|
--disable-autodetect disable detected external libraries |
||||||
|
|
||||||
|
Program options: |
||||||
|
--disable-programs do not build command line programs |
||||||
|
--disable-ffmpeg disable ffmpeg build |
||||||
|
--disable-ffplay disable ffplay build |
||||||
|
--disable-ffprobe disable ffprobe build |
||||||
|
|
||||||
|
Component options: |
||||||
|
--disable-avdevice disable libavdevice build |
||||||
|
--disable-avcodec disable libavcodec build |
||||||
|
--disable-avformat disable libavformat build |
||||||
|
--disable-swresample disable libswresample build |
||||||
|
--disable-swscale disable libswscale build |
||||||
|
--disable-postproc disable libpostproc build |
||||||
|
--disable-avfilter disable libavfilter build |
||||||
|
--disable-pthreads disable pthreads |
||||||
|
--disable-network disable network support [no] |
||||||
|
|
||||||
|
Individual component options: |
||||||
|
--disable-everything disable all components |
||||||
|
--disable-encoder=NAME disable encoder NAME |
||||||
|
--enable-encoder=NAME enable encoder NAME |
||||||
|
--disable-encoders disable all encoders |
||||||
|
--disable-decoder=NAME disable decoder NAME |
||||||
|
--enable-decoder=NAME enable decoder NAME |
||||||
|
--disable-decoders disable all decoders |
||||||
|
--disable-muxer=NAME disable muxer NAME |
||||||
|
--enable-muxer=NAME enable muxer NAME |
||||||
|
--disable-muxers disable all muxers |
||||||
|
--disable-demuxer=NAME disable demuxer NAME |
||||||
|
--enable-demuxer=NAME enable demuxer NAME |
||||||
|
--disable-demuxers disable all demuxers |
||||||
|
--enable-parser=NAME enable parser NAME |
||||||
|
--disable-parser=NAME disable parser NAME |
||||||
|
--disable-parsers disable all parsers |
||||||
|
--enable-protocol=NAME enable protocol NAME |
||||||
|
--disable-protocol=NAME disable protocol NAME |
||||||
|
--disable-protocols disable all protocols |
||||||
|
--enable-filter=NAME enable filter NAME |
||||||
|
--disable-filter=NAME disable filter NAME |
||||||
|
--disable-filters disable all filters |
||||||
|
|
||||||
|
External library support: |
||||||
|
--disable-avfoundation disable Apple AVFoundation framework |
||||||
|
--enable-jni enable JNI support [no] |
||||||
|
--enable-libaom enable AV1 video codec via libaom [no] |
||||||
|
--enable-libass enable libass subtitles rendering [no] |
||||||
|
--enable-libdav1d enable AV1 decoding via libdav1d [no] |
||||||
|
--enable-libfdk-aac enable AAC de/encoding via libfdk-aac [no] |
||||||
|
--enable-libfontconfig enable libfontconfig [no] |
||||||
|
--enable-libfreetype enable libfreetype, needed for drawtext |
||||||
|
--enable-libfribidi enable libfribidi, improves drawtext filter |
||||||
|
--enable-libmp3lame enable MP3 encoding via libmp3lame [no] |
||||||
|
--enable-libopencv enable video filtering via libopencv [no] |
||||||
|
--enable-libopenh264 enable H.264 encoding via OpenH264 [no] |
||||||
|
--enable-libopus enable Opus de/encoding via libopus [no] |
||||||
|
--enable-librtmp enable RTMP[E] support via librtmp [no] |
||||||
|
--enable-libshine enable fixed-point MP3 encoding |
||||||
|
--enable-libsoxr enable Include libsoxr resampling [no] |
||||||
|
--enable-libspeex enable Speex de/encoding via libspeex [no] |
||||||
|
--enable-libtensorflow enable TensorFlow as a DNN module [no] |
||||||
|
--enable-libvorbis enable Vorbis en/decoding via libvorbis |
||||||
|
--enable-libvpx enable VP8 and VP9 de/encoding via libvpx |
||||||
|
--enable-libx264 enable H.264 encoding via x264 [no] |
||||||
|
--enable-libx265 enable HEVC encoding via x265 [no] |
||||||
|
--enable-mediacodec enable Android MediaCodec support [no] |
||||||
|
--enable-opengl enable OpenGL rendering [no] |
||||||
|
--enable-openssl enable openssl, needed for https support |
||||||
|
|
||||||
|
Toolchain options: |
||||||
|
--arch=ARCH select architecture [] |
||||||
|
--cpu=CPU select the minimum required CPU |
||||||
|
--cross-prefix=PREFIX use PREFIX for compilation tools [] |
||||||
|
--enable-cross-compile assume a cross-compiler is used |
||||||
|
--sysroot=PATH root of cross-build tree |
||||||
|
--target-os=OS compiler targets OS [] |
||||||
|
--toolchain=NAME set tool defaults according to name |
||||||
|
--nm=NM use nm tool NM [nm -g] |
||||||
|
--ar=AR use archive tool AR [ar] |
||||||
|
--as=AS use assembler AS [] |
||||||
|
--strip=STRIP use strip tool STRIP [strip] |
||||||
|
--cc=CC use C compiler CC [gcc] |
||||||
|
--cxx=CXX use C compiler CXX [g++] |
||||||
|
--ld=LD use linker LD [] |
||||||
|
--host-cc=HOSTCC use host C compiler HOSTCC |
||||||
|
--host-cflags=HCFLAGS use HCFLAGS when compiling for host |
||||||
|
--host-ld=HOSTLD use host linker HOSTLD |
||||||
|
--host-ldflags=HLDFLAGS use HLDFLAGS when linking for host |
||||||
|
--host-extralibs=HLIBS use libs HLIBS when linking for host |
||||||
|
--host-os=OS compiler host OS [] |
||||||
|
--extra-cflags=ECFLAGS add ECFLAGS to CFLAGS [] |
||||||
|
--extra-cxxflags=ECFLAGS add ECFLAGS to CXXFLAGS [] |
||||||
|
--extra-ldflags=ELDFLAGS add ELDFLAGS to LDFLAGS [] |
||||||
|
|
||||||
|
## 2、修改so后缀 |
||||||
|
默认编译出来的so库包括avcodec、avformat、avutil、avdevice、avfilter、swscale、</br> |
||||||
|
avresample、swresample、postproc，编译出来so是个软链接，真正so名字后缀带有一长串主版本号与子版本号，</br> |
||||||
|
这样的so名字在Adnroid平台无法识别。所以我们需要修改一下，打开该文件并搜索SLIBNAME，找到如下命令行：</br> |
||||||
|
``` |
||||||
|
SLIBNAME_WITH_MAJOR='$(SLIBNAME).$(LIBMAJOR)' |
||||||
|
|
||||||
|
LIB_INSTALL_EXTRA_CMD='$$(RANLIB)"$(LIBDIR)/$(LIBNAME)"' |
||||||
|
|
||||||
|
SLIB_INSTALL_NAME='$(SLIBNAME_WITH_VERSION)' |
||||||
|
|
||||||
|
SLIB_INSTALL_LINKS='$(SLIBNAME_WITH_MAJOR)$(SLIBNAME)' |
||||||
|
``` |
||||||
|
替换为： |
||||||
|
``` |
||||||
|
SLIBNAME_WITH_MAJOR='$(SLIBPREF)$(FULLNAME)-$(LIBMAJOR)$(SLIBSUF)' |
||||||
|
|
||||||
|
LIB_INSTALL_EXTRA_CMD='$$(RANLIB)"$(LIBDIR)/$(LIBNAME)"' |
||||||
|
|
||||||
|
SLIB_INSTALL_NAME='$(SLIBNAME_WITH_MAJOR)' |
||||||
|
|
||||||
|
SLIB_INSTALL_LINKS='$(SLIBNAME)' |
||||||
|
``` |
||||||
|
## 3、修改hevc_mvs.c |
||||||
|
在linux或者mac平台交叉编译过程中，可能在libavcodec/hevc_mvs.c报错： |
||||||
|
``` |
||||||
|
libavcodec/hevc_mvs.c: In function 'derive_spatial_merge_candidates': |
||||||
|
libavcodec/hevc_mvs.c:208:15: error: 'y0000000' undeclared (first use in this function) |
||||||
|
((y ## v) >> s->ps.sps->log2_min_pu_size)) |
||||||
|
^ |
||||||
|
libavcodec/hevc_mvs.c:204:14: note: in definition of macro 'TAB_MVF' |
||||||
|
tab_mvf[(y) * min_pu_width + x] |
||||||
|
^ |
||||||
|
libavcodec/hevc_mvs.c:274:16: note: in expansion of macro 'TAB_MVF_PU' |
||||||
|
(cand && !(TAB_MVF_PU(v).pred_flag == PF_INTRA)) |
||||||
|
^ |
||||||
|
libavcodec/hevc_mvs.c:368:23: note: in expansion of macro 'AVAILABLE' |
||||||
|
is_available_b0 = AVAILABLE(cand_up_right, B0) && |
||||||
|
^ |
||||||
|
libavcodec/hevc_mvs.c:208:15: note: each undeclared identifier is reported only once for each function it appears in |
||||||
|
((y ## v) >> s->ps.sps->log2_min_pu_size)) |
||||||
|
^ |
||||||
|
libavcodec/hevc_mvs.c:204:14: note: in definition of macro 'TAB_MVF' |
||||||
|
tab_mvf[(y) * min_pu_width + x] |
||||||
|
^ |
||||||
|
libavcodec/hevc_mvs.c:274:16: note: in expansion of macro 'TAB_MVF_PU' |
||||||
|
(cand && !(TAB_MVF_PU(v).pred_flag == PF_INTRA)) |
||||||
|
``` |
||||||
|
原因是hevc_mvs.c会引用libavutil/timer.h文件(参考：ijkplayer#issues#4093) |
||||||
|
``` |
||||||
|
#if CONFIG_LINUX_PERF |
||||||
|
#ifndef _GNU_SOURCE |
||||||
|
#define _GNU_SOURCE |
||||||
|
#endif |
||||||
|
#include <unistd.h> |
||||||
|
#include <sys/ioctl.h> |
||||||
|
#include <asm/unistd.h> |
||||||
|
#include <linux/perf_event.h> |
||||||
|
#endif |
||||||
|
``` |
||||||
|
在sys/ioctl.h中最终会引用asm/termbits .h文件有#define B0 0000000，导致与hevc_mvs.c的B0命名冲突。</br> |
||||||
|
解决方法有2种：把B0改为b0、xB0改为xb0、yB0改为yb0。</br> |
||||||
|
或者在脚本添加：export COMMON_FF_CFG_FLAGS="$COMMON_FF_CFG_FLAGS --disable-linux-perf"</br> |
||||||
|
|
||||||
|
## 4、编译脚本 |
||||||
|
在ffmpeg源码根目录创建一个shell脚本，比如命名为build_ffmpeg.sh，以mac编译环境为例，</br> |
||||||
|
ndk旧版本已经过时，google官方放弃了gcc交叉编译工具链，转而使用clang编译工具链，因为clang编译速度快、效率高。</br> |
||||||
|
下面例子是采用ndk新版的clang进行编译(如果是使用虚拟机在linux环境交叉编译FFmpeg，下面的darwin改为linux)。具体如下：</br> |
||||||
|
``` |
||||||
|
#!/bin/bash |
||||||
|
make clean |
||||||
|
set -e |
||||||
|
archbit=64 |
||||||
|
|
||||||
|
if [ $archbit -eq 64 ];then |
||||||
|
echo "build for 64bit" |
||||||
|
ARCH=aarch64 |
||||||
|
CPU=armv8-a |
||||||
|
API=21 |
||||||
|
PLATFORM=aarch64 |
||||||
|
ANDROID=android |
||||||
|
CFLAGS="" |
||||||
|
LDFLAGS="" |
||||||
|
|
||||||
|
else |
||||||
|
echo "build for 32bit" |
||||||
|
ARCH=arm |
||||||
|
CPU=armv7-a |
||||||
|
API=16 |
||||||
|
PLATFORM=armv7a |
||||||
|
ANDROID=androideabi |
||||||
|
CFLAGS="-mfloat-abi=softfp -march=$CPU" |
||||||
|
LDFLAGS="-Wl,--fix-cortex-a8" |
||||||
|
fi |
||||||
|
|
||||||
|
export NDK=/Users/xufulong/Library/Android/android-ndk-r20b |
||||||
|
export TOOLCHAIN=$NDK/toolchains/llvm/prebuilt/darwin-x86_64/bin |
||||||
|
export SYSROOT=$NDK/toolchains/llvm/prebuilt/darwin-x86_64/sysroot |
||||||
|
export CROSS_PREFIX=$TOOLCHAIN/$ARCH-linux-$ANDROID- |
||||||
|
export CC=$TOOLCHAIN/$PLATFORM-linux-$ANDROID$API-clang |
||||||
|
export CXX=$TOOLCHAIN/$PLATFORM-linux-$ANDROID$API-clang++ |
||||||
|
export PREFIX=../ffmpeg-android/$CPU |
||||||
|
|
||||||
|
function build_android { |
||||||
|
./configure \ |
||||||
|
--prefix=$PREFIX \ |
||||||
|
--cross-prefix=$CROSS_PREFIX \ |
||||||
|
--target-os=android \ |
||||||
|
--arch=$ARCH \ |
||||||
|
--cpu=$CPU \ |
||||||
|
--cc=$CC \ |
||||||
|
--cxx=$CXX \ |
||||||
|
--nm=$TOOLCHAIN/$ARCH-linux-$ANDROID-nm \ |
||||||
|
--strip=$TOOLCHAIN/$ARCH-linux-$ANDROID-strip \ |
||||||
|
--enable-cross-compile \ |
||||||
|
--sysroot=$SYSROOT \ |
||||||
|
--extra-cflags="$CFLAGS" \ |
||||||
|
--extra-ldflags="$LDFLAGS" \ |
||||||
|
--extra-ldexeflags=-pie \ |
||||||
|
--enable-runtime-cpudetect \ |
||||||
|
--disable-static \ |
||||||
|
--enable-shared \ |
||||||
|
--disable-ffprobe \ |
||||||
|
--disable-ffplay \ |
||||||
|
--disable-ffmpeg \ |
||||||
|
--disable-debug \ |
||||||
|
--disable-doc \ |
||||||
|
--enable-avfilter \ |
||||||
|
--enable-avresample \ |
||||||
|
--enable-decoders \ |
||||||
|
$ADDITIONAL_CONFIGURE_FLAG |
||||||
|
|
||||||
|
make |
||||||
|
make install |
||||||
|
} |
||||||
|
build_android |
||||||
|
``` |
||||||
|
按照上面shell脚本分为4段。第一段make clean清除缓存，set -e设置编译出错后马上退出，archbit=xx指定cpu架构是32位还是64位。</br> |
||||||
|
第二段if...else...fi用来条件编译不同cpu架构对应字段的值。第三段用export关键字声明宏定义，其中PREFIX是指定输出文件路径。</br> |
||||||
|
第四段是一个执行函数，按照ffmpeg的configure规范进行编写。函数里面的enable代表开启，disable代表关闭，也就是对ffmpeg进行剪裁，</br> |
||||||
|
根据我们需要的功能进行enable。make命令是执行编译，make install命令是执行安装。最后的build_android是执行函数。</br> |
||||||
|
初次执行shell脚本，需要修改脚本权限，使用linux命令：chmod 777 build_ffmpeg.sh。执行脚本只需要一行命令，</br> |
||||||
|
即在命令行输入./build_ffmpeg.sh。编译过程中，命令行会不断打印编译日志，等待命令行输出INSTALL xxx关键字代表编译完成。</br> |
||||||
|
|
||||||
|
## 5、编译问题分析 |
||||||
|
编译过程中，可能会出现这样那样的问题，比如ndk配置不对、脚本语法不对。但不用慌，编译输出窗口会描述出错原因，</br> |
||||||
|
在ffbuild/config.log会告诉你问题的具体原因所在，顺着思路一般可以找到问题的答案。</br> |
||||||
|
|
||||||
|
# 三、so库剪裁 |
||||||
|
ffmpeg强大之处在于支持按需编译，进行弹性剪裁。可以使用--disable-everything关闭所有模块，</br> |
||||||
|
可以使用enable/disable来开启关闭某个模块，或者某个编解码器、某个封装器、某个协议。</br> |
||||||
|
|
||||||
|
## 1、encoders与decoders |
||||||
|
encoder和decoder在libavcodec模块，可以用./configure --list-encoders或者ffmpeg --encoders查看支持的编码器。</br> |
||||||
|
同样地，可以用./configure --list-decoders或者ffmpeg --decoders查看支持的解码器。我们可以先--disable-encoders，</br> |
||||||
|
--enable-encoder=aac,h264 其中lib开头的表示第三方库。</br> |
||||||
|
|
||||||
|
## 2、muxers与demuxers |
||||||
|
muxer和demuxer在libavformat模块，可用./configure --list-muxers或者ffmpeg --muxers查看支持的封装器。</br> |
||||||
|
同样地，可用./configure --list-demuxers或者ffmpeg --demuxers查看支持的解封装器。先--disable-muxers，再--enable-muxer=mp3</br> |
||||||
|
|
||||||
|
## 3、protocols |
||||||
|
protocol也是在libavformat模块中，./configure --list-protocols或者ffmpeg --protocols查看支持的协议，</br> |
||||||
|
|
||||||
|
## 4、parsers |
||||||
|
parser在libavfilter模块中，提供各种filter，比如音频：amix、atempo，视频：rotate、hflip，</br> |
||||||
|
我们可以根据需求--enable-parser来开启，可使用./configure --list-parsers查看具体列表。</br> |
||||||
|
|
||||||
|
# 四、编译过程分析 |
||||||
|
编译过程包括：预编译、编译、汇编、链接。详细可以查阅书籍<程序员的自我修养> |
||||||
|
|
||||||
|
## 1、预编译 |
||||||
|
预编译处理(.c/.cpp->.i)，对源文件的伪指令进行处理。 |
||||||
|
伪指令包括：宏定义(#define)、条件编译指令(#ifdef #elseif #endif)、头文件包含指令(#include) |
||||||
|
|
||||||
|
## 2、编译 |
||||||
|
编译(.i->.s)，对经过预编译处理文件进行语法分析，编译为汇编文件。 |
||||||
|
|
||||||
|
## 3、汇编 |
||||||
|
汇编(.i->.o)，把汇编代码翻译为机器码，也就是二进制的目标文件。 |
||||||
|
|
||||||
|
## 4、链接 |
||||||
|
链接(.o->.so/.a/.lib)，把所有目标文件链接成动态库、静态库文件。 |
||||||
|
|
||||||
|
## 5、FFmpeg的makefile分析 |
||||||
|
makefile主要发生在汇编阶段，把所有依赖的目标文件添加进去。以FFmpeg的AVFilter模块makefile为例(有省略)： |
||||||
|
``` |
||||||
|
NAME = avfilter |
||||||
|
DESC = FFmpeg audio/video filtering library |
||||||
|
|
||||||
|
HEADERS = avfilter.h \ |
||||||
|
buffersink.h \ |
||||||
|
buffersrc.h \ |
||||||
|
version.h \ |
||||||
|
|
||||||
|
OBJS = allfilters.o \ |
||||||
|
audio.o \ |
||||||
|
avfilter.o \ |
||||||
|
avfiltergraph.o \ |
||||||
|
buffersink.o \ |
||||||
|
buffersrc.o \ |
||||||
|
drawutils.o \ |
||||||
|
fifo.o \ |
||||||
|
formats.o \ |
||||||
|
framepool.o \ |
||||||
|
framequeue.o \ |
||||||
|
graphdump.o \ |
||||||
|
graphparser.o \ |
||||||
|
transform.o \ |
||||||
|
video.o \ |
||||||
|
|
||||||
|
# audio filters |
||||||
|
OBJS-$(CONFIG_ACOPY_FILTER) += af_acopy.o |
||||||
|
OBJS-$(CONFIG_ACROSSFADE_FILTER) += af_afade.o |
||||||
|
OBJS-$(CONFIG_ACROSSOVER_FILTER) += af_acrossover.o |
||||||
|
OBJS-$(CONFIG_ADELAY_FILTER) += af_adelay.o |
||||||
|
OBJS-$(CONFIG_AECHO_FILTER) += af_aecho.o |
||||||
|
|
||||||
|
# video filters |
||||||
|
OBJS-$(CONFIG_BLACKDETECT_FILTER) += vf_blackdetect.o |
||||||
|
OBJS-$(CONFIG_DEBLOCK_FILTER) += vf_deblock.o |
||||||
|
OBJS-$(CONFIG_DELOGO_FILTER) += vf_delogo.o |
||||||
|
OBJS-$(CONFIG_DRAWTEXT_FILTER) += vf_drawtext.o |
||||||
|
OBJS-$(CONFIG_EDGEDETECT_FILTER) += vf_edgedetect.o |
||||||
|
OBJS-$(CONFIG_EQ_FILTER) += vf_eq.o |
||||||
|
OBJS-$(CONFIG_GBLUR_FILTER) += vf_gblur.o |
||||||
|
OBJS-$(CONFIG_OVERLAY_FILTER) += vf_overlay.o framesync.o |
||||||
|
``` |
||||||
Loading…
Reference in new issue