Combining these two in one single value saves some memory, but is
complicated and we may need the src_sample_format for new features
later.