Am I guessing right that
<config> in manifest file for a Joomla library is not supported? Only for modules, components, templates and plugins?
No (as far as I know), but you can register your lib through a plugin and plugins can have config manifests:
I would just load the lib into my component and would set params there.