Currently, the metadata filters in pipeline (CI) jobs are either all of a type of metadata, or a defined subset. There is no option to include all, except for a couple of objects, which is oftentimes required.
Please consider adding a negative (exclusion) filter for CI jobs, in addition to the existing positive (inclusion) filters.