Magento 2.4.2 : Disabled Products are visible in Frontend

Products, that are disabled in our backend, are still shown in the frontend.
Even after changing the visibility to “not visible individually” or just “catalog”, they still appear through the search function in our shop.

We already tried clearing the cache and reindexing.
Is there another option?

The products were originally synched from our ERP system, but we changed the settings in our ERP system to “not available” and “not active” as well. – still no change

Thanks!