We have shipped a beta feature that enables Errors/Exceptions tracking separately by environment. This includes occurrences, stacktraces and notifications. When you are using different environments, then enabling this feature will initially trigger new notifications for all errors in non-production environments.
When triggering a release for an environment and service, only errors of these will get reset and notify again, according to your notification filter settings.
Enable this feature in the “Beta Features” section under the main navigation “Organizations” entry.