One Bad Recording Rule crash all Multi Tenant Recording Rules

[yoyoraso]

Describe the bug
I have Multi tenant recording_rules and incase of any rule has a issue I see that ruler stop them all
To Reproduce
Steps to reproduce the behavior:

1. create two recording_rule one for each tenant (tenant1,tenant2)
2. I created to config maps and mounted them to the ruler pod using helm chart extra mount volume.
3. first rule is under /etc/loki/rules/tenant1 second one is under /etc/loki/rules/tenant2
4. test if both working fine if yes try to make one of them faulty
5. now you will find that ruler is not able to evaluate both and keeps telling you [failed to list rule groups for user (name of the tenant with the faulty rule)]Expected behavior
   at least only this tenant rules stop working not all of them

Environment:

• Kubernetes
• helm

Screenshots, Promtail config, or terminal output