Ragas
Ragas is an open source framework for testing and evaluating LLM applications. Ragas provides metrics , synthetic test data generation and workflows for ensuring the quality of your application while development and also monitoring it's quality in production.