KARMA – An evaluation framework for Medical AI systems

Show HN: KARMA – An evaluation framework for Medical AI systems

Operating in show hn launch, KARMA – An evaluation framework for Medical AI systems operates.

Profile

KARMA-OpenMedEvalKit is an expandable toolkit for assessing AI models in medical applications, featuring multiple healthcare-focused datasets with particular emphasis on the Indian healthcare environment.KARMA can evaluate text, image, and audio-based medical AI models using 21+ healthcare datasets We support popular models (Qwen, MedGemma, IndicConformer, OpenAI, Anthropic models - via AWS Bedrock, and practically any HuggingFace models) out-of-the-box KARMA also handles medical-specific evaluation needs like ASR models that need language-aware post-processing, or having LLM as a judge on rubric based evaluations. KARMA caches model outputs so you can iterate on metrics without re-running e

The company sits in the show hn launch segment, where it competes on its core product or service.

Directory data places it at the Show HN launch stage.

Website: karma.eka.care