AI Solutions

LLMEval

API

0

focuses on understanding how these models perform in various scenarios and analyzing results from an interpretability perspective.

FELM

API

0

a meta-benchmark that evaluates how well factuality evaluators assess the outputs of large language models (LLMs).

DreamBench++

API

0

a benchmark for evaluating the performance of large language models (LLMs) in various tasks related to both textual and visual imagination.

MMToM-QA

API

0

a multimodal question-answering benchmark designed to evaluate AI models' cognitive ability to understand human beliefs and goals.

PubMedQA

API

0

a biomedical question-answering benchmark designed for answering research-related questions using PubMed abstracts.

MMedBench

API

0

a benchmark that evaluates large language models' ability to answer medical questions across multiple languages.

TAT-DQA

API

0

a large-scale Document Visual Question Answering (VQA) dataset designed for complex document understanding, particularly in financial reports.

SuperLim

API

0

a Swedish language understanding benchmark that evaluates natural language processing (NLP) models on various tasks such as argumentation analysis, semantic similarity, and textual entailment.

SciBench

API

0

benchmark designed to evaluate large language models (LLMs) on solving complex, college-level scientific problems from domains like chemistry, physics, and mathematics.

SuperBench

API

0

a benchmark platform designed for evaluating large language models (LLMs) on a range of tasks, particularly focusing on their performance in different aspects such as natural language understanding, reasoning, and generalization.

We-Math

API

0

a benchmark that evaluates large multimodal models (LMMs) on their ability to perform human-like mathematical reasoning.

VisualWebArena

API

0

a benchmark designed to assess the performance of multimodal web agents on realistic visually grounded tasks.

WHOOPS!

API

0

a benchmark dataset testing AI's ability to reason about visual commonsense through images that defy normal expectations.

Tune Studio

API

0

Playground for devs to finetune & deploy LLMs

Guardrails.ai

API

0

AI tool from awesome-llm

MPT-7B

API

0

AI tool from awesome-llm

Chainlit

API

0

AI tool from awesome-llm

Arthur Shield

API

0

AI tool from awesome-llm

Grok-1-314B-MoE

API

0

AI tool from awesome-llm

Weights & Biases

API

0

AI tool from awesome-llm

Llama 3.2-1|3|11|90B

API

0

AI tool from awesome-llm

MLflow

API

0

MLflow: An open-source framework for the end-to-end machine learning lifecycle, helping developers track experiments, evaluate models/prompts, deploy models, and add observability with tracing.

Gemma2-9|27B

API

0

AI tool from awesome-llm

CS25-Transformers United

API

0

AI tool from awesome-llm