Devstral

Devstral

Mistral AI
+
+

Related Products

  • Vertex AI
    961 Ratings
    Visit Website
  • Atera
    1,923 Ratings
    Visit Website
  • Sendbird
    164 Ratings
    Visit Website
  • Ango Hub
    15 Ratings
    Visit Website
  • Pipefy
    591 Ratings
    Visit Website
  • Docket
    58 Ratings
    Visit Website
  • Checksum.ai
    1 Rating
    Visit Website
  • Viktor
    17 Ratings
    Visit Website
  • Perplexity Computer
    26 Ratings
    Visit Website
  • Assembled
    248 Ratings
    Visit Website

About

AgentBench is an evaluation framework specifically designed to assess the capabilities and performance of autonomous AI agents. It provides a standardized set of benchmarks that test various aspects of an agent's behavior, such as task-solving ability, decision-making, adaptability, and interaction with simulated environments. By evaluating agents on tasks across different domains, AgentBench helps developers identify strengths and weaknesses in the agents’ performance, such as their ability to plan, reason, and learn from feedback. The framework offers insights into how well an agent can handle complex, real-world-like scenarios, making it useful for both research and practical development. Overall, AgentBench supports the iterative improvement of autonomous agents, ensuring they meet reliability and efficiency standards before wider application.

About

Devstral is an open source, agentic large language model (LLM) developed by Mistral AI in collaboration with All Hands AI, specifically designed for software engineering tasks. It excels at navigating complex codebases, editing multiple files, and resolving real-world issues, outperforming all open source models on the SWE-Bench Verified benchmark with a score of 46.8%. Devstral is fine-tuned from Mistral-Small-3.1 and features a long context window of up to 128,000 tokens. It is optimized for local deployment on high-end hardware, such as a Mac with 32GB RAM or an Nvidia RTX 4090 GPU, and is compatible with inference frameworks like vLLM, Transformers, and Ollama. Released under the Apache 2.0 license, Devstral is available for free and can be accessed via Hugging Face, Ollama, Kaggle, Unsloth, and LM Studio.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

AI developers wanting a tool to manage and evaluate their LLMs

Audience

Software developers and engineering teams seeking a tool to assist with code exploration, debugging, and multi-file editing tasks

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Pricing

No information available.
Free Version
Free Trial

Pricing

$0.1 per million input tokens
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

AgentBench
China
llmbench.ai/agent

Company Information

Mistral AI
Founded: 2023
France
mistral.ai/news/devstral

Alternatives

GLM-4.7

GLM-4.7

Zhipu AI

Alternatives

DeepCoder

DeepCoder

Agentica Project
DeepSWE

DeepSWE

Agentica Project
Mistral Vibe

Mistral Vibe

Mistral AI
GLM-4.6

GLM-4.6

Zhipu AI
Mistral Large 3

Mistral Large 3

Mistral AI
Claude Opus 4.5

Claude Opus 4.5

Anthropic

Categories

Categories

Integrations

Hugging Face
Kaggle
LM Studio
Mistral AI
Mistral Code
Ollama
Unsloth

Integrations

Hugging Face
Kaggle
LM Studio
Mistral AI
Mistral Code
Ollama
Unsloth
Claim AgentBench and update features and information
Claim AgentBench and update features and information
Claim Devstral and update features and information
Claim Devstral and update features and information