DevstralMistral AI
|
||||||
Related Products
|
||||||
About
AgentBench is an evaluation framework specifically designed to assess the capabilities and performance of autonomous AI agents. It provides a standardized set of benchmarks that test various aspects of an agent's behavior, such as task-solving ability, decision-making, adaptability, and interaction with simulated environments. By evaluating agents on tasks across different domains, AgentBench helps developers identify strengths and weaknesses in the agents’ performance, such as their ability to plan, reason, and learn from feedback. The framework offers insights into how well an agent can handle complex, real-world-like scenarios, making it useful for both research and practical development. Overall, AgentBench supports the iterative improvement of autonomous agents, ensuring they meet reliability and efficiency standards before wider application.
|
About
Devstral is an open source, agentic large language model (LLM) developed by Mistral AI in collaboration with All Hands AI, specifically designed for software engineering tasks. It excels at navigating complex codebases, editing multiple files, and resolving real-world issues, outperforming all open source models on the SWE-Bench Verified benchmark with a score of 46.8%. Devstral is fine-tuned from Mistral-Small-3.1 and features a long context window of up to 128,000 tokens. It is optimized for local deployment on high-end hardware, such as a Mac with 32GB RAM or an Nvidia RTX 4090 GPU, and is compatible with inference frameworks like vLLM, Transformers, and Ollama. Released under the Apache 2.0 license, Devstral is available for free and can be accessed via Hugging Face, Ollama, Kaggle, Unsloth, and LM Studio.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
AI developers wanting a tool to manage and evaluate their LLMs
|
Audience
Software developers and engineering teams seeking a tool to assist with code exploration, debugging, and multi-file editing tasks
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
No information available.
Free Version
Free Trial
|
Pricing
$0.1 per million input tokens
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationAgentBench
China
llmbench.ai/agent
|
Company InformationMistral AI
Founded: 2023
France
mistral.ai/news/devstral
|
|||||
Alternatives |
Alternatives |
|||||
|
|
||||||
|
|
||||||
|
|
|
|||||
|
|
|
|||||
Categories |
Categories |
|||||
Integrations
Hugging Face
Kaggle
LM Studio
Mistral AI
Mistral Code
Ollama
Unsloth
|
Integrations
Hugging Face
Kaggle
LM Studio
Mistral AI
Mistral Code
Ollama
Unsloth
|
|||||
|
|
|