Mistral – 7B Parameters

Mistral for Edge AI Applications

Mistral is a compact and powerful 7B parameter model, optimized for instruction following and text completion while being lightweight enough for Edge AI deployments. With an Apache 2.0 license, Mistral provides unrestricted flexibility for customization and integration into real-world applications.

Why Mistral for Edge AI?

• Efficiency: Offers top-tier performance in a small model size, ideal for low-latency edge computing.
• Benchmark Superiority: Outperforms Llama 2 13B across all major benchmarks and rivals CodeLlama 7B in coding tasks.
• Versatile Deployment: Available in both instruct (optimized for guided interactions) and text (pure text completion) variants.
• Function Calling Capabilities: Supports structured API interactions, making it suitable for intelligent automation and system integrations.

Model Versions

• Mistral 0.3 (Latest) – Supports function calling for dynamic applications.
• Mistral 0.2 – Minor update refining previous functionalities.
• Mistral 0.1 – Initial release.

Function Calling for Edge AI

Mistral 0.3 enables function calling via Ollama’s raw mode, making it useful for real-world tasks such as:

• Smart IoT Devices: Fetch real-time data and trigger automated responses.
• Edge-Based Assistants: Process and retrieve localized information efficiently.
• Industrial Automation: Execute structured commands in autonomous systems.

Example Function Call for Weather Retrieval

[AVAILABLE_TOOLS] [{"type": "function", "function": {"name": "get_current_weather", "description": "Get the current weather", "parameters": {"type": "object", "properties": {"location": {"type": "string", "description": "The city and state, e.g. San Francisco, CA"}, "format": {"type": "string", "enum": ["celsius", "fahrenheit"], "description": "The temperature unit to use. Infer this from the user's location."}}, "required": ["location", "format"]}}}][/AVAILABLE_TOOLS][INST] What is the weather like today in San Francisco [/INST]

Example Response:

[TOOL_CALLS] [{"name": "get_current_weather", "arguments": {"location": "San Francisco, CA", "format": "celsius"}}]

Deployment and Integration

Mistral can be easily deployed on edge devices via command-line or API:

CLI Usage

ollama run mistral

API Example

curl -X POST http://localhost:11434/api/generate -d '{
  "model": "mistral",
  "prompt":"Summarize recent AI advancements"
 }'

Summary

Mistral’s compact size and powerful performance make it an ideal choice for Edge AI deployments, whether for industrial automation, IoT integration, or AI-powered assistants. Its ability to handle structured function calls enhances real-world usability, making it a key player in next-generation AI systems at the edge.