Add files using upload-large-folder tool

.gitattributes

@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+tekken.json filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,398 @@
+---
+library_name: vllm
+language:
+- en
+- fr
+- es
+- de
+- it
+- pt
+- nl
+- zh
+- ja
+- ko
+- ar
+license: apache-2.0
+inference: false
+extra_gated_description: >-
+  If you want to learn more about how we process your personal data, please read
+  our <a href="https://mistral.ai/terms/">Privacy Policy</a>.
+tags:
+- mistral-common
+---
+
+# Mistral Large 3 675B Base 2512
+From our family of large models, **Mistral Large 3** is a state-of-the-art general-purpose **Multimodal granular Mixture-of-Experts** model with **41B active parameters** and **675B total parameters** trained from scratch with 3000 H200s.
+
+This model is the base pre-trained version, not fine-tuned for instruction or reasoning tasks, making it ideal for custom post-training processes.  
+Designed for reliability and long-context comprehension - It is engineered for production-grade assistants, retrieval-augmented systems, scientific workloads, and complex enterprise workflows.
+
+Mistral Large 3 Instruct is deployable on-premises in:
+- [FP8](https://huggingface.co/mistralai/Mistral-Large-3-675B-Instruct-2512) on a single node of B200s or H200s.
+- [NVFP4](https://huggingface.co/mistralai/Mistral-Large-3-675B-Instruct-2512-NVFP4) on a single node of H100s or A100s.
+
+## Key Features
+Mistral Large 3 consists of two main architectural components:
+- **A Granular MoE Language Model with 673B params and 39B active**
+- **A 2.5B Vision Encoder**
+
+The Mistral Large 3 Base model offers the following capabilities:
+- **Vision**: Enables the model to analyze images and provide insights based on visual content, in addition to text.
+- **Multilingual**: Supports dozens of languages, including English, French, Spanish, German, Italian, Portuguese, Dutch, Chinese, Japanese, Korean, Arabic.
+- **Frontier**: Delivers best-in-class performance.
+- **Apache 2.0 License**: Open-source license allowing usage and modification for both commercial and non-commercial purposes.
+- **Large Context Window**: Supports a 256k context window.
+
+## Use Cases
+With powerful long-context performance, stable and consistent cross-domain behavior, Mistral Large 3 is perfect for:
+- Long Document Understanding
+- Powerful Daily-Driver AI Assistants
+- State-of-the-Art Agentic and Tool-Use Capabilities
+- Enterprise Knowledge Work
+- General Coding Assistant
+
+And enterprise-grade use cases requiring frontier capabilities.
+
+## Recommended Settings
+
+We recommend deploying Large 3 in a client-server configuration with the following best practices:
+
+- **System Prompt**: Define a clear environment and use case, including guidance on how to effectively leverage tools in agentic systems.
+- **Sampling Parameters**: Use a temperature below 0.1 for daily-driver and production environments ; Higher temperatures may be explored for creative use cases - developers are encouraged to experiment with alternative settings.
+- **Tools**: Keep the set of tools well-defined and limit their number to the minimum required for the use case - Avoiding overloading the model with an excessive number of tools.
+- **Vision**: When deploying with vision capabilities, we recommend maintaining an aspect ratio close to 1:1 (width-to-height) for images. Avoiding the use of overly thin or wide images - crop them as needed to ensure optimal performance.
+
+### Known Issues / Limitations
+
+- **Not a dedicated reasoning model**: Dedicated reasoning models can outperform Mistral Large 3 in strict reasoning use cases.
+- **Behind vision-first models in multimodal tasks**: Mistral Large 3 can lag behind models optimized for vision tasks and use cases.
+- **Complex deployment**: Due to its large size and architecture, the model can be challenging to deploy efficiently with constrained resources or at scale.
+
+## Benchmark Results
+
+We compare Mistral Large 3 to similar sized models.
+
+### Text 
+
+### Vision
+
+## Instruct Usage
+
+The Instruct model can be used with the following frameworks;
+- [`vllm`](https://github.com/vllm-project/vllm): See [here](#vllm)
+  
+### vLLM
+
+We recommend using this model with [vLLM](https://github.com/vllm-project/vllm).
+
+#### Installation
+
+Make sure to install [`vLLM >= 0.12.0`](https://github.com/vllm-project/vllm/releases/tag/v0.12.0):
+
+```
+pip install vllm --upgrade
+```
+
+Doing so should automatically install [`mistral_common >= 1.8.6`](https://github.com/mistralai/mistral-common/releases/tag/v1.8.6).
+
+To check:
+```
+python -c "import mistral_common; print(mistral_common.__version__)"
+```
+
+You can also make use of a ready-to-go [docker image](https://github.com/vllm-project/vllm/blob/main/Dockerfile) or on the [docker hub](https://hub.docker.com/layers/vllm/vllm-openai/latest/images/sha256-de9032a92ffea7b5c007dad80b38fd44aac11eddc31c435f8e52f3b7404bbf39).
+
+#### Serve
+
+The Mistral Large 3 Instruct FP8 format can be used on one 8xH200 node. We recommend to use this format if you plan to fine-tuning as it can be more precise than NVFP4 in some situations.
+
+A simple launch command is:
+
+```bash
+
+vllm serve mistralai/Mistral-Large-3-675B-Instruct-2512 \
+  --tensor-parallel-size 8 \
+  --enable-auto-tool-choice --tool-call-parser mistral
+```
+
+Key parameter notes:
+
+* enable-auto-tool-choice: Required when enabling tool usage.
+* tool-call-parser mistral: Required when enabling tool usage.
+
+
+Additional flags:
+
+* You can set `--max-model-len` to preserve memory. By default it is set to `262144` which is quite large but not necessary for most scenarios.
+* You can set `--max-num-batched-tokens` to balance throughput and latency, higher means higher throughput but higher latency.
+
+#### Usage of the model
+
+Here we asumme that the model `mistralai/Mistral-Large-3-675B-Instruct-2512` is served and you can ping it to the domain `localhost` with the port `8000` which is the default for vLLM.
+
+<details>
+  <summary>Vision Reasoning</summary>
+
+Let's see if Mistral Large 3 knows when to pick a fight !
+
+```python
+from datetime import datetime, timedelta
+
+from openai import OpenAI
+from huggingface_hub import hf_hub_download
+
+# Modify OpenAI's API key and API base to use vLLM's API server.
+openai_api_key = "EMPTY"
+openai_api_base = "http://localhost:8000/v1"
+
+TEMP = 0.15
+MAX_TOK = 262144
+
+client = OpenAI(
+    api_key=openai_api_key,
+    base_url=openai_api_base,
+)
+
+models = client.models.list()
+model = models.data[0].id
+
+
+def load_system_prompt(repo_id: str, filename: str) -> str:
+    file_path = hf_hub_download(repo_id=repo_id, filename=filename)
+    with open(file_path, "r") as file:
+        system_prompt = file.read()
+    today = datetime.today().strftime("%Y-%m-%d")
+    yesterday = (datetime.today() - timedelta(days=1)).strftime("%Y-%m-%d")
+    model_name = repo_id.split("/")[-1]
+    return system_prompt.format(name=model_name, today=today, yesterday=yesterday)
+
+
+SYSTEM_PROMPT = load_system_prompt(model, "SYSTEM_PROMPT.txt")
+image_url = "https://static.wikia.nocookie.net/essentialsdocs/images/7/70/Battle.png/revision/latest?cb=20220523172438"
+
+messages = [
+    {"role": "system", "content": SYSTEM_PROMPT},
+    {
+        "role": "user",
+        "content": [
+            {
+                "type": "text",
+                "text": "What action do you think I should take in this situation? List all the possible actions and explain why you think they are good or bad.",
+            },
+            {"type": "image_url", "image_url": {"url": image_url}},
+        ],
+    },
+]
+
+
+response = client.chat.completions.create(
+    model=model,
+    messages=messages,
+    temperature=TEMP,
+    max_tokens=MAX_TOK,
+)
+
+print(response.choices[0].message.content)
+```
+</details>
+
+<details>
+  <summary>Function Calling</summary>
+
+Let's solve some equations thanks to our simple Python calculator tool.
+
+```python
+import json
+from openai import OpenAI
+from huggingface_hub import hf_hub_download
+
+# Modify OpenAI's API key and API base to use vLLM's API server.
+openai_api_key = "EMPTY"
+openai_api_base = "http://localhost:8000/v1"
+
+TEMP = 0.15
+MAX_TOK = 262144
+
+client = OpenAI(
+    api_key=openai_api_key,
+    base_url=openai_api_base,
+)
+
+models = client.models.list()
+model = models.data[0].id
+
+
+def load_system_prompt(repo_id: str, filename: str) -> str:
+    file_path = hf_hub_download(repo_id=repo_id, filename=filename)
+    with open(file_path, "r") as file:
+        system_prompt = file.read()
+    return system_prompt
+
+
+SYSTEM_PROMPT = load_system_prompt(model, "SYSTEM_PROMPT.txt")
+
+image_url = "https://math-coaching.com/img/fiche/46/expressions-mathematiques.jpg"
+
+
+def my_calculator(expression: str) -> str:
+    return str(eval(expression))
+
+
+tools = [
+    {
+        "type": "function",
+        "function": {
+            "name": "my_calculator",
+            "description": "A calculator that can evaluate a mathematical equation and compute its results.",
+            "parameters": {
+                "type": "object",
+                "properties": {
+                    "expression": {
+                        "type": "string",
+                        "description": "The mathematical expression to evaluate.",
+                    },
+                },
+                "required": ["expression"],
+            },
+        },
+    },
+    {
+        "type": "function",
+        "function": {
+            "name": "rewrite",
+            "description": "Rewrite a given text for improved clarity",
+            "parameters": {
+                "type": "object",
+                "properties": {
+                    "text": {
+                        "type": "string",
+                        "description": "The input text to rewrite",
+                    }
+                },
+            },
+        },
+    },
+]
+
+messages = [
+    {"role": "system", "content": SYSTEM_PROMPT},
+    {
+        "role": "user",
+        "content": [
+            {
+                "type": "text",
+                "text": "Thanks to your calculator, compute the results for the equations that involve numbers displayed in the image.",
+            },
+            {
+                "type": "image_url",
+                "image_url": {
+                    "url": image_url,
+                },
+            },
+        ],
+    },
+]
+
+response = client.chat.completions.create(
+    model=model,
+    messages=messages,
+    temperature=TEMP,
+    max_tokens=MAX_TOK,
+    tools=tools,
+    tool_choice="auto",
+)
+
+tool_calls = response.choices[0].message.tool_calls
+
+results = []
+for tool_call in tool_calls:
+    function_name = tool_call.function.name
+    function_args = tool_call.function.arguments
+    if function_name == "my_calculator":
+        result = my_calculator(**json.loads(function_args))
+        results.append(result)
+
+messages.append({"role": "assistant", "tool_calls": tool_calls})
+for tool_call, result in zip(tool_calls, results):
+    messages.append(
+        {
+            "role": "tool",
+            "tool_call_id": tool_call.id,
+            "name": tool_call.function.name,
+            "content": result,
+        }
+    )
+
+
+response = client.chat.completions.create(
+    model=model,
+    messages=messages,
+    temperature=TEMP,
+    max_tokens=MAX_TOK,
+)
+
+print(response.choices[0].message.content)
+```
+
+</details>
+
+<details>
+  <summary>Text-Only Request</summary>
+
+Mistral Large 3 can follow your instructions down to the letter.
+
+```python
+from openai import OpenAI
+from huggingface_hub import hf_hub_download
+
+# Modify OpenAI's API key and API base to use vLLM's API server.
+openai_api_key = "EMPTY"
+openai_api_base = "http://localhost:8000/v1"
+
+TEMP = 0.15
+MAX_TOK = 262144
+
+client = OpenAI(
+    api_key=openai_api_key,
+    base_url=openai_api_base,
+)
+
+models = client.models.list()
+model = models.data[0].id
+
+
+def load_system_prompt(repo_id: str, filename: str) -> str:
+    file_path = hf_hub_download(repo_id=repo_id, filename=filename)
+    with open(file_path, "r") as file:
+        system_prompt = file.read()
+    return system_prompt
+
+
+SYSTEM_PROMPT = load_system_prompt(model, "SYSTEM_PROMPT.txt")
+
+messages = [
+    {"role": "system", "content": SYSTEM_PROMPT},
+    {
+        "role": "user",
+        "content": "Write me a sentence where every word starts with the next letter in the alphabet - start with 'a' and end with 'z'.",
+    },
+]
+
+response = client.chat.completions.create(
+    model=model,
+    messages=messages,
+    temperature=TEMP,
+    max_tokens=MAX_TOK,
+)
+
+assistant_message = response.choices[0].message.content
+print(assistant_message)
+```
+
+</details>
+
+## License
+
+This model is licensed under the [Apache 2.0 License](https://www.apache.org/licenses/LICENSE-2.0.txt).
+
+*You must not use this model in a manner that infringes, misappropriates, or otherwise violates any third party’s rights, including intellectual property rights.*

consolidated-00001-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:45bb281671a3022404fe8418853526244e5b474d0163f12c069a426f6590de12
+size 4998260600

consolidated-00026-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f3461b8fb74fc3e9a8330d95f72781d825a997a4d63a0ccfd162a6b706418d10
+size 4991230984

consolidated-00039-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:82a885654b0e883536da58efe83f777ad68039bfff7a6c789af4d6ed26ac4859
+size 4991231056

consolidated-00049-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e2cbfbe2636e6c79f162d8bc4c1fbce78930d524cde57e75738939e91093d1e4
+size 4991231008

consolidated-00055-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b3585c918b65ac837e531ad2cbcdd7439831b9f9f68a43a9c0121e2bf30cfd62
+size 4991230984

consolidated-00060-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:801acc32e87b38aac7d33f220cf7d5f516340c13c9187654fc918868b7a55a9e
+size 4991230984

consolidated-00063-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e8a708211d870050f147839444670e7eb201562dd2edba994b233f98e4b9ae40
+size 4991231008

consolidated-00065-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fe9fc37799958f048726a67417d775cc707491cd288a47adfa5b48fff2356e22
+size 4991230984

consolidated-00067-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:864bdbb30eccd5f16de465b06cc86a1d8d5f9ff29ec782f57c58e2050da8ccfb
+size 4991231064

consolidated-00070-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0cc49d71f8a94841e3588f84408c4a9854de7c1907244dbc9306ae787d802aee
+size 4991230984

consolidated-00071-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:db46e1e666edae0a56d4819f2ecf0b6e0fb14a647e22685b2f5668e1da7c18c4
+size 4956267904

consolidated-00073-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b04e9ba1cc78cdff353ad31d7c3bbfd9067d91bf557cc47cbb5223cfe8556d4f
+size 4991230984

consolidated-00074-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:24a2a56e68eeba5b7df92a905c887b5e6949b4f47c056b5d4771ab1a7b2086d2
+size 4991230984

consolidated-00085-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d1f6bb9ba5e8245bd582c30d322a28f80c342aad7c67622be10b1c071d747e5e
+size 4956267904

consolidated-00087-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:410bea1b852f7f9f54b97dd7116eaed86dcc5dc6392b7e4308b196988dc29b5d
+size 4991230984

consolidated-00088-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a51dbae2141b8461f3f7569304cc8f5e4649daab2a37365861bd79a3978e48a4
+size 4991230984

consolidated-00092-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b762f25569bc9b559ed6adf52af69758c8feddc6719e499bed888d9dcb94d8f3
+size 4991230984

consolidated-00093-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bad5c47dd59c9693867c9ff4a1688446011e11698175ae667f16c042e089ffc3
+size 4991230984

consolidated-00095-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:39876f982945ca39dc32fb667de480dfc949e4ba05c439302def967ebd9c8f62
+size 4991230960

consolidated-00104-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9ba5e4546672eaa212486c25cb0d7cb65f290cd5af668f45ab75c5eb2f146f8b
+size 4991231064

consolidated-00116-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:05ecdfe6c40132a4cf137087d977617696c053d3033cedb996eabca0a36c8b5f
+size 4991230984

consolidated-00120-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e912a0266c90f0664c9541ab9be48064bea6f8ce68f3e6bb096bad78781c2e4b
+size 4991230984

consolidated-00121-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a9984d5e37e7a61e62612194fd6fd6e73a39f3d23c00209fce66671f43a6ed46
+size 4991230984

consolidated-00124-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:234ff23d50be49b3a1b82900d8d94cb3343cff1249f800890ad7d14ad0671192
+size 4991230984

consolidated-00129-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2089049e913bf24382cfa4fa69635044b4b09623e506376eab1b3c6c94b0e2bf
+size 4991230984

consolidated-00130-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6dabff442b93fc22eb7f2638bda42781cb9abea0081c24848b241b7c5b7c701d
+size 4991230984

consolidated-00135-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:10ceac4d8d7d03ecadad8622f917fb38cad050effe681c758a1f9d9bf1b08377
+size 4991230984

consolidated-00138-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ef59ca3c783b6130df4f7b98d4ca627e8fd5f05d0b76296fba289809c9956831
+size 4991230984

consolidated-00142-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cef80bb51b1692a6a716a99b56d133e8b97b8df59dbc5b04ffa5efbbaf3f2ae5
+size 4991230992

consolidated-00143-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4e9151c0647c4dfeef79f36695d57f0c03e79d0bc7a5308186cffe047c39f4df
+size 4991230984

consolidated-00146-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:aef66297a86d9edda2b0a20f735219341e8b1baeec292b05cc0f1c2bae8a56d5
+size 4991230960

consolidated-00168-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4c810e458cd054654126255116534eaec62e926e459c86e0fc62e4c23788b84e
+size 4956267872

consolidated-00173-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0af5f8fb32487891d67fe710d7ea33c26cfedb45e19816070f3b55e613b95e8c
+size 4956267904

consolidated-00179-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:312a69eb22f4341647d231b369d2f61bad4d42f727002d7265370ae4ba19df02
+size 4991231000

consolidated-00183-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c99a69c024d96799bcbba281d8bd75da097a57c5c6d64b3cb67b9c6f63bfca09
+size 4991231056

consolidated-00185-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d29e565f1d3f5112febffc8e565436b3ebfc64b3169311caf16fcfc1783b8d8a
+size 4991230984

consolidated-00191-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7fe6de41da75a7ee4cc46fb144c91057030f659a75610aae3b7b2c450b609012
+size 4956267856

consolidated-00194-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8affc297d760af8a576e2565502082bd87801338e443c97ecb7f1b6baf336dd0
+size 4991230984

consolidated-00198-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f7fe3017dfbf92077f2e9ed09469909652a334ff5bcfab142bd383e85824f263
+size 4991230904

consolidated-00202-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:60888201e2d0b2491e354125c731ca9533657918e1aa632dd42ae7ddb6574af2
+size 4991231008

consolidated-00205-of-00272.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c265a514403d35a5d2dd762ec9df351d75ca251fb16df17c1d75c0b4d17a117c
+size 4956267864

params.json

@@ -0,0 +1,61 @@
+{
+  "dim": 7168,
+  "n_layers": 61,
+  "head_dim": 192,
+  "hidden_dim": 16384,
+  "n_heads": 128,
+  "n_kv_heads": 128,
+  "rope_theta": 10000.0,
+  "norm_eps": 1e-06,
+  "vocab_size": 131072,
+  "tied_embeddings": false,
+  "max_position_embeddings": 294912,
+  "max_seq_len": 262144,
+  "llama_4_scaling": {
+    "original_max_position_embeddings": 8192,
+    "beta": 0.1
+  },
+  "q_lora_rank": 1536,
+  "qk_rope_head_dim": 64,
+  "qk_nope_head_dim": 128,
+  "kv_lora_rank": 512,
+  "v_head_dim": 128,
+  "yarn": {
+    "original_max_position_embeddings": 8192,
+    "factor": 36,
+    "apply_scale": false,
+    "beta": 32,
+    "alpha": 1
+  },
+  "moe": {
+    "expert_parallel": 1,
+    "expert_model_parallel": 1,
+    "route_every_n": 1,
+    "first_k_dense_replace": 3,
+    "num_experts": 128,
+    "num_experts_per_tok": 4,
+    "num_expert_groups": 1,
+    "num_expert_groups_per_tok": 1,
+    "routed_scale": 1.0,
+    "expert_hidden_dim": 4096,
+    "num_shared_experts": 1
+  },
+  "vision_encoder": {
+    "image_token_id": 10,
+    "image_break_token_id": 12,
+    "image_end_token_id": 13,
+    "intermediate_size": 8192,
+    "num_hidden_layers": 48,
+    "num_attention_heads": 16,
+    "mm_projector_id": "patch_merge",
+    "spatial_merge_size": 2,
+    "hidden_size": 1664,
+    "num_channels": 3,
+    "image_size": 1540,
+    "max_image_size": 1540,
+    "patch_size": 14,
+    "rope_theta": 10000.0,
+    "add_pre_mm_projector_layer_norm": true,
+    "adapter_bias": false
+  }
+}

processor_config.json

@@ -0,0 +1,42 @@
+{
+  "image_break_token": "[IMG_BREAK]",
+  "image_end_token": "[IMG_END]",
+  "image_processor": {
+    "crop_size": null,
+    "data_format": "channels_first",
+    "device": null,
+    "disable_grouping": null,
+    "do_center_crop": null,
+    "do_convert_rgb": true,
+    "do_normalize": true,
+    "do_pad": null,
+    "do_rescale": true,
+    "do_resize": true,
+    "image_mean": [
+      0.48145466,
+      0.4578275,
+      0.40821073
+    ],
+    "image_processor_type": "PixtralImageProcessorFast",
+    "image_seq_length": null,
+    "image_std": [
+      0.26862954,
+      0.26130258,
+      0.27577711
+    ],
+    "input_data_format": null,
+    "pad_size": null,
+    "patch_size": 14,
+    "processor_class": "PixtralProcessor",
+    "resample": 3,
+    "rescale_factor": 0.00392156862745098,
+    "return_tensors": null,
+    "size": {
+      "longest_edge": 1540
+    }
+  },
+  "image_token": "[IMG]",
+  "patch_size": 14,
+  "processor_class": "PixtralProcessor",
+  "spatial_merge_size": 2
+}

tekken.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e29d19ea32eb7e26e6c0572d57cb7f9eca0f4420e0e0fe6ae1cf3be94da1c0d6
+size 16753777

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:577575622324b2e099e2648be26bdeb5e5815ffe66d7004e9e3ddbf421db6bf1
+size 17078110