Add model files

.gitattributes

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

Modelfile

@@ -0,0 +1,11 @@
+# ollama modelfile auto-generated by llamafactory
+
+FROM .
+
+TEMPLATE """{{ if .System }}System: {{ .System }}<|im_end|>
+{{ end }}{{ range .Messages }}{{ if eq .Role "user" }}Human: {{ .Content }}<|im_end|>
+Assistant:{{ else if eq .Role "assistant" }}{{ .Content }}<|im_end|>
+{{ end }}{{ end }}"""
+
+PARAMETER stop "<|im_end|>"
+PARAMETER num_ctx 4096

README.md

@@ -1,3 +1,176 @@
----
-license: apache-2.0
----
+---
+library_name: peft
+license: apache-2.0
+base_model: agentlans/Qwen2.5-1.5B-Instruct-drill
+tags:
+- llama-factory
+- generated_from_trainer
+model-index:
+- name: Qwen2.5-1.5B-Instruct-Keywords
+  results: []
+datasets:
+- agentlans/finewebedu-annotated
+language:
+- en
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# Qwen2.5-1.5B-Instruct-Keywords
+
+This model is a fine-tuned version of [agentlans/Qwen2.5-1.5B-Instruct-drill](https://huggingface.co/agentlans/Qwen2.5-1.5B-Instruct-drill) on the [agentlans/finewebedu-annotated](https://huggingface.co/datasets/agentlans/finewebedu-annotated) dataset.
+
+## Model description
+
+This model generates a list of keywords and key phrases from a piece of text in XML format. The most important keywords are at the front of the list.
+
+Input format:
+```text
+Keywords:
+{{YOUR_TEXT_HERE}}
+```
+
+Output format:
+```xml
+<list>
+<keyword>Keyword 1</keyword>
+<keyword>Keyword 2</keyword>
+...
+</list>
+```
+
+### Example
+
+<details>
+<summary>Click here for example input prompt</summary>
+
+[Source](https://www.gartner.com/en/articles/ai-agents)
+
+```
+Keywords:
+
+AI agents can help drive business model innovation
+
+Though generative AI (GenAI) has captured headlines with its meteoric rise to popularity, AI agents are quickly becoming the “next big thing.” By 2028, Gartner predicts that 33% of enterprise software applications will include agentic AI, up from less than 1% in 2024, with at least 15% of day-to-day work decisions being made autonomously through AI agents.
+
+But AI agents are also being piloted more strategically to innovate business models, in particular to autonomously address pain points in customer journeys and capitalize on emerging opportunities.
+Download the Top 10 Strategic Technology Trends for 2025
+Learn how AI agents and other tech trends align with your digital ambitions — and how to integrate them into your plans.
+Work Email
+
+By clicking the "Continue" button, you are agreeing to the Gartner Terms of Use and Privacy Policy.
+Think critically about integrating AI agents into the business strategy
+
+Digital leaders cannot afford to overlook the potential business opportunities created by AI agents. However, implementing this technology requires careful consideration of all the potential applications, risks and solutions.
+Innovate business models with customer journey mapping
+
+In a market with fierce competition and rapidly emerging technologies — each with their own risks and benefits — digital leaders are under constant pressure to adjust and adapt the business model.
+
+Business model innovation aims to discover new ways to meet customer needs, differentiate from competitors and increase efficiency and profitability by optimizing or transforming the existing business model.
+
+Organizations looking to innovate their business models should consider leveraging customer journey mapping. By addressing specific pain points along this journey, they can enhance the experience for customers, streamline operations and uncover new products, services or revenue streams. AI agents can be a key solution for organizations looking to mitigate customer pain points and capitalize on emerging opportunities.
+Identify business opportunities for AI-agent-powered innovation
+
+Digital leaders embarking on a journey to capitalize on AI agents should consider six key steps to identify and seize opportunities: 
+
+    Define your goals. Figure out what the organization needs to achieve with the business model innovation. 
+
+    Map the customer journey and touchpoints. Study how customers interact with the business. Map out their journey and identify key touchpoints.
+
+    Identify the pain points to uncover opportunities. At each touchpoint, flag pain points for improvements or increased efficiency. 
+
+    Explore solutions with AI agents. Think about what innovative solutions AI agents could offer to address those pain points and seize opportunities. 
+
+    Manage the change. Implementing new AI solutions means change. Strategize on the best way to manage this transition smoothly. 
+
+    Evaluate the outcomes. Assess the impact of the AI-agent-powered innovations. Track KPIs and evaluate how well these AI solutions are meeting initial goals. Refine the strategies based on this data. 
+
+Explore all the AI-agent solutions
+
+AI agents are not a one-size-fits-all solution and come in a variety of shapes and sizes. Organizations should carefully consider each AI-agent solution and select the technology that makes the most sense for their organization and application.
+
+    Types: There are six types of AI agents: reflex agents, goal-based agents, learning-based agents, utility-based agents, hierarchical agents and collaborative agents. Each type is suited to different scenarios and applications.
+
+    Applications: AI agents are ideal for a variety of situations that require automation, decision making and intelligent interaction with the environment. 
+
+    Interaction models: AI agents can function with different levels of human involvement, such as human-in-the-loop versus human-out-of-the-loop.
+
+    Multiagent systems: Multiple agents can address complex tasks that individual agents cannot, resulting in more adaptable, scalable and robust solutions.
+
+    Embedded AI techniques: AI agents use AI techniques to sense, navigate and adapt to their environment. Techniques include optimization, natural language processing, and knowledge representation.
+
+    Risks: These agents are designed to act autonomously and proactively within an environment, often learning and adapting as they operate.
+
+Implement LLM-based AI agents
+
+Organizations looking for AI agents that are focused on planning, reasoning and processing should consider those that use large language models (LLMs) to drive execution of tasks and processes. LLM-based AI agents can provide a useful and accessible alternative to more established types of AI agents.
+
+LLM-based AI agents use both programmed and prompted behaviors that require careful design, evaluation and monitoring to ensure the desired outcome. These agents should be built using a modular and composable approach to the software architecture.
+```
+</details>
+
+Output:
+```xml
+<list>
+<keyword>business model innovation</keyword>
+<keyword>AI agents</keyword>
+<keyword>genai</keyword>
+<keyword>customer journey mapping</keyword>
+<keyword>business model innovation</keyword>
+<keyword>customer pain points</keyword>
+<keyword>AI agent solutions</keyword>
+<keyword>LLM-based AI agents</keyword>
+<keyword>large language models</keyword>
+<keyword>business model innovation</keyword>
+<keyword>AI agent applications</keyword>
+<keyword>customer experience optimization</keyword>
+<keyword>business transformation</keyword>
+<keyword>AI agent interaction models</keyword>
+<keyword>AI agent types</keyword>
+<keyword>AI agent risks</keyword>
+<keyword>AI agent implementation</keyword>
+<keyword>AI agent evaluation</keyword>
+<keyword>AI agent optimization</keyword>
+<keyword>AI agent integration</keyword>
+</list>
+```
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 5e-05
+- train_batch_size: 2
+- eval_batch_size: 8
+- seed: 42
+- gradient_accumulation_steps: 8
+- total_train_batch_size: 16
+- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
+- lr_scheduler_type: cosine
+- num_epochs: 3.0
+
+### Training results
+
+
+
+### Framework versions
+
+- PEFT 0.15.0
+- Transformers 4.49.0
+- Pytorch 2.6.0+cu124
+- Datasets 3.4.1
+- Tokenizers 0.21.0

added_tokens.json

@@ -0,0 +1,24 @@
+{
+  "</tool_call>": 151658,
+  "<tool_call>": 151657,
+  "<|box_end|>": 151649,
+  "<|box_start|>": 151648,
+  "<|endoftext|>": 151643,
+  "<|file_sep|>": 151664,
+  "<|fim_middle|>": 151660,
+  "<|fim_pad|>": 151662,
+  "<|fim_prefix|>": 151659,
+  "<|fim_suffix|>": 151661,
+  "<|im_end|>": 151645,
+  "<|im_start|>": 151644,
+  "<|image_pad|>": 151655,
+  "<|object_ref_end|>": 151647,
+  "<|object_ref_start|>": 151646,
+  "<|quad_end|>": 151651,
+  "<|quad_start|>": 151650,
+  "<|repo_name|>": 151663,
+  "<|video_pad|>": 151656,
+  "<|vision_end|>": 151653,
+  "<|vision_pad|>": 151654,
+  "<|vision_start|>": 151652
+}

config.json

@@ -0,0 +1,29 @@
+{
+  "_name_or_path": "/drive2/Repo/Qwen2.5-1.5B-Instruct-drill",
+  "architectures": [
+    "Qwen2ForCausalLM"
+  ],
+  "attention_dropout": 0.0,
+  "bos_token_id": 151643,
+  "eos_token_id": 151645,
+  "hidden_act": "silu",
+  "hidden_size": 1536,
+  "initializer_range": 0.02,
+  "intermediate_size": 8960,
+  "max_position_embeddings": 32768,
+  "max_window_layers": 21,
+  "model_type": "qwen2",
+  "num_attention_heads": 12,
+  "num_hidden_layers": 28,
+  "num_key_value_heads": 2,
+  "rms_norm_eps": 1e-06,
+  "rope_scaling": null,
+  "rope_theta": 1000000.0,
+  "sliding_window": 32768,
+  "tie_word_embeddings": true,
+  "torch_dtype": "bfloat16",
+  "transformers_version": "4.49.0",
+  "use_cache": true,
+  "use_sliding_window": false,
+  "vocab_size": 151936
+}

generation_config.json

@@ -0,0 +1,14 @@
+{
+  "bos_token_id": 151643,
+  "do_sample": true,
+  "eos_token_id": [
+    151645,
+    151643
+  ],
+  "pad_token_id": 151643,
+  "repetition_penalty": 1.1,
+  "temperature": 0.7,
+  "top_k": 20,
+  "top_p": 0.8,
+  "transformers_version": "4.49.0"
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3178aa4816acc486905db8acbfe53ea80650a28f7cbd57d59425654d9f92069f
+size 3087467144

special_tokens_map.json

@@ -0,0 +1,31 @@
+{
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>",
+    "<|object_ref_start|>",
+    "<|object_ref_end|>",
+    "<|box_start|>",
+    "<|box_end|>",
+    "<|quad_start|>",
+    "<|quad_end|>",
+    "<|vision_start|>",
+    "<|vision_end|>",
+    "<|vision_pad|>",
+    "<|image_pad|>",
+    "<|video_pad|>"
+  ],
+  "eos_token": {
+    "content": "<|im_end|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9c5ae00e602b8860cbd784ba82a8aa14e8feecec692e7076590d014d7b7fdafa
+size 11421896

tokenizer_config.json

@@ -0,0 +1,209 @@
+{
+  "add_bos_token": false,
+  "add_prefix_space": false,
+  "added_tokens_decoder": {
+    "151643": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151644": {
+      "content": "<|im_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151645": {
+      "content": "<|im_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151646": {
+      "content": "<|object_ref_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151647": {
+      "content": "<|object_ref_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151648": {
+      "content": "<|box_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151649": {
+      "content": "<|box_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151650": {
+      "content": "<|quad_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151651": {
+      "content": "<|quad_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151652": {
+      "content": "<|vision_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151653": {
+      "content": "<|vision_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151654": {
+      "content": "<|vision_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151655": {
+      "content": "<|image_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151656": {
+      "content": "<|video_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151657": {
+      "content": "<tool_call>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151658": {
+      "content": "</tool_call>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151659": {
+      "content": "<|fim_prefix|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151660": {
+      "content": "<|fim_middle|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151661": {
+      "content": "<|fim_suffix|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151662": {
+      "content": "<|fim_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151663": {
+      "content": "<|repo_name|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151664": {
+      "content": "<|file_sep|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    }
+  },
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>",
+    "<|object_ref_start|>",
+    "<|object_ref_end|>",
+    "<|box_start|>",
+    "<|box_end|>",
+    "<|quad_start|>",
+    "<|quad_end|>",
+    "<|vision_start|>",
+    "<|vision_end|>",
+    "<|vision_pad|>",
+    "<|image_pad|>",
+    "<|video_pad|>"
+  ],
+  "bos_token": null,
+  "chat_template": "{% if messages[0]['role'] == 'system' %}{% set loop_messages = messages[1:] %}{% set system_message = messages[0]['content'] %}{% else %}{% set loop_messages = messages %}{% endif %}{% if system_message is defined %}{{ 'System: ' + system_message + '<|im_end|>' + '\n' }}{% endif %}{% for message in loop_messages %}{% set content = message['content'] %}{% if message['role'] == 'user' %}{{ 'Human: ' + content + '<|im_end|>' + '\nAssistant:' }}{% elif message['role'] == 'assistant' %}{{ content + '<|im_end|>' + '\n' }}{% endif %}{% endfor %}",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|im_end|>",
+  "errors": "replace",
+  "extra_special_tokens": {},
+  "model_max_length": 131072,
+  "pad_token": "<|endoftext|>",
+  "padding_side": "left",
+  "split_special_tokens": false,
+  "tokenizer_class": "Qwen2Tokenizer",
+  "unk_token": null
+}