Hugging Face's logo

mrs83
/
FlowerTune-phi-4-NLP-PEFT

Text Generation
PEFT
Safetensors
English
Model card Files Community
FlowerTune-phi-4-NLP-PEFT / README.md
mrs83's picture
mrs83
Update README.md
bd81b92 verified
preview code
|
raw
history blame
1.22 kB
metadata
base_model: microsoft/phi-4
library_name: peft
license: apache-2.0
datasets:
  - vicgalle/alpaca-gpt4
language:
  - en
pipeline_tag: text-generation

⚠️ Work in progress!

Model Card for FlowerTune-phi-4-NLP-PEFT

This PEFT adapter has been trained by using Flower, a friendly federated AI framework.

The adapter and benchmark results have been submitted to the FlowerTune LLM NLP Leaderboard.

Model Details

Please check the following GitHub project for model details and evaluation results:

https://github.com/mrs83/FlowerTune-phi-4-NLP

How to Get Started with the Model

Use this model as:

from peft import PeftModel
from transformers import AutoModelForCausalLM

base_model = AutoModelForCausalLM.from_pretrained("mrs83/FlowerTune-phi-4-NLP-PEFT")
model = PeftModel.from_pretrained(base_model, "mrs83/FlowerTune-phi-4-NLP-PEFT")

Evaluation Results (Accuracy)

  • STEM: 32.31 %
  • Social Sciences: 67 %
  • Humanities: WIP
  • Average: WIP

Communication Budget

45804.69 Megabytes

Framework versions

  • PEFT 0.14.0
  • Flower 1.13.0