Files changed (1) hide show
  1. README.md +87 -3
README.md CHANGED
@@ -1,3 +1,87 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ license: other
5
+ license_name: pixelscribe-non-commercial-license
6
+ license_link: LICENSE.md
7
+ tags:
8
+ - text-to-image
9
+ - image-generation
10
+ - Diffusers
11
+ - PixelScribe
12
+ base_model:
13
+ - sbapan41/PixelScribe
14
+ new_version: sbapan41/PixelScribe
15
+ pipeline_tag: text-to-image
16
+ library_name: diffusers
17
+ ---
18
+
19
+ ![PixelScribe Grid](./PixelScribe.jpg)
20
+
21
+ `PixelScribe` is a 12 billion parameter rectified flow transformer capable of generating images from text descriptions.
22
+
23
+ # Key Features
24
+ 1. Cutting-edge output quality, second only to our state-of-the-art model `PixelScribe`.
25
+ 2. Competitive prompt following, matching the performance of closed source alternatives .
26
+ 3. Trained using guidance distillation, making `PixelScribe` more efficient.
27
+ 4. Open weights to drive new scientific research, and empower artists to develop innovative workflows.
28
+ 5. Generated outputs can be used for personal, scientific, and commercial purposes as described
29
+
30
+ # Usage
31
+ We provide a reference implementation of `PixelScribe`, as well as sampling code, in a dedicated [github repository](https://github.com/MotoBwi/PixelScribe.git).
32
+ Developers and creatives looking to build on top of `PixelScribe` are encouraged to use this as a starting point.
33
+
34
+
35
+ ## Diffusers
36
+
37
+ To use `PixelScribe` with the 🧨 diffusers python library, first install or upgrade diffusers
38
+
39
+ ```shell
40
+ pip install -U diffusers
41
+ ```
42
+
43
+ Then you can use `FluxPipeline` to run the model
44
+
45
+ ```python
46
+ import torch
47
+ from diffusers import FluxPipeline
48
+
49
+ pipe = FluxPipeline.from_pretrained("sbapan41/PixelScribe", torch_dtype=torch.bfloat16)
50
+ pipe.enable_model_cpu_offload() #save some VRAM by offloading the model to CPU. Remove this if you have enough GPU power
51
+
52
+ prompt = "A cat holding a sign that says hello world"
53
+ image = pipe(
54
+ prompt,
55
+ height=1024,
56
+ width=1024,
57
+ guidance_scale=3.5,
58
+ num_inference_steps=50,
59
+ max_sequence_length=512,
60
+ generator=torch.Generator("cpu").manual_seed(0)
61
+ ).images[0]
62
+ image.save("PixelScribe.png")
63
+ ```
64
+
65
+
66
+
67
+ ---
68
+ # Limitations
69
+ - This model is not intended or able to provide factual information.
70
+ - As a statistical model this checkpoint might amplify existing societal biases.
71
+ - The model may fail to generate output that matches the prompts.
72
+ - Prompt following is heavily influenced by the prompting-style.
73
+
74
+ # Out-of-Scope Use
75
+ The model and its derivatives may not be used
76
+
77
+ - In any way that violates any applicable national, federal, state, local or international law or regulation.
78
+ - For the purpose of exploiting, harming or attempting to exploit or harm minors in any way; including but not limited to the solicitation, creation, acquisition, or dissemination of child exploitative content.
79
+ - To generate or disseminate verifiably false information and/or content with the purpose of harming others.
80
+ - To generate or disseminate personal identifiable information that can be used to harm an individual.
81
+ - To harass, abuse, threaten, stalk, or bully individuals or groups of individuals.
82
+ - To create non-consensual nudity or illegal pornographic content.
83
+ - For fully automated decision making that adversely impacts an individual's legal rights or otherwise creates or modifies a binding, enforceable obligation.
84
+ - Generating or facilitating large-scale disinformation campaigns.
85
+
86
+ # License
87
+ This model falls under the [`PixelScribe` Non-Commercial License].