John2121's picture
please setup hugging face variables and appropriate secrets for me to add to the settings after you launch it for using open ai comptable lllama api link like this:import os from openai import OpenAI client = OpenAI( api_key=os.environ["LLAMA_API_KEY"], base_url="https://api.llama.com/compat/v1/" ) # Create chat completion request completion = client.chat.completions.create( model="Llama-3.3-8B-Instruct", messages=[ { "role": "developer", "content": "You are a helpful assistant." }, { "role": "user", "content": "Hello!" } ], ) print(completion.choices[0].message.content) - Follow Up Deployment
73015a9 verified