Is there any native settings to extend the context window to 8k?

#19

by sihanzeng233 - opened Sep 16

Sep 16

Hi, thanks for releasing the embedding model! Wondering if there's any native settings that can extend the context window from 2k to larger than 8k?

BalakrishnaCh

Google org Sep 17

Hi @sihanzeng233 ,

Welcome to Google's Gemma family of open source models, thanks for reaching out to us. The google/embeddinggemma-300m model is having context widow size of 2048 that's the max positional embedding (max_position_embeddings) settings provided to this model. Please refer the config.json file from the file sections to know more about this model settings.

Thanks.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment