estrogen
/

ModernBERG-base-uninit

Model card Files Files and versions Community

Fizzarolli commited on about 1 month ago

Commit

8f10a7a

·

verified ·

1 Parent(s): 7da89f9

Update modernberg_model.py

Files changed (1) hide show

modernberg_model.py +1 -0

modernberg_model.py CHANGED Viewed

@@ -413,6 +413,7 @@ class GriffinRecurrentblock(nn.Module):
         attention_mask: torch.Tensor,
         cache_position: torch.Tensor,
         use_cache: bool = True,
     ) -> Tuple[torch.Tensor, Dict[str, torch.Tensor]]:
         _, seq_len, _ = input_states.shape

         attention_mask: torch.Tensor,
         cache_position: torch.Tensor,
         use_cache: bool = True,
+        **kwargs
     ) -> Tuple[torch.Tensor, Dict[str, torch.Tensor]]:
         _, seq_len, _ = input_states.shape