Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
danieldk 
posted an update 28 days ago
Post
1964
kernels 0.8.0 is out: https://github.com/huggingface/kernels/releases/tag/v0.8.0

This release refines kernel selection in the kernelize function:

• You can now register kernels for certain CUDA capability ranges.
• Rather than doing exact mating of modes, fall back to other compatible modes. If you are kernelizing for inference, but you only registered a training + torch.compile kernel, it will use that kernel since it is compatible with inference as well.

I am replying here because I haven't figured out how to create my own post yet. I have a question, what can be done about the problem of models hallucinating?