ImportError: /lib64/libc.so.6: version `GLIBC_2.32' not found
Hello,
I'm encountering a GLIBC compatibility issue when trying to use vLLM with flash-attention on a cluster system. The error occurs when attempting to import vLLM components that depend on CUDA extensions.
Error Message
ImportError: /lib64/libc.so.6: version GLIBC_2.32' not found
Environment:
GLIBC version: 2.28
Python: 3.12.8
PyTorch: 2.9.0.dev20250804+cu128
CUDA: 12.8
Would it be possible to work around this issue by modifying or rebuilding the dependencies to match the existing GLIBC version?
same issue. Are you using Ubuntu 20.04?
Please check my solution in the next post!
I solved this issue by installing the glibc-2.32 and glibc-2.38 (since it also requires glibc-2.34).
NOTE: my path is /projectnb/vkolagrp/brucejia. Please change it to yours.
For glibc-2.32:
wget -c https://ftp.gnu.org/gnu/glibc/glibc-2.32.tar.gz
tar -zxvf glibc-2.32.tar.gz
cd glibc-2.32
mkdir glibc-build && cd glibc-build
mkdir /projectnb/vkolagrp/brucejia/glibc
../configure --prefix=/projectnb/vkolagrp/brucejia/glibc
make -j"$(nproc)"
make install
For glibc-2.38:
export GLIBC_NEW=/projectnb/vkolagrp/brucejia/glibc-2.38
export SRC=/projectnb/vkolagrp/brucejia/src
mkdir -p "$SRC" && cd "$SRC"
wget -c https://ftp.gnu.org/gnu/glibc/glibc-2.38.tar.xz
tar -xf glibc-2.38.tar.xz
mkdir -p glibc-2.38-build && cd glibc-2.38-build
../glibc-2.38/configure --prefix="$GLIBC_NEW" --disable-werror
make -j"$(nproc)"
make install
Then, load the vllm using commands like these. Please change my path to your own path.
export GLIBC_NEW=/projectnb/vkolagrp/brucejia/glibc-2.38
export CONDA=/projectnb/vkolagrp/brucejia/.conda/envs/new
export GCC_LIBDIR="$(dirname "$(gcc -print-file-name=libstdc++.so.6)")"
export LD_LIBRARY_PATH="$GLIBC_NEW/lib:$CONDA/lib:$GCC_LIBDIR:${CUDA_HOME:+$CUDA_HOME/lib64}:$LD_LIBRARY_PATH"
$GLIBC_NEW/lib/ld-linux-x86-64.so.2 \
--library-path "$GLIBC_NEW/lib:$CONDA/lib:$GCC_LIBDIR:${CUDA_HOME:+$CUDA_HOME/lib64}:$LD_LIBRARY_PATH" \
"$CONDA/bin/python" -m vllm.entrypoints.cli.main serve openai/gpt-oss-20b
Best regards,
Shuyue
Aug 10th, 2025