Skip to content

atlarge-research/2026-llm-cxl-bench

Repository files navigation

cxl-llm

Microbenchmarks

Setup

Install Intel MLC:

Please refer to the offical document.

Install MSR tools:

sudo apt install msr-tools
sudo modprobe msr

Then the msr registers can be read/write with:

# read
sudo rdmsr -p [core-id] [msr address]
# write
sudo wrmsr -p [core-id] [msr address] [value]

Note:

Install AMD uPerf

Please refer to the offical document.

Prepare CUDA environments

Please refer to the offical document.

Memory Baseline Performance

First disble hardware prefetcher manually

Set up huge pages

Idle latency

# Disable hardware prefetcher before running
sudo ../utils/disable-prefetcher.sh
# run the experiments
python3 micro-idle-lat.py --run --plot > micro-idle-lat.log

Read bandwidth

# Disable hardware prefetcher before running
sudo ../utils/disable-prefetcher.sh
# run the experiments
python3 micro-bw-matrix.py --run --plot > micro-bw-matrix.log

Bandwidth

Loaded bandwidth

CPU-GPU Transfer Performance

Case Study: Model Loading

sudo apt install git-lfs
git lfs install
git clone https://huggingface.co/tiiuae/falcon-7b

TODO

Add install psutil for python

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors