Distinguished In Uniform: Self Attention Vs. Virtual Nodes (https://arxiv.org/abs/2405.11951)

Based on the GPS codebase: https://github.com/rampasek/GraphGPS

Python environment setup with Conda

conda create -n graphgps python=3.10
conda activate graphgps

conda install pytorch torchvision torchaudio pytorch-cuda=11.7 -c pytorch -c nvidia
pip install torch_geometric==2.3.0
pip install pyg_lib torch_scatter torch_sparse torch_cluster torch_spline_conv -f https://data.pyg.org/whl/torch-2.0.0+cu117.html

# RDKit is required for OGB-LSC PCQM4Mv2 and datasets derived from it.  
conda install openbabel fsspec rdkit -c conda-forge

pip install pytorch-lightning yacs torchmetrics
pip install performer-pytorch
pip install tensorboardX
pip install ogb
pip install wandb

conda clean --all

Run Experiments on Synthetic Data

conda activate graphgps
bash experiment_cor44.sh
bash experiment_cor49.sh