Skip to content
@PKU-Alignment

PKU-Alignment

Loves Sharing and Open-Source, Making AI Safer.

PKU-Alignment Team

Large language models (LLMs) have immense potential in the field of general intelligence but come with significant risks. As a research team at Peking University, we actively focus on alignment techniques for LLMs, such as safety alignment, to enhance the model's safety and reduce toxicity.

Welcome to follow our AI Safety project:

Pinned Loading

  1. omnisafe omnisafe Public

    JMLR: OmniSafe is an infrastructural framework for accelerating SafeRL research.

    Python 927 132

  2. safety-gymnasium safety-gymnasium Public

    NeurIPS 2023: Safety-Gymnasium: A Unified Safe Reinforcement Learning Benchmark

    Python 387 52

  3. safe-rlhf safe-rlhf Public

    Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

    Python 1.3k 118

  4. Safe-Policy-Optimization Safe-Policy-Optimization Public

    NeurIPS 2023: Safe Policy Optimization: A benchmark repository for safe reinforcement learning algorithms

    Python 322 46

Repositories

Showing 10 of 14 repositories
  • ProgressGym Public

    Alignment with a millennium of moral progress.

    PKU-Alignment/ProgressGym’s past year of commit activity
    Python 10 MIT 2 0 0 Updated Oct 24, 2024
  • omnisafe Public

    JMLR: OmniSafe is an infrastructural framework for accelerating SafeRL research.

    PKU-Alignment/omnisafe’s past year of commit activity
    Python 927 Apache-2.0 132 8 3 Updated Oct 15, 2024
  • align-anything Public

    Align Anything: Training All-modality Model with Feedback

    PKU-Alignment/align-anything’s past year of commit activity
    Python 194 Apache-2.0 31 4 1 Updated Oct 11, 2024
  • safe-sora Public

    SafeSora is a human preference dataset designed to support safety alignment research in the text-to-video generation field, aiming to enhance the helpfulness and harmlessness of Large Vision Models (LVMs).

    PKU-Alignment/safe-sora’s past year of commit activity
    Python 24 5 1 0 Updated Aug 20, 2024
  • .github Public
    PKU-Alignment/.github’s past year of commit activity
    0 0 0 0 Updated Jul 15, 2024
  • safe-rlhf Public

    Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

    PKU-Alignment/safe-rlhf’s past year of commit activity
    Python 1,330 Apache-2.0 118 12 0 Updated Jun 13, 2024
  • llms-resist-alignment Public

    Repo for paper "Language Models Resist Alignment"

    PKU-Alignment/llms-resist-alignment’s past year of commit activity
    Python 3 0 0 0 Updated Jun 10, 2024
  • safety-gymnasium Public

    NeurIPS 2023: Safety-Gymnasium: A Unified Safe Reinforcement Learning Benchmark

    PKU-Alignment/safety-gymnasium’s past year of commit activity
    Python 387 Apache-2.0 52 3 0 Updated May 14, 2024
  • ProAgent Public

    ProAgent: Building Proactive Cooperative Agents with Large Language Models

    PKU-Alignment/ProAgent’s past year of commit activity
    JavaScript 56 MIT 5 1 0 Updated Apr 8, 2024
  • SafeDreamer Public

    ICLR 2024: SafeDreamer: Safe Reinforcement Learning with World Models

    PKU-Alignment/SafeDreamer’s past year of commit activity
    Python 43 Apache-2.0 6 1 0 Updated Apr 8, 2024

Top languages

Loading…

Most used topics

Loading…