Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Provide Memory Benchmarking Feature to Benchmarking Code #14

Merged
merged 19 commits into from
May 27, 2024
Merged

Provide Memory Benchmarking Feature to Benchmarking Code #14

merged 19 commits into from
May 27, 2024

Commits on May 20, 2024

  1. add gpu memory logging support

    @achew010
    achew010 committed May 20, 2024
    Configuration menu
    Copy the full SHA
    9589ee3 View commit details
    Browse the repository at this point in the history

  2. made improvements to GPU reference and result collation

    @achew010
    achew010 committed May 20, 2024
    Configuration menu
    Copy the full SHA
    680c5f7 View commit details
    Browse the repository at this point in the history

  3. Renamed memory logging argument to reflect its readings as reserved me 

    mory using nvidia-smi and changed aggregation function in result collation
    @achew010
    achew010 committed May 20, 2024
    Configuration menu
    Copy the full SHA
    a0aa069 View commit details
    Browse the repository at this point in the history

Commits on May 21, 2024

  1. variable renames

    @achew010
    achew010 committed May 21, 2024
    Configuration menu
    Copy the full SHA
    7054aa6 View commit details
    Browse the repository at this point in the history

  2. manual linting

    @achew010
    achew010 committed May 21, 2024
    Configuration menu
    Copy the full SHA
    b3ff020 View commit details
    Browse the repository at this point in the history

  3. added memory logging functionality via HFTrainer

    @achew010
    achew010 committed May 21, 2024
    Configuration menu
    Copy the full SHA
    97352b1 View commit details
    Browse the repository at this point in the history

  4. added support to benchmark memory using HFTrainer and updated READMEw… 

    …ith explanation of the 2 memory benchmarking options
    @achew010
    achew010 committed May 21, 2024
    Configuration menu
    Copy the full SHA
    44e6100 View commit details
    Browse the repository at this point in the history

  5. addressed changes requested in PR foundation-model-stack#14

    @achew010
    achew010 committed May 21, 2024
    Configuration menu
    Copy the full SHA
    1baf6aa View commit details
    Browse the repository at this point in the history

  6. fix bug and smplify gpu logs aggregation logic

    @achew010
    achew010 committed May 21, 2024
    Configuration menu
    Copy the full SHA
    56db51d View commit details
    Browse the repository at this point in the history

Commits on May 23, 2024

  1. fixes to calculation of HFTrainer Mem Logging values

    @achew010
    achew010 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    4ba9b93 View commit details
    Browse the repository at this point in the history

  2. fix calculations

    @achew010
    achew010 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    20d872e View commit details
    Browse the repository at this point in the history

  3. more fixes

    @achew010
    achew010 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    381a191 View commit details
    Browse the repository at this point in the history

Commits on May 24, 2024

  1. fix to ignore including stage inside max calculation of alloc memory

    @achew010
    achew010 committed May 24, 2024
    Configuration menu
    Copy the full SHA
    b3e8c56 View commit details
    Browse the repository at this point in the history

  2. more comments and README updates

    @achew010
    achew010 committed May 24, 2024
    Configuration menu
    Copy the full SHA
    b6f7519 View commit details
    Browse the repository at this point in the history

  3. added fix to keyerror due to empty output dict from OOM

    @achew010
    achew010 committed May 24, 2024
    Configuration menu
    Copy the full SHA
    2ee8902 View commit details
    Browse the repository at this point in the history

  4. manual linting

    @achew010
    achew010 committed May 24, 2024
    Configuration menu
    Copy the full SHA
    4b92b5d View commit details
    Browse the repository at this point in the history

  5. added benchmark results to refs

    @achew010
    achew010 committed May 24, 2024
    Configuration menu
    Copy the full SHA
    f39d03c View commit details
    Browse the repository at this point in the history

Commits on May 27, 2024

  1. remove unnecessary columns in results gathering

    @achew010
    achew010 committed May 27, 2024
    Configuration menu
    Copy the full SHA
    04702cc View commit details
    Browse the repository at this point in the history

  2. made changes to results gathering

    @achew010
    achew010 committed May 27, 2024
    Configuration menu
    Copy the full SHA
    5de954f View commit details
    Browse the repository at this point in the history