Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add video support #430

Draft
wants to merge 28 commits into
base: main
Choose a base branch
from
Draft

Add video support #430

wants to merge 28 commits into from
+730 −23

Commits on Feb 15, 2023

  1. Add video support

    @iejMac
    iejMac committed Feb 15, 2023
    Configuration menu
    Copy the full SHA
    3ec0ed8 View commit details
    Browse the repository at this point in the history

Commits on Feb 16, 2023

  1. Merge branch 'main' into vivit

    @iejMac
    iejMac authored Feb 16, 2023
    Configuration menu
    Copy the full SHA
    0403d1d View commit details
    Browse the repository at this point in the history

Commits on Feb 18, 2023

  1. data loading: correct shapes in training loop (crappy code)

    @iejMac
    iejMac committed Feb 18, 2023
    Configuration menu
    Copy the full SHA
    1cd33e4 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'vivit' of https://github.com/iejMac/open_clip into vivit

    @iejMac
    iejMac committed Feb 18, 2023
    Configuration menu
    Copy the full SHA
    107292f View commit details
    Browse the repository at this point in the history

  3. update model progress

    @iejMac
    iejMac committed Feb 18, 2023
    Configuration menu
    Copy the full SHA
    b995750 View commit details
    Browse the repository at this point in the history

Commits on Feb 19, 2023

  1. rename file + create_model loads something

    @iejMac
    iejMac committed Feb 19, 2023
    Configuration menu
    Copy the full SHA
    be04c06 View commit details
    Browse the repository at this point in the history

  2. update

    @iejMac
    iejMac committed Feb 19, 2023
    Configuration menu
    Copy the full SHA
    0ad7168 View commit details
    Browse the repository at this point in the history

  3. update

    @iejMac
    iejMac committed Feb 19, 2023
    Configuration menu
    Copy the full SHA
    f9dfd02 View commit details
    Browse the repository at this point in the history

  4. embeddings get to loss, time to implement video encoding

    @iejMac
    iejMac committed Feb 19, 2023
    Configuration menu
    Copy the full SHA
    df1c698 View commit details
    Browse the repository at this point in the history

  5. update, set num_samples

    @iejMac
    iejMac committed Feb 19, 2023
    Configuration menu
    Copy the full SHA
    7643ce3 View commit details
    Browse the repository at this point in the history

  6. more filling in

    @iejMac
    iejMac committed Feb 19, 2023
    Configuration menu
    Copy the full SHA
    cb12acd View commit details
    Browse the repository at this point in the history

  7. slightly improved preprocessing

    @iejMac
    iejMac committed Feb 19, 2023
    Configuration menu
    Copy the full SHA
    67a2d33 View commit details
    Browse the repository at this point in the history

  8. update

    @iejMac
    iejMac committed Feb 19, 2023
    Configuration menu
    Copy the full SHA
    f0615f9 View commit details
    Browse the repository at this point in the history

  9. update weird lag

    @iejMac
    iejMac committed Feb 19, 2023
    Configuration menu
    Copy the full SHA
    7bd848e View commit details
    Browse the repository at this point in the history

Commits on Feb 20, 2023

  1. simpler dataloader same results

    @iejMac
    iejMac committed Feb 20, 2023
    Configuration menu
    Copy the full SHA
    80f41a0 View commit details
    Browse the repository at this point in the history

Commits on Feb 21, 2023

  1. properly normalize frames

    @iejMac
    iejMac committed Feb 21, 2023
    Configuration menu
    Copy the full SHA
    f5af600 View commit details
    Browse the repository at this point in the history

  2. update no temporal

    @iejMac
    iejMac committed Feb 21, 2023
    Configuration menu
    Copy the full SHA
    982ee88 View commit details
    Browse the repository at this point in the history

Commits on Feb 26, 2023

  1. filter no mp4 samples

    @iejMac
    iejMac committed Feb 26, 2023
    Configuration menu
    Copy the full SHA
    3f4fde7 View commit details
    Browse the repository at this point in the history

  2. update

    @iejMac
    iejMac committed Feb 26, 2023
    Configuration menu
    Copy the full SHA
    7176d95 View commit details
    Browse the repository at this point in the history

  3. adding projection removes weird const loss bug but training doesn't g… 

    …o very well
    @iejMac
    iejMac committed Feb 26, 2023
    Configuration menu
    Copy the full SHA
    3f64b62 View commit details
    Browse the repository at this point in the history

Commits on Feb 27, 2023

  1. some updates

    @iejMac
    iejMac committed Feb 27, 2023
    Configuration menu
    Copy the full SHA
    8d3cc48 View commit details
    Browse the repository at this point in the history

Commits on Mar 11, 2023

  1. save changes

    @iejMac
    iejMac committed Mar 11, 2023
    Configuration menu
    Copy the full SHA
    4230428 View commit details
    Browse the repository at this point in the history

Commits on Mar 26, 2023

  1. update dataloader to use video2dataset

    @iejMac
    iejMac committed Mar 26, 2023
    Configuration menu
    Copy the full SHA
    9413c5e View commit details
    Browse the repository at this point in the history

Commits on Mar 27, 2023

  1. update

    @iejMac
    iejMac committed Mar 27, 2023
    Configuration menu
    Copy the full SHA
    5c65a52 View commit details
    Browse the repository at this point in the history

Commits on Mar 28, 2023

  1. repeat is bad

    @iejMac
    iejMac committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    f2fa5bd View commit details
    Browse the repository at this point in the history

Commits on Apr 4, 2023

  1. enable loading CLIP weights to spatial and text encoders

    @iejMac
    iejMac committed Apr 4, 2023
    Configuration menu
    Copy the full SHA
    3125171 View commit details
    Browse the repository at this point in the history

Commits on Apr 15, 2023

  1. update

    @iejMac
    iejMac committed Apr 15, 2023
    Configuration menu
    Copy the full SHA
    b093a4c View commit details
    Browse the repository at this point in the history

Commits on Jun 9, 2023

  1. update

    iejmac committed Jun 9, 2023
    Configuration menu
    Copy the full SHA
    9db7425 View commit details
    Browse the repository at this point in the history