Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Postgres replication #392

Merged
merged 44 commits into from
May 2, 2024
Merged

Postgres replication #392

merged 44 commits into from
May 2, 2024

Commits on Feb 25, 2024

  1. WIP

    Jorrit Sandbrink committed Feb 25, 2024
    Configuration menu
    Copy the full SHA
    cb58fbc View commit details
    Browse the repository at this point in the history

Commits on Mar 3, 2024

  1. WIP

    Jorrit Sandbrink committed Mar 3, 2024
    Configuration menu
    Copy the full SHA
    d218a3a View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of https://github.com/dlt-hub/verified-sources … 

    …into 933-wip
    Jorrit Sandbrink committed Mar 3, 2024
    Configuration menu
    Copy the full SHA
    945da6d View commit details
    Browse the repository at this point in the history

Commits on Mar 4, 2024

  1. move config to correct position

    Jorrit Sandbrink committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    fa9a4c1 View commit details
    Browse the repository at this point in the history

Commits on Mar 12, 2024

  1. extend SQLAlchemy type mapping

    Jorrit Sandbrink committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    4cdf823 View commit details
    Browse the repository at this point in the history

  2. add initial support for postgres replication

    Jorrit Sandbrink committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    8808812 View commit details
    Browse the repository at this point in the history

  3. add credentials instruction

    Jorrit Sandbrink committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    1914acf View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' of https://github.com/dlt-hub/verified-sources … 

    …into 933-postgres-replication
    Jorrit Sandbrink committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    36739ec View commit details
    Browse the repository at this point in the history

  5. undo adding secret

    Jorrit Sandbrink committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    cc6a11d View commit details
    Browse the repository at this point in the history

  6. add module docstring

    Jorrit Sandbrink committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    f815361 View commit details
    Browse the repository at this point in the history

Commits on Mar 13, 2024

  1. use from import to prevent AttributeError when running test_dlt_init.py

    Jorrit Sandbrink committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    a318fee View commit details
    Browse the repository at this point in the history

Commits on Mar 15, 2024

  1. enable multiple tables per publication

    Jorrit Sandbrink committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    8aed399 View commit details
    Browse the repository at this point in the history

Commits on Mar 16, 2024

  1. add support for schema replication

    Jorrit Sandbrink committed Mar 16, 2024
    Configuration menu
    Copy the full SHA
    9fc3c39 View commit details
    Browse the repository at this point in the history

  2. add support for unmapped data types

    Jorrit Sandbrink committed Mar 16, 2024
    Configuration menu
    Copy the full SHA
    8c2f905 View commit details
    Browse the repository at this point in the history

Commits on Mar 17, 2024

  1. add test for init_replication

    Jorrit Sandbrink committed Mar 17, 2024
    Configuration menu
    Copy the full SHA
    a0af605 View commit details
    Browse the repository at this point in the history

  2. update docstrings

    Jorrit Sandbrink committed Mar 17, 2024
    Configuration menu
    Copy the full SHA
    051830c View commit details
    Browse the repository at this point in the history

  3. return resource instead of single-element list

    Jorrit Sandbrink committed Mar 17, 2024
    Configuration menu
    Copy the full SHA
    656989a View commit details
    Browse the repository at this point in the history

Commits on Mar 18, 2024

  1. add example pipeline

    Jorrit Sandbrink committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    d014645 View commit details
    Browse the repository at this point in the history

  2. add more example pipelines

    Jorrit Sandbrink committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    269422e View commit details
    Browse the repository at this point in the history

  3. add nullability hints

    Jorrit Sandbrink committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    c674f24 View commit details
    Browse the repository at this point in the history

  4. add README

    Jorrit Sandbrink committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    a919c82 View commit details
    Browse the repository at this point in the history

Commits on Mar 19, 2024

  1. add sql_database dependency instruction

    Jorrit Sandbrink committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    57b5e1e View commit details
    Browse the repository at this point in the history

Commits on Mar 22, 2024

  1. batch data items per table and yield hints only once

    Jorrit Sandbrink committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    5636e07 View commit details
    Browse the repository at this point in the history

  2. postpone replication column hints to preserve order

    Jorrit Sandbrink committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    2713464 View commit details
    Browse the repository at this point in the history

  3. refactor to use resource decorator

    Jorrit Sandbrink committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    eec75f0 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' of https://github.com/dlt-hub/verified-sources … 

    …into 933-postgres-replication
    Jorrit Sandbrink committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    aae3754 View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2024

  1. add support for table schema changes

    Jorrit Sandbrink committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    493147d View commit details
    Browse the repository at this point in the history

Commits on Mar 25, 2024

  1. optimize message type detection for performance

    Jorrit Sandbrink committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    7bd211b View commit details
    Browse the repository at this point in the history

Commits on Apr 9, 2024

  1. upgrade dlt to 0.4.8

    Jorrit Sandbrink committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    48442ba View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of https://github.com/dlt-hub/verified-sources … 

    …into 933-postgres-replication
    Jorrit Sandbrink committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    d303efd View commit details
    Browse the repository at this point in the history

Commits on Apr 14, 2024

  1. enables to run tests in parallel

    @rudolfix
    rudolfix committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    524945f View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into 933-postgres-replication

    @rudolfix
    rudolfix committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    ab005a1 View commit details
    Browse the repository at this point in the history

  3. fixes format

    @rudolfix
    rudolfix committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    c596180 View commit details
    Browse the repository at this point in the history

Commits on Apr 15, 2024

  1. make test more specific to handle postgres version differences

    Jorrit Sandbrink committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    34610b6 View commit details
    Browse the repository at this point in the history

  2. add postgres server version requirement for schema replication functi… 

    …onality
    Jorrit Sandbrink committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    7a07045 View commit details
    Browse the repository at this point in the history

  3. removed whitespace

    Jorrit Sandbrink committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    61712b4 View commit details
    Browse the repository at this point in the history

Commits on Apr 22, 2024

  1. explicitly fetch credentials from pg_replication source

    Jorrit Sandbrink committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    fd1d973 View commit details
    Browse the repository at this point in the history

  2. add superuser check

    Jorrit Sandbrink committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    8bc4da3 View commit details
    Browse the repository at this point in the history

Commits on May 1, 2024

  1. Merge branch 'master' into 933-postgres-replication

    @rudolfix
    rudolfix committed May 1, 2024
    Configuration menu
    Copy the full SHA
    796c980 View commit details
    Browse the repository at this point in the history

  2. updates lock file

    @rudolfix
    rudolfix committed May 1, 2024
    Configuration menu
    Copy the full SHA
    77fb1dd View commit details
    Browse the repository at this point in the history

Commits on May 2, 2024

  1. use psycopg2-binary instead of psycopg2

    Jorrit Sandbrink committed May 2, 2024
    Configuration menu
    Copy the full SHA
    8a1d910 View commit details
    Browse the repository at this point in the history

  2. use destination-specific escape identifier

    Jorrit Sandbrink committed May 2, 2024
    Configuration menu
    Copy the full SHA
    b0d2abb View commit details
    Browse the repository at this point in the history

  3. replace string literal with int literal

    Jorrit Sandbrink committed May 2, 2024
    Configuration menu
    Copy the full SHA
    f63ceff View commit details
    Browse the repository at this point in the history

  4. include pypgoutput decoders in library

    Jorrit Sandbrink committed May 2, 2024
    Configuration menu
    Copy the full SHA
    22758fe View commit details
    Browse the repository at this point in the history