Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Prepro rework: parallelization strategy change #171

Merged
merged 10 commits into from
Oct 12, 2023
Merged

Prepro rework: parallelization strategy change #171

merged 10 commits into from
Oct 12, 2023

Commits on Oct 11, 2023

  1. added timeout for ray model service

    @floschne
    floschne committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    9868b9d View commit details
    Browse the repository at this point in the history

  2. SQLService echo off by default

    @floschne
    floschne committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    36ecf8e View commit details
    Browse the repository at this point in the history

  3. removed unnecessary logger output

    @floschne
    floschne committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    e5b92ac View commit details
    Browse the repository at this point in the history

  4. fixed imports in main

    @floschne
    floschne committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    968d045 View commit details
    Browse the repository at this point in the history

Commits on Oct 12, 2023

  1. removed old simsearch code

    @floschne
    floschne committed Oct 12, 2023
    Configuration menu
    Copy the full SHA
    8b79576 View commit details
    Browse the repository at this point in the history

  2. implemented helper functions in crud ppj

    @floschne
    floschne committed Oct 12, 2023
    Configuration menu
    Copy the full SHA
    3643fda View commit details
    Browse the repository at this point in the history

  3. removed multiproessing in prepro pipeline and made all methods to be … 

    …executed for a single cargo
    @floschne
    floschne committed Oct 12, 2023
    Configuration menu
    Copy the full SHA
    130a56c View commit details
    Browse the repository at this point in the history

  4. updated celery prepro methods to only accept a single cargo

    @floschne
    floschne committed Oct 12, 2023
    Configuration menu
    Copy the full SHA
    cfb4d9f View commit details
    Browse the repository at this point in the history

  5. removed unnecessary old configs

    @floschne
    floschne committed Oct 12, 2023
    Configuration menu
    Copy the full SHA
    d89788f View commit details
    Browse the repository at this point in the history

  6. set default bg jobs worker concurrency to 10

    @floschne
    floschne committed Oct 12, 2023
    Configuration menu
    Copy the full SHA
    389373a View commit details
    Browse the repository at this point in the history