Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

simple-genai-server 0.2: Make autonomous mode effective #3693

Merged
merged 2 commits into from
Mar 11, 2024

Commits on Mar 11, 2024

  1. simple-genai-server 0.2: Make autonomous mode effective

    This change does a number of things:
    
    * Adds a flag for concurrent player "slots" to imitate more than a
    single player in a game server.
    
    * Each player slot now runs forever instead of exiting, so ditched the
    waitgroup.
    
    * Instead of strictly going for a specific number of turns, added a
    "stop phrase". With prompt engineering, we can instruct the Sim to say
    a phrase when its done - we then key on this and go one more turn in
    response and end that player.
    
    * Did some careful prompt engineering to make Sim kind of
    interesting.
    
    * Cleaned up logging. Added inference "rate" in b/s.
    
    * Fixed yamllint complaints.
    
    I've already pushed :0.2 if you want to test with this branch.
    zmerlynn committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    9c388d3 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    60a1ed1 View commit details
    Browse the repository at this point in the history