tiktoken
Here are 25 public repositories matching this topic...
A custom GPT based on [Zero To Hero](https://karpathy.ai/zero-to-hero.html) utilizing tiktoken with the intent to augment AI Transformer-model education and reverse engineer GPT models from scratch.
-
Updated
Jun 19, 2023 - Python
Simple wrapper around tiktoken to use it in your favorite language.
-
Updated
Jul 8, 2023 - Python
The ChatGPT Long Term Memory package is a powerful tool designed to empower your projects with the ability to handle a large number of simultaneous users and external sources.
-
Updated
Jul 31, 2023 - Python
В рамках хакатона был создан телеграм бот для консультации с клиентами с сфере обслуживания магазина "Ашан"
-
Updated
Aug 23, 2023 - Python
Predict the exact openai token usage of functions
-
Updated
Sep 20, 2023 - Python
console based game based on a llm
-
Updated
Oct 29, 2023 - Python
Logseq Markdown Tokenizer is a Python application that tokenizes and estimates prices for one to many markdown files.
-
Updated
Mar 7, 2024 - Python
Web crawling GUI app for non-govermental events, easy integration with custom proxy, user agents, ApenAI Api and Redis Stack. Enjoy!
-
Updated
Apr 17, 2024 - Python
This project harnesses the power of Tiktoken and the OpenAI API to create a Python Streamlit web application with a primary focus on token counting and price estimation.
-
Updated
May 27, 2024 - Python
-
Updated
Jun 23, 2024 - Python
An Industry Standard Tokenizer, purposed for large-scale language models like OpenAI's GPT Series.
-
Updated
Jun 29, 2024 - Python
Extracts Google Sheets to JSONL for fine-tuning, estimates task costs with tiktoken.
-
Updated
Jul 6, 2024 - Python
Improve this page
Add a description, image, and links to the tiktoken topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the tiktoken topic, visit your repo's landing page and select "manage topics."