PromptShark

PromptShark by Promptropy dynamically strips and reorders tokens in LLM inputs to reduce context length, drastically reducing inputs token costs and speeding up inference, all while retaining or even improving model response quality. Ideal for AI apps that have lengthy inputs(e.g. AI writing assistants) and GPT wrappers.