A collection of simple yet practical tools for AI development workflow. These are tools I've built to make my own AI development process smoother and more efficient.
Working with AI models involves a lot of repetitive tasks - counting tokens, comparing model outputs, managing prompts, and tracking costs. I found myself building these tools for my own use, and figured they might be useful to others as well.
Compare responses from different AI models side by side. Track response times, token usage, and costs all in one view. Perfect for:
- A/B testing prompts across models
- Analyzing cost-performance tradeoffs
- Checking response consistency
Simple but effective token counting tool with cost estimation. Features:
- Real-time token estimation
- Cost calculation for different models
- Input validation and formatting
- Store and organize prompt templates
- Version control your prompts
- Track prompt performance
- Compare model outputs against defined criteria
- Generate basic performance metrics
- Track consistency across runs
# Clone the repository
git clone https://github.com/yourusername/ai-toolbelt
# Install dependencies
npm install
# Start the development server
npm run dev- React
- Tailwind CSS
- shadcn/ui components
Contributions are welcome! Whether it's adding new tools, improving existing ones, or fixing bugs - feel free to open a PR.
MIT License - feel free to use these tools however you'd like.
Built with ☕ and curiosity. If you find these tools useful, a star would be appreciated!