24
+340
// summary
llmfit is a terminal tool designed to automatically evaluate and recommend the most suitable large language models to run based on a user's CPU, RAM, and GPU hardware configuration. It provides intuitive adaptation suggestions by detecting system specifications and comprehensively considering model quality, running speed, memory usage, and context capabilities. The tool supports interactive TUI and command-line modes, and provides a REST API to meet the needs of automated scripts or cluster scheduling.
// use cases
01
Automatically detect system hardware and recommend the most suitable LLM models to run
02
Quickly compare the performance and adaptation of different models via interactive TUI or CLI
03
Use Plan mode to estimate the hardware specifications required for specific model configurations