I do not have the budget or the hardware to train a massive foundation model, so I am looking into fine-tuning smaller models. What is the best way to start? I am focused on a very specific domain and I have a decent dataset. Should I be looking at LoRA, or is there a better approach for someone just starting out in the ecosystem? I would appreciate a path from data preparation to final deployment.

