Fine-Tuning Open-Source Large Language Models
Overview The Fine-Tuning Open-Source Large Language Models Course is a CPD-accredited, fully online programme designed for learners who want to develop advanced generative AI and machine learning skills. This course introduces the process of adapting open-source large language models for specialised tasks, improving AI performance, and creating customised intelligent solutions. …
Overview
Overview
The Fine-Tuning Open-Source Large Language Models Course is a CPD-accredited, fully online programme designed for learners who want to develop advanced generative AI and machine learning skills. This course introduces the process of adapting open-source large language models for specialised tasks, improving AI performance, and creating customised intelligent solutions.
Throughout the course, you will explore LLM fine-tuning concepts, dataset preparation, model adaptation, training workflows, evaluation methods, optimisation techniques, and practical applications of open-source AI models. You will learn how developers customise language models to achieve better accuracy, domain-specific performance, and enhanced AI capabilities.
This course is ideal for AI developers, machine learning engineers, Python programmers, data scientists, and technology professionals looking to advance their generative AI expertise. With flexible online learning, CPD accreditation, and practical AI development concepts, it helps learners build confidence in working with modern language models.
Key highlights:
- Understand large language model fine-tuning
- Learn open-source AI model adaptation
- Explore dataset preparation techniques
- Optimise customised AI model performance
- Flexible self-paced online learning with lifetime access
- CPD-accredited for advanced AI skills
- Apply fine-tuning techniques to AI projects
Accreditation & Recognition
The Fine-Tuning Open-Source Large Language Models Course is CPD-accredited, supporting learners who want to develop practical artificial intelligence and machine learning capabilities. The course provides structured learning focused on LLM customisation, model optimisation, and modern AI engineering practices.
- 100% online and flexible learning experience
- Designed for AI and ML professionals
- Includes CPD-accredited certificate upon completion
- Supports progression into AI careers
Assessment & Certification
Your understanding of fine-tuning open-source large language models is assessed through an online multiple-choice assessment designed to evaluate your knowledge of LLM concepts, training workflows, dataset preparation, model evaluation, and AI optimisation techniques. You will receive instant results after completion and can retake the assessment if required. Upon successful completion, you can order your CPD Accredited certificate as evidence of your advanced AI engineering learning and professional development achievement.
Who Is This Course For?
- AI engineers developing customised models
- Machine learning professionals advancing skills
- Python developers building AI solutions
- Data scientists exploring LLM technology
- Technology professionals adopting generative AI
Career Opportunities & Progression
- LLM Engineer (£50,000 – £100,000)
- AI Engineer (£45,000 – £85,000)
- Machine Learning Engineer (£45,000 – £80,000)
- Generative AI Developer (£50,000 – £95,000)
- AI Research Engineer (£50,000 – £90,000)
Key Skills You’ll Gain
- Understanding LLM fine-tuning workflows
- Preparing datasets for AI training
- Customising open-source language models
- Evaluating model performance effectively
- Optimising AI model outputs
- Building specialised AI applications
- Developing advanced LLM engineering skills
Why Study with Royal Open College
Royal Open College is a trusted CPD-accredited training provider committed to helping learners develop practical and career-focused skills. Our online courses combine flexible study options with industry-relevant knowledge, allowing learners to build confidence and progress professionally.
- Expert-designed courses focused on practical skills
- 100% online learning with flexible access
- Affordable training with transparent pricing
- Trusted by learners developing future-ready skills
Enrol today in the Fine-Tuning Open-Source Large Language Models Course to strengthen your LLM expertise, develop advanced AI engineering skills, and prepare for the future of intelligent application development.
Curriculum
Curriculum
- 3 Sections
- 22 Lessons
- Lifetime Access
- Fine-Tuning of Large Language Models with LORA, SFTTrainer, PEFT, & TRL20 Items
- 1.1Introducing the Project with a Welcome Message: Fine-Tuning of LLMs4 Minutes
- 1.2Importing Key Libraries and Datasets6 Minutes
- 1.3Trying the Practice Question on GPU Detection: Tesla T4 and A1001 Minute
- 1.4Walking Through the Practice Solution for GPU Detection: Tesla T4 and A1002 Minutes
- 1.5Loading and Preparing the Financial News Datasets4 Minutes
- 1.6Trying the Practice Question on Exploring Data Imbalance and Seaborn Countplot1 Minute
- 1.7Walking Through the Practice Solution for Exploring Data Imbalance and Seaborn Countplot2 Minutes
- 1.8Formatting the Data into Supervised Fine-Tuning (SFT) Trainer Format7 Minutes
- 1.9Trying the Practice Question on Formatting DeepSeek Models in SFTTrainer Format1 Minute
- 1.10Walking Through the Practice Solution for Formatting DeepSeek Models in SFTTrainer Format3 Minutes
- 1.11Understanding the Confusion Matrix and Classification KPIs (Precision, Recall)6 Minutes
- 1.12Performing Zero-Shot Classification with the Base Model (Inference): Part 17 Minutes
- 1.13Performing Zero-Shot Classification with the Base Model (Inference): Part 23 Minutes
- 1.14Trying the Practice Question on Zero-Shot Inference on the Base Model1 Minute
- 1.15Walking Through the Practice Solution for Zero-Shot Inference on the Base Model2 Minutes
- 1.16Performing LLMs Fine-Tuning Using PEFT, LORA and SFTTrainer8 Minutes
- 1.17Evaluating Fine-Tuned Large Language Models3 Minutes
- 1.18Trying the Practice Question on Plotting the Confusion Matrix and KPIs for a Fine-Tuned LLM1 Minute
- 1.19Walking Through the Practice Solution for Plotting the Confusion Matrix and KPIs for a Fine-Tuned LLM1 Minute
- 1.20Wrapping Up with a Conclusion, Summary and Thank You2 Minutes
- Resources1 Item
- Practice Lab1 Item
Course Features
- Lectures 22
- Quiz 0
- Duration Lifetime access
- Skill level All Levels
- Language English
- Students 794
- Assessments Yes
Royal Open College provides high-quality online courses covering a variety of topics along with certificates issued by top organisations.
Quickly and easily check the validity of your
Royal Open College course certificates with Royal Open College’s Course Certificate Validator tool.
Payment methods possible
Copyright © 2026 Royal Open College. All Right Reserved.