Initial commit: LLM workshop materials
Five modules covering nanoGPT, Ollama, RAG, semantic search, and neural networks. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This commit is contained in:
commit
1604671d36
56 changed files with 5577 additions and 0 deletions
56
README.md
Normal file
56
README.md
Normal file
|
|
@ -0,0 +1,56 @@
|
|||
# LLMs for Engineers
|
||||
|
||||
**CHEG 667-013 — Chemical Engineering with Computers**
|
||||
Department of Chemical and Biomolecular Engineering, University of Delaware
|
||||
|
||||
A hands-on workshop on Large Language Models and machine learning for engineers. Learn how to train a GPT from scratch, run local models, build retrieval-augmented generation systems, then tie it back to underlying machine learning methods by implementing a simple neural network.
|
||||
|
||||
## Sections
|
||||
|
||||
| # | Topic | Description |
|
||||
|---|-------|-------------|
|
||||
| [01](01-nanogpt/) | **nanoGPT** | Train a small transformer on Shakespeare. Explore model parameters, temperature, and text generation. |
|
||||
| [02](02-ollama/) | **Local models with Ollama** | Run pre-trained LLMs locally. Summarize documents, query arXiv, generate code, build custom models. |
|
||||
| [03](03-rag/) | **Retrieval-Augmented Generation** | Build a RAG system: chunk documents, embed them, and query with an LLM grounded in your own data. |
|
||||
| [04](04-semantic-search/) | **Advanced retrieval** | Hybrid BM25 + vector search with cross-encoder re-ranking. Compares summarization versus raw retrieval. |
|
||||
| [05](05-neural-networks/) | **Building a neural network** | Implement a one-hidden-layer network from scratch in numpy, then in PyTorch. Fits $C_p(T)$ data for N₂. |
|
||||
|
||||
|
||||
|
||||
## Prerequisites
|
||||
|
||||
- A terminal (macOS/Linux, or WSL on Windows)
|
||||
- Python 3.10+
|
||||
- Basic comfort with the command line
|
||||
- [Ollama](https://ollama.com) (sections 02–04)
|
||||
|
||||
## Getting started
|
||||
|
||||
Clone this repository and work through each section in order:
|
||||
|
||||
```bash
|
||||
git clone https://lem.che.udel.edu/git/furst/llm-workshop.git
|
||||
cd llm-workshop
|
||||
```
|
||||
|
||||
Each section has its own `README.md` with a full walkthrough, exercises, and any code or data needed.
|
||||
|
||||
### Python environment
|
||||
|
||||
Create a virtual environment once and reuse it across sections:
|
||||
|
||||
```bash
|
||||
python3 -m venv llm
|
||||
source llm/bin/activate
|
||||
pip install numpy torch matplotlib
|
||||
```
|
||||
|
||||
Sections 03 and 04 have additional dependencies listed in their `requirements.txt` files.
|
||||
|
||||
## License
|
||||
|
||||
MIT
|
||||
|
||||
## Author
|
||||
|
||||
Eric M. Furst, University of Delaware
|
||||
Loading…
Add table
Add a link
Reference in a new issue