Any tips or ideas on choosing a final year project? I don’t really have any ideas in mind other than implementing an LLM, not sure how applicable or good this is though, my major is computer engineering and i’m only interested in software dev
Any tips or ideas on choosing a final year project? I don’t really have any ideas in mind other than implementing an LLM, not sure how applicable or good this is though, my major is computer engineering and i’m only interested in software dev
I might misunderstand what you mean with “implementing” an LLM, but unless you have a good understanding of deep learning and math I wouldn’t recommend to implement one from scratch. There’s a lot of complex math involved in these kind of topics. If you mean implementing an application around an existing LLM, for example writing a chat website that interfaces with ChatGPT or a local LLM, then it’s doable (depending on you current skills).
The math involved in LLMs is not complex for anyone that has passed undergrad Calc and Linear Algebra classes. If you know derivatives, the chain rule and some matrix basics you can figure them out with enough studying.
The hard part about LLMs is not the math but the neural net architecture innovations they brought (eg self-attention)