GPU - manduk.ai

Fine-tuning with limited hardware resources

February 14, 2024June 26, 2023

In 2023, we are witnessing a boom in language models and their practical applications. ChatGPT has sparked interest in replicating its success, and many teams have published the results of their work. A large portion of the new models have been released under the Apache 2.0 license, which allows for their free modification, use, and …

PyTorch: dividing dataset, transformations, training on GPU and metric visualization

May 6, 2024April 10, 2022

In machine learning designing the structure of the model and training the neural network are relatively small elements of a longer chain of activities. We usually start with understanding business requirements, collecting and curating data, dividing it into training, validation and test subsets, and finally serving data to the model. Along the way, there are …