Crafting Text Generators: A Dive into Transformer Architecture

At the time of writing this post (its Polish version was created in April/May 2023), there’s still quite a widespread excitement about the possibilities of large language models. These possibilities were spectacularly showcased to us by a solution released at the end of 2022 by OpenAI, and our world will never be the same again. …

Read more

Categories NLP

Fine-tuning with limited hardware resources

In 2023, we are witnessing a boom in language models and their practical applications. ChatGPT has sparked interest in replicating its success, and many teams have published the results of their work. A large portion of the new models have been released under the Apache 2.0 license, which allows for their free modification, use, and …

Read more

Categories NLP

Welcome tomorrow – how AI will shape the world by 2032

When in 2019 I started this blog, I allowed myself to be a little controversial by writing “AI will change the world more than the industrial revolution.” Of course, prediction is very difficult, especially if it’s about the future (Niels Bohr), but recent developments in machine learning have made me think about how AI will …

Read more

PyTorch: dividing dataset, transformations, training on GPU and metric visualization

In machine learning designing the structure of the model and training the neural network are relatively small elements of a longer chain of activities. We usually start with understanding business requirements, collecting and curating data, dividing it into training, validation and test subsets, and finally serving data to the model. Along the way, there are …

Read more

Data preparation with Dataset and DataLoader in Pytorch

Preparing your data for machine learning is not a task that most AI professionals miss. Data are of different quality, most often they require very thorough analysis, sometimes manual review, and certainly selection and initial preprocessing. In the case of classification tasks, the division of a dataset into classes may be inappropriate or insufficiently balanced. …

Read more

YOLO fast object detection and classification

Computer Vision is one of the most interesting and my favorite application area for artificial intelligence. A big challenge for image analysis algorithms is fast detection and classification of objects in real time. The problem of detecting objects is much more difficult than the classification that I have discussed many times on my blog. That’s …

Read more

Artificial intelligence and blockchain

Looking at the advances in technology over the past few years, it’s hard to name two more breakthrough technologies than artificial intelligence and blockchain. The former opened up entirely new possibilities in the fields of data analysis, predictions and robotics. The later one elevated decentralization, transparency and security as a result of the immutability built …

Read more

Artificial intelligence – a few key concepts

Until recently, a large part of the key concepts in the field of artificial intelligence was not so clearly defined. Some of them, such as Deep Learning, were even referred to as “buzzwords”, term used mainly by marketing and not strictly translated into scientific areas. Now, the basic concepts seem to have taken hold, and …

Read more

k-nearest neighbors for handwriting recognition

If I had to indicate one algorithm in machine learning that is both very simple and highly effective, then my choice would be the k-nearest neighbors (KNN). What’s more, it’s not only simple and efficient, but it works well in surprisingly many areas of application. In this post I decided to check its effectiveness in …

Read more