AUTOMATED DATASET PREPROCESSING

Computer Engineering

Machine Learning (ML) has grown rapidly in recent years, with many resources available for people to become ML practitioners. Companies are profiting from ML analysis and predictions, and ML Engineers are in high demand and well-compensated. ML has become more prevalent and easier to understand. One crucial stage in ML is Data preprocessing and feature extraction. Data preprocessing involves various tasks to accurately prepare the provided data. From handling missing values to encoding and normalization, each step is important and requires expertise. The preprocessing steps depend on the type of data, such as categorical data, continuous data, or even image data. Learning and becoming an expert in all the cleaning steps can be challenging and time-consuming, with no guarantee of desired results. This is where automation can help. Our goal is to automate the entire data preprocessing process, making it easier and more productive for ML Engineers. Users will only need to provide the dataset without manually selecting processing techniques, as done in the latest Data Mining tools. Our application will analyze the dataset and automatically apply suitable techniques. With automation, even people unfamiliar with ML concepts can preprocess the dataset. This opens up opportunities for individuals from various domains who want to perform ML operations but lack expertise in preprocessing. By automating data preprocessing, we aim to simplify the work for ML Engineers, increase productivity, and make ML more accessible to a wider range of users.

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.