WARNING: THIS SITE IS A MIRROR OF GITHUB.COM / IT CANNOT LOGIN OR REGISTER ACCOUNTS / THE CONTENTS ARE PROVIDED AS-IS / THIS SITE ASSUMES NO RESPONSIBILITY FOR ANY DISPLAYED CONTENT OR LINKS / IF YOU FOUND SOMETHING MAY NOT GOOD FOR EVERYONE, CONTACT ADMIN AT ilovescratch@foxmail.com
Skip to content
View m-dougl's full-sized avatar

Highlights

  • Pro

Block or report m-dougl

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don't include any personal information such as legal names or email addresses. Markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
m-dougl/README.md

Hi, I'm Douglas 👋

👨‍💻 About Me

I’m a Data Engineer at TIM Brazil, passionate about building scalable data solutions and applying Machine Learning to Big Data challenges. My mission is to transform large datasets into valuable insights and innovative products for the telecommunications industry.

  • 🔭 Currently working with Python, SQL, and Airflow to build complex pipelines
  • 🌱 Expanding skills in Cloud (AWS, GCP) and the modern data stack
  • 🤝 Open to collaborating on Data Engineering and MLOps open-source projects
  • 💬 Ask me about Python, Data Orchestration, Big Data, and ML in production

🚀 Featured Projects

End-to-end pipeline that extracts weather API data, orchestrates with Airflow, loads into PostgreSQL, and serves insights via a Streamlit dashboard. Containerized with Docker and deployed on AWS.
Stack: Airflow · Docker · AWS · PostgreSQL · Streamlit · Pandas


Simulated RAN traffic system generating synthetic telecom data with Faker. Orchestrated with Airflow, processed with Pandas/SQL, and visualized on Streamlit. Includes validation with Pydantic.
Stack: Python · Airflow · Docker · PostgreSQL · Streamlit · SQLAlchemy


Sentiment classification for Portuguese texts using NLP techniques and ML models. Focus on preprocessing, feature extraction, and model evaluation.
Stack: Python · spaCy · NLTK · Pandas · NumPy · Matplotlib


A full-stack CRUD application with a FastAPI backend and Streamlit frontend. Fully containerized with Docker, showcasing API and front-end integration.
Stack: FastAPI · Streamlit · Docker · PostgreSQL


🛠️ Tech Stack

Data Orchestration
Airflow
AWS Glue

Data Processing & Transformation
Spark
dbt
Pandas
Kafka

Databases & Storage
Postgres
MySQL
MongoDB
Redis
Amazon S3
AWS RDS
AWS Redshift
Google Cloud Storage
Google BigQuery

ML & Data Science
TensorFlow
PyTorch
Scikit-learn
Jupyter
Vertex AI

Languages, Cloud & DevOps
Python
C++
FastAPI
AWS
GCP
Cloud Run
Docker
Git
Linux
AWS EC2

Pinned Loading

  1. ran-traffic-monitor ran-traffic-monitor Public

    Python 1

  2. weather-monitor weather-monitor Public

    Python 1

  3. users-management users-management Public

    Python 1 1

  4. smart-home-mqtt smart-home-mqtt Public

    C++

  5. projeto-microprocessador projeto-microprocessador Public

    C++

  6. emotion-analysis emotion-analysis Public

    emotion analysis in short texts using models provided by the scikit-learn library.

    Jupyter Notebook 3 1