Skip to content
View cqllum's full-sized avatar
🔦
🔦
  • United Kingdom

Block or report cqllum

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
cqllum/README.md

Hi there 👋

🚀 About Me

Hello! I'm a well rounded Data Engineer and Business Intelligence Developer from the United Kingdom, with a strong focus on real-time and batch data processing, full stack development, database administration, and building efficient data pipelines. I specialize in transforming raw data into actionable insights through the development of robust and efficient data pipelines, engaging web applications, and comprehensive dashboards for data visualization.

🎨 My Background

Since the age of 10, I have gained a background in IT, data engineering, web/software development and data analytics. My expertise includes creating sophisticated data processing scripts and pipelines, developing both frontend and backend web applications, and implementing advanced scripting and automation. I am also adept at designing advanced dashboards that offer deep insights and clear visualizations. I am dedicated to delivering high-quality, scalable solutions and continuously exploring innovative ways to leverage data. I am very sophisticated in my approaches relevant to anything IT, focusing on efficiency and unlocking true potential from systems with my indepth knowledge and eagerness to learn new tech. I am also a heavy supporter of documentation.


🦾 What am I currently working on?

A real time CDC Data Replication process written in to speedup data replication from traditional OLTP databases to a ClickHouse Data Warehouse.

View it here


🖊️ Some things I've made

A data warehouse schema creation tool powered by AI and to quickly create data structures using your databases Information schema & Google's
View it here

A business website generator with full backend control, completely databaseless written in to speedup creation of a website using pure PHP and JSON. Including themes, SEO and content control
View it here

A secure single note sharing application written in Python (flask) to help share sensitive one time note data, allowing you to skip out on 3rd party solutions and avoid compromise.
View it here


💻 Technical Skillset

Take a look below and learn a bit more about my skillset

🔑 Key Skills Overview

Data Engineering, Frontend+Backend Web Development, API Development, ETL Development, Data Services, Business Intelligence, Data Warehousing, Database Administration, DB Backup/Restore Data Analytics, Dashboarding, Reporting, Query Writing/Optimisation, Stored Procedure/Function Development, Web Scraping, Data Collection, Data Cleansing, Automation, Monitor/Alert Development, Generative AI Development, IoT Development (Cameras Data), Excel Macros/Google Apps Script

👨‍💻 Programming

SQL Python PHP Javascript Flask Django jQuery HTML5 CSS3 Bootstrap Bash PowerShell Java React Go Perl Lua C# R Google Apps Script GraphQL Markdown LaTeX Jinja JSON

💿 Database - SQL/NoSQL - (OLTP/OLAP)

Postgres MicrosoftSQLServer MySQL Mariadb SQLite Oracle ClickHouse Singlestore BigQuery Redis MongoDB ElasticSearch InfluxDB

🏃 Data Pipelines / Processing (ETL)

Apache Kafka Apache Spark Apache Airflow Zookeeper Mirrormaker Selenium Chromedriver Pandas NumPy SciPy Scikit Learn OpenCV Tensorflow dbt Airbyte Seaborn Matplotlib NLTK

📊 Business Intelligence (BI) + Monitoring

Looker PowerBi Tableau Metabase Grafana DataDog Excel Amazon Quicksight Jaspersoft Studio

☁️ Cloud

Google Cloud AWS Azure DigitalOcean OVH IONOS Vultr Vercel

🎫 OS Exposure

Windows iOS MacOS Ubuntu Debian CentOs Rocky Linux Red Hat ChromeOS Android

🧉 Virtualisation

Proxmox VMWare VirtualBox HyperV Nutanix Docker Kubernetes Qemu

🤖 AI

ChatGPT Google Gemini Copilot

🕒 Version Control

Git GitHub GitLab

🤝 Collaboration

Jira Asana Manage Engine SD+ Monday Microsoft Teams Miro Slack Badge Skype

🛠️ Other

NGINX Apache2 Lightspeed Linux Microsoft Office Libre Office Cloudflare Heroku Vim Adobe Adobe Photoshop Gimp Adobe XD Figma Adobe Illustrator

Pinned Loading

  1. db2ch db2ch Public

    ⚡Replicate your Database to Clickhouse in real time without Debezium, Kafka, or Clickhouse Materialized Engines

    Go 3

  2. php-website-generator php-website-generator Public

    PHP Business website generator - Databaseless

    CSS

  3. schema2dwh schema2dwh Public

    ⚡ Automatically produce a data model on your database using its information schema using GenAI.

    Python 1

  4. private-note private-note Public

    Python Flask & SQLite based Localised Private note sharing application. Secure business data. Skip the third parties.

    HTML