Haziq Hilmi

Character name

Data Engineer, level 2

Class & level

Computer Science (AI)

Background

Selangor, Malaysia

Home

Malay, English

Languages

Data engineering+316

Infrastructure+215

Programming+215

Databases+214

Cloud+112

Machine learning+112

Skills

+2Proficiency bonus

+5AirflowData
+3SparkData
+5Microsoft FabricData
+4KubernetesInfra
+4DockerInfra
+4LinuxInfra
+4ProxmoxInfra
+4PythonCode
+4FastAPICode
+2TypeScriptCode
+2ReactCode
+4SQLDatabases
+4MSSQLDatabases
+4MongoDBDatabases
+3AWSCloud
+3Gemini APIML
+1PyTorchML

Daily use Some use

Other proficiencies

MySQL, Redshift, DynamoDB, TrueNAS, Caddy, Tailscale, Vercel, Fly.io, Git, Jira. CCNA: Introduction to Networks (Cisco).

Personality

Trait

I would rather host it myself than pay for it.

Ideal

Automation. If I do it twice by hand, the third time a script does it.

Bond

My family uses my home server every day.

Flaw

I ... cannot ... stop ..vibecoding..

Experience

Data Scientist / Data Engineer, Webqlo

Aug 2024 to now

Moved an enterprise client's data platform from SQL Server to Microsoft Fabric. I built the ETL pipelines on a medallion architecture: raw data lands in a Lakehouse, gets cleaned, and ends in a curated Warehouse layer.
Wrote SQL stored procedures on the curated layer that feed the client's dashboards for sales, customer feedback and employee analytics, with KPIs such as sales against budget, survey NPS, audit scores and staff turnover.
Built a read-only query service over the Fabric SQL endpoint, so people can ask data questions in plain language through AI assistants.
Built a crawler that collects social media posts, mentions and comments through RapidAPI and stores them in MongoDB.
Moved the crawl pipeline from cron jobs to Apache Airflow. It now runs about 2,000 crawl jobs a day, and a failed task shows its own error and retries by itself, so nobody has to SSH into each worker to debug it.
Set up a self-hosted Kubernetes cluster on 10 mini PCs. It serves the FastAPI endpoints that Airflow calls for data processing, and I watch its health in Headlamp.

Data Engineer Intern, AXRAIL

Jul to Dec 2022

Built an IoT sensor data capture system for more than 20 convenience stores, which stored thousands of sensor readings.
Built AWS QuickSight dashboards on that sensor data.
Tested a mobile app before its release to more than 1 million users.
Wrote AWS backend maintenance scripts for patching and CRUD operations.

BSc Computer Science (AI), Universiti Malaya

2020 to 2024

CGPA 3.75. Dean's List in 5 of 7 semesters. Champion of UM Hackathon 2022.

Equipment

MTG Card Scanner

Web app, live at mtgscanner.online

Take one photo of a pile of Magic cards, and it names and prices each card. I use it when I sell cards at night markets. Gemini, Scryfall, Card Kingdom, FastAPI, React.

Home Server

Built for RM1,500 from second-hand parts

Proxmox with TrueNAS and 24 Docker containers. Immich and Jellyfin keep 3.2 TB of my family's photos and media. Tailscale for remote access.

AFK Minimize

RuneLite plugin for Old School RuneScape

When my inventory fills up while I AFK mine, the game jumps to the front. I click a rock, and a second later it minimizes itself and I am back in my other window. Java, RuneLite.