Tech Stack I use daily as a Data Engineer

Overview : 

Category	Tools	Purpose
Databases & Infrastructure	Postico, PostgreSQL, ClickHouse, Snowflake, Elasticsearch, Apache Airflow, Kafka	Data storage, analytics, search, pipeline orchestration
Languages & Dev Tools	Python, VS Code, Docker, Hex	Programming, coding, environment setup, collaborative data analysis
Collaboration & Communication	Slack, Notion, Asana, Zoom, GitHub	Team communication, documentation, project management, video calls, code collaboration
Network & Security	AWS VPN	Secure connection to cloud infrastructure

---

🛢️ 1. Databases & Infrastructure

Tool	Type	What it is / Use
PostgreSQL(on RDS)	Relational DB	Main database for structured data
Postico	DB client	GUI client for PostgreSQL databases (Mac only)
ClickHouse	Columnar OLAP DB	High-speed analytics, log/event processing
Snowflake	Data warehouse	Scalable cloud-based SQL data lake/warehouse
Elasticsearch	NoSQL + Search engine	Fast full-text search, log queries
Apache Airflow	Workflow scheduler	DAG-based scheduling of data pipelines
Kafka	Event streaming platform	Real-time message queue, data transport layer

---

🛠️ 2. Languages & Dev Tools

Tool	Type	What it is / Use
Python	Programming language	Scripting, data processing, automation
VS Code	Code editor	Lightweight IDE for coding and debugging
Docker	Container platform	Isolated dev/test environments, portability
Hex	Data notebook	Collaborative SQL+Python notebooks (for analysis + reporting)

 

---

🧑‍💼 3. Collaboration & Communication

Tool	Type	What it is / Use
Slack	Team chat	Real-time messaging, alerts, integrations
Notion	Docs & Project notes	Notes, internal documentation, team knowledge
Asana	Task manager	Project and task tracking
Zoom	Video conference	Meetings, stand-ups, remote calls
GitHub	Code hosting	Source code version control, code collaboration (Git)

 

---

🔐 4. Network & Security

Tool	Type	What it is / Use
AWS VPN	Secure network tunnel	Private access to AWS resources from internal systems