Learning Data Engineering During Service & Earning Professional Certifications

One of the questions I hear most often is: “Where do you find time to learn during service? Data technology changes so quickly. Aren't you worried about falling behind?”My answer is that study time comes from deliberate choices and a consistent routine.

1. Focused Study Blocks During Service

Days are divided between training, physical exercise, patrols, and duty shifts. I rarely have an uninterrupted four- or five-hour morning to study.

Instead, I use focused study blocks.:

• The 9:00-11:30 p.m. study window: When duties allow, a small desk becomes my study space. I turn off social media and notifications and use the time to read Snowflake and dbt documentation and practice SQL.
• Atomic notes: I summarize architectural principles in short Markdown notes, focusing on why a system is designed a particular way rather than memorizing syntax.

“When your time is limited, focused attention matters. Two hours of deliberate study can be more useful than a full day of distracted activity.”

2. Preparing for HackerRank SQL Advanced

My SQL preparation includes challenging query patterns: gaps and islands, recursive CTEs, and window functions with complex grouping and ordering logic.

• Before writing a SELECTstatement, I sketch the intermediate tables and processing logic on paper.
• I review the ordering of PARTITION BY and ORDER BY in functions such as DENSE_RANK(), LAG(), LEAD() to avoid unnecessary repeated work.

-- Solve gaps & and islands using the difference between two ROW_NUMBER sequences
WITH ranked_events AS (
  SELECT customer_id, event_date,
    ROW_NUMBER() OVER (PARTITION BY customer_id ORDER BY event_date) AS seq,
    ROW_NUMBER() OVER (PARTITION BY customer_id, is_active ORDER BY event_date) AS active_seq
  FROM user_activity_logs
)
SELECT customer_id, MIN(event_date) AS streak_start, MAX(event_date) AS streak_end,
  COUNT(*) AS streak_length_days
FROM ranked_events
GROUP BY customer_id, (seq - active_seq)
HAVING COUNT(*) >= 7
ORDER BY streak_length_days DESC;

3. DataCamp Data Engineer Associate: Strengthening Pipeline Fundamentals

While SQL practice develops query logic, the DataCamp Data Engineer Associate certification provides a broader assessment of data engineering foundations:

1. Data Ingestion & Quality Control: Handling schema changes, null checks, type casting, and deduplication during ingestion.
2. Data Warehouse Design: Organizing Kimball star schemas, distinguishing facts from dimensions, and managing surrogate and foreign keys.
3. Security & Governance: Role-based access control and encryption at rest and in transit.

For Anyone Who Feels Short of Time

Do not wait for a perfect schedule. Start with 30 minutes a day. A consistent routine builds knowledge and confidence over time.