Writing ·

Becoming a data scientist

Originally on LinkedIn

Titles change with markets. Craft accumulates more slowly. When I went through IIM Ahmedabad’s executive programme in Advanced Business Analytics and AI (2018–2019), the lasting lessons were not a list of algorithms—they were habits of mind for turning ambiguous business situations into tractable analytical work.

This post is a reflection on becoming effective in data science work: framing problems, telling the story, understanding data, questioning assumptions, engineering features thoughtfully, and preferring quality over volume.

The myth of the toolchain identity

It is easy to confuse “becoming a data scientist” with collecting tools: a bit of Python, a bit of SQL, a certification, a neural network tutorial. Tools matter. They are not the job.

The job is to reduce uncertainty for a decision or a product behaviour—under constraints of data, time, ethics, and organisational reality. People who only chase models struggle when the data is messy or the question is unclear. People who can frame and validate problems remain useful as toolchains evolve.

Frame the business problem first

Before modelling, write the decision:

If you cannot state the decision, you are decorating. Framing also reveals when analytics is the wrong hammer: sometimes you need a process change, better instrumentation, or a simpler rule.

Tell the story

Analysis that cannot be communicated does not ship. Story here does not mean spin. It means a clear narrative:

Leaders remember structure and trade-offs. They forget model names.

Understand the data before you model it

Sit with distributions, missingness, joins, and generation processes. Ask how fields are produced in the operational system. Many “model problems” are undocumented business rules and broken logging.

Practical habits:

Question assumptions—especially your own

Every dataset encodes a worldview: who was included, what was measured, which outcomes were labelled. Assumptions hide in target definitions, filtering steps, and “obvious” features.

Good practitioners keep a written assumption list and attack it. What would falsify this approach? Which segments are thin? Where could leakage create fake accuracy?

Features: where craft shows

Feature work is underrated because it is not glamorous. Yet thoughtful features—grounded in domain mechanisms—often beat exotic models on weak representations.

Focus on:

Automated feature tools can help; they do not replace domain thinking.

Quality over volume

More rows are not automatically more truth. More columns are not automatically more signal. Prefer:

Volume without quality industrialises mistakes.

A pragmatic learning path

If you are moving into this work from engineering or business:

  1. Learn enough statistics to talk about uncertainty without bluffing
  2. Get dangerous with SQL and data wrangling—most time goes here
  3. Build a few end-to-end projects that include deployment and monitoring, not only notebooks
  4. Practice problem framing with real stakeholders
  5. Study failure cases: bias, drift, leakage, incentive gaming
  6. Keep ethics concrete: data permission, impact on people, human oversight

Programmes and courses—including executive programmes like the one I completed at IIMA—work best when you apply them immediately to live problems at work.

Working with engineers and the business

Data science does not succeed in isolation. With engineering, agree on contracts: feature freshness, training/serving parity, monitoring signals, and rollback plans. With the business, agree on decision rights and what “good enough” means before you optimise a loss function nobody will use.

Fusion skills matter: you should be able to sit in an architecture review and a stakeholder workshop without changing personalities. Translate requirements into data needs; translate model limits into operational controls.

Ethics as part of craft, not a footnote

Becoming effective also means knowing when not to build. If labels encode historical discrimination, if consent is unclear, or if the action space can harm people at scale, the professional move may be to refuse, redesign, or insist on human oversight. Technical excellence without that judgment is incomplete.

Closing the loop after the model

“Done” is not a validation score. Done includes how the output enters a workflow, how errors are caught, how drift is monitored, and how owners respond. Practitioners who stop at the notebook handoff leave the hardest part—organisational learning—to chance.

Closing

Becoming a data scientist is less about joining a tribe and more about adopting a discipline: frame the business problem, understand the data, question assumptions, craft features carefully, communicate clearly, and never confuse volume with quality.

Tools will keep changing. Those habits transfer.

← All writing