Holden Karau Portfolio
GitHub profile of Holden Karau, an Apache Spark committer and co-author of Learning Spark and High Performance Spark, maintaining spark-testing-base — a widely used library for writing tests against Spark jobs — among 300+ public repositories.
What makes it work
A breakdown of the choices that make this portfolio stand out.
Testing infrastructure for a tool most engineers only consume
spark-testing-base solves a problem most Spark users hit but rarely build tooling for (how do you actually unit-test a Spark job), which is why it has drawn heavy, sustained adoption rather than being a niche utility.
Books that extend committer-level knowledge to a wider audience
Learning Spark and High Performance Spark translate deep, project-internals-level knowledge into material approachable for working data engineers, bridging a gap that pure API documentation doesn't close.
A cluster of small, complementary Spark utilities
Beyond the flagship testing library, smaller repos (a validator, a debugging flowchart, a project template) each solve one specific pain point in the Spark workflow rather than trying to be one big framework.
What Data Engineers can take from this
Specific, actionable tips to apply to your own portfolio — no generic advice.
Look for the unglamorous but universally needed problem in your ecosystem (like testing) — solving it well can outlast flashier projects.
If you have deep internals knowledge of a tool, consider writing it up for a broader audience; a book or long guide reaches people your code alone won't.
Ship a cluster of small, single-purpose utilities around a flagship project instead of trying to fold every feature into one repository.
More Data Engineer portfolios
Ready to build your portfolio?
Follow the Data Engineer roadmap — skills, projects, and timeline to get hired.